spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 06:59:33,728|FF|app-00000000000000-0000|15|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 06:59:34,845|FF|app-20190625065934-0112|15|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 06:59:34,845|FF|app-20190625065934-0112|15|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 06:59:39,018|FF|app-20190625065934-0112|15|4| END| 5.27|Data read | 4.17|331128|-1 2019-06-25 06:59:39,018|FF|app-20190625065934-0112|15|4|START| 5.27|KDBTree partitioner | 0.00| 0|-1 2019-06-25 06:59:39,440|FF|app-20190625065934-0112|15|4| END| 5.70|KDBTree partitioner | 0.42| 816|-1 2019-06-25 06:59:39,440|FF|app-20190625065934-0112|15|4|START| 5.70|MF partitioner | 0.00| 0|-1 2019-06-25 06:59:39,462|FF|app-20190625065934-0112|15|4| END| 5.72|MF partitioner | 0.02| 1350|-1 2019-06-25 06:59:39,462|FF|app-20190625065934-0112|15|4|START| 5.72|Pointset done | 0.00| 0|-1 2019-06-25 06:59:40,666|FF|app-20190625065934-0112|15|4| END| 6.92|Pointset done | 1.20| 4|-1 2019-06-25 06:59:40,666|FF|app-20190625065934-0112|15|4|START| 6.92|Flock Finder run | 0.00| 0|-1 2019-06-25 06:59:40,683|FF|app-20190625065934-0112|15|4|START| 6.94|1.Maximal disks found | 0.00| 0|0 2019-06-25 06:59:40,685|MF|app-20190625065934-0112|15|4|START| 6.94|A.Points indexed | 0.00| 0|0 2019-06-25 06:59:40,888|MF|app-20190625065934-0112|15|4| END| 7.14|A.Points indexed | 0.20| 54279|0 2019-06-25 06:59:40,889|MF|app-20190625065934-0112|15|4|START| 7.14|B.Pairs found | 0.00| 0|0 2019-06-25 06:59:42,824|MF|app-20190625065934-0112|15|4| END| 9.08|B.Pairs found | 1.94| 71679|0 2019-06-25 06:59:42,825|MF|app-20190625065934-0112|15|4|START| 9.08|C.Centers found | 0.00| 0|0 2019-06-25 06:59:44,598|MF|app-20190625065934-0112|15|4| END| 10.85|C.Centers found | 1.77|143358|0 2019-06-25 06:59:44,599|MF|app-20190625065934-0112|15|4|START| 10.85|D.Disks found | 0.00| 0|0 2019-06-25 06:59:51,757|MF|app-20190625065934-0112|15|4| END| 18.01|D.Disks found | 7.16| 52353|0 2019-06-25 06:59:51,757|MF|app-20190625065934-0112|15|4|START| 18.01|E.Disks partitioned | 0.00| 0|0 2019-06-25 06:59:54,261|MF|app-20190625065934-0112|15|4| END| 20.52|E.Disks partitioned | 2.50| 69681|0 2019-06-25 06:59:54,261|MF|app-20190625065934-0112|15|4|START| 20.52|F.Maximal disks found | 0.00| 0|0 2019-06-25 06:59:54,263|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 06:59:54,263|Cell area: 1055533.7681000116 2019-06-25 06:59:56,447|MF|app-20190625065934-0112|15|4| END| 22.70|F.Maximal disks found | 2.19| 17026|0 2019-06-25 06:59:56,448|MAXIMALS|app-20190625065934-0112|4|15|80.0|3|1350|15.763|17026 2019-06-25 06:59:57,515|FF|app-20190625065934-0112|15|4| END| 23.77|1.Maximal disks found | 16.83| 17026|0 2019-06-25 06:59:57,515|FF|app-20190625065934-0112|15|4|START| 23.77|1.Maximal disks found | 0.00| 0|1 2019-06-25 06:59:57,515|MF|app-20190625065934-0112|15|4|START| 23.77|A.Points indexed | 0.00| 0|1 2019-06-25 06:59:57,642|MF|app-20190625065934-0112|15|4| END| 23.90|A.Points indexed | 0.13| 54735|1 2019-06-25 06:59:57,642|MF|app-20190625065934-0112|15|4|START| 23.90|B.Pairs found | 0.00| 0|1 2019-06-25 06:59:58,752|MF|app-20190625065934-0112|15|4| END| 25.01|B.Pairs found | 1.11| 72729|1 2019-06-25 06:59:58,752|MF|app-20190625065934-0112|15|4|START| 25.01|C.Centers found | 0.00| 0|1 2019-06-25 07:00:00,292|MF|app-20190625065934-0112|15|4| END| 26.55|C.Centers found | 1.54|145458|1 2019-06-25 07:00:00,292|MF|app-20190625065934-0112|15|4|START| 26.55|D.Disks found | 0.00| 0|1 2019-06-25 07:00:07,940|MF|app-20190625065934-0112|15|4| END| 34.20|D.Disks found | 7.65| 53289|1 2019-06-25 07:00:07,941|MF|app-20190625065934-0112|15|4|START| 34.20|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:00:10,179|MF|app-20190625065934-0112|15|4| END| 36.43|E.Disks partitioned | 2.24| 70836|1 2019-06-25 07:00:10,180|MF|app-20190625065934-0112|15|4|START| 36.44|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:00:10,180|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:00:10,180|Cell area: 1055533.7681000116 2019-06-25 07:00:12,153|MF|app-20190625065934-0112|15|4| END| 38.41|F.Maximal disks found | 1.97| 17245|1 2019-06-25 07:00:12,153|MAXIMALS|app-20190625065934-0112|4|15|80.0|3|1350|14.638|17245 2019-06-25 07:00:13,172|FF|app-20190625065934-0112|15|4| END| 39.43|1.Maximal disks found | 15.66| 17245|1 2019-06-25 07:00:13,172|FF|app-20190625065934-0112|15|4|START| 39.43|2.Join done | 0.00| 0|1 2019-06-25 07:00:15,680|FF|app-20190625065934-0112|15|4| END| 41.94|2.Join done | 2.51| 27004|1 2019-06-25 07:00:15,680|FF|app-20190625065934-0112|15|4|START| 41.94|3.Flocks to report | 0.00| 0|1 2019-06-25 07:00:16,123|FF|app-20190625065934-0112|15|4| END| 42.38|3.Flocks to report | 0.44| 0|1 2019-06-25 07:00:16,123|FF|app-20190625065934-0112|15|4|START| 42.38|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:00:16,193|FF|app-20190625065934-0112|15|4| END| 42.45|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 07:00:16,193|FF|app-20190625065934-0112|15|4|START| 42.45|5.Flocks reported | 0.00| 0|1 2019-06-25 07:00:16,197|FF|app-20190625065934-0112|15|4| END| 42.45|5.Flocks reported | 0.00| 0|1 2019-06-25 07:00:16,197|FF|app-20190625065934-0112|15|4|START| 42.45|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:00:17,450|FF|app-20190625065934-0112|15|4| END| 43.71|6.Candidates indexed | 1.25| 28069|1 2019-06-25 07:00:17,450|FF|app-20190625065934-0112|15|4|START| 43.71|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:00:17,450|MF|app-20190625065934-0112|15|4|START| 43.71|A.Points indexed | 0.00| 0|2 2019-06-25 07:00:17,571|MF|app-20190625065934-0112|15|4| END| 43.83|A.Points indexed | 0.12| 55182|2 2019-06-25 07:00:17,572|MF|app-20190625065934-0112|15|4|START| 43.83|B.Pairs found | 0.00| 0|2 2019-06-25 07:00:18,418|MF|app-20190625065934-0112|15|4| END| 44.67|B.Pairs found | 0.85| 73710|2 2019-06-25 07:00:18,418|MF|app-20190625065934-0112|15|4|START| 44.67|C.Centers found | 0.00| 0|2 2019-06-25 07:00:20,149|MF|app-20190625065934-0112|15|4| END| 46.40|C.Centers found | 1.73|147420|2 2019-06-25 07:00:20,149|MF|app-20190625065934-0112|15|4|START| 46.40|D.Disks found | 0.00| 0|2 2019-06-25 07:00:23,681|MF|app-20190625065934-0112|15|4| END| 49.94|D.Disks found | 3.53| 54024|2 2019-06-25 07:00:23,681|MF|app-20190625065934-0112|15|4|START| 49.94|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:00:24,623|MF|app-20190625065934-0112|15|4| END| 50.88|E.Disks partitioned | 0.94| 71877|2 2019-06-25 07:00:24,623|MF|app-20190625065934-0112|15|4|START| 50.88|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:00:24,624|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:00:24,624|Cell area: 1055533.7681000116 2019-06-25 07:00:26,597|MF|app-20190625065934-0112|15|4| END| 52.85|F.Maximal disks found | 1.97| 17462|2 2019-06-25 07:00:26,597|MAXIMALS|app-20190625065934-0112|4|15|80.0|3|1350|9.147|17462 2019-06-25 07:00:27,595|FF|app-20190625065934-0112|15|4| END| 53.85|1.Maximal disks found | 10.15| 17462|2 2019-06-25 07:00:27,595|FF|app-20190625065934-0112|15|4|START| 53.85|2.Join done | 0.00| 0|2 2019-06-25 07:00:32,511|FF|app-20190625065934-0112|15|4| END| 58.77|2.Join done | 4.92| 38332|2 2019-06-25 07:00:32,511|FF|app-20190625065934-0112|15|4|START| 58.77|3.Flocks to report | 0.00| 0|2 2019-06-25 07:00:33,483|FF|app-20190625065934-0112|15|4| END| 59.74|3.Flocks to report | 0.97| 33043|2 2019-06-25 07:00:33,484|FF|app-20190625065934-0112|15|4|START| 59.74|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:00:33,558|FF|app-20190625065934-0112|15|4|START| 59.81|4a.Making expansions | 0.00| 0|2 2019-06-25 07:00:34,490|FF|app-20190625065934-0112|15|4| END| 60.75|4a.Making expansions | 0.93| 41709|2 2019-06-25 07:00:34,490|FF|app-20190625065934-0112|15|4|START| 60.75|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:00:35,606|FF|app-20190625065934-0112|15|4| END| 61.86|4b.Finding maximals | 1.12| 12225|2 2019-06-25 07:00:36,056|FF|app-20190625065934-0112|15|4| END| 62.31|4.Flocks prunned by expansion | 2.57| 12225|2 2019-06-25 07:00:36,056|FF|app-20190625065934-0112|15|4|START| 62.31|5.Flocks reported | 0.00| 0|2 2019-06-25 07:00:36,615|FF|app-20190625065934-0112|15|4| END| 62.87|5.Flocks reported | 0.56| 12225|2 2019-06-25 07:00:36,615|FF|app-20190625065934-0112|15|4|START| 62.87|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:00:38,158|FF|app-20190625065934-0112|15|4| END| 64.41|6.Candidates indexed | 1.54| 18597|2 2019-06-25 07:00:38,158|FF|app-20190625065934-0112|15|4|START| 64.41|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:00:38,158|MF|app-20190625065934-0112|15|4|START| 64.41|A.Points indexed | 0.00| 0|3 2019-06-25 07:00:38,272|MF|app-20190625065934-0112|15|4| END| 64.53|A.Points indexed | 0.11| 55644|3 2019-06-25 07:00:38,273|MF|app-20190625065934-0112|15|4|START| 64.53|B.Pairs found | 0.00| 0|3 2019-06-25 07:00:39,146|MF|app-20190625065934-0112|15|4| END| 65.40|B.Pairs found | 0.87| 74871|3 2019-06-25 07:00:39,146|MF|app-20190625065934-0112|15|4|START| 65.40|C.Centers found | 0.00| 0|3 2019-06-25 07:00:40,113|MF|app-20190625065934-0112|15|4| END| 66.37|C.Centers found | 0.97|149742|3 2019-06-25 07:00:40,113|MF|app-20190625065934-0112|15|4|START| 66.37|D.Disks found | 0.00| 0|3 2019-06-25 07:00:43,702|MF|app-20190625065934-0112|15|4| END| 69.96|D.Disks found | 3.59| 54930|3 2019-06-25 07:00:43,702|MF|app-20190625065934-0112|15|4|START| 69.96|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:00:44,581|MF|app-20190625065934-0112|15|4| END| 70.84|E.Disks partitioned | 0.88| 73112|3 2019-06-25 07:00:44,581|MF|app-20190625065934-0112|15|4|START| 70.84|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:00:44,582|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:00:44,582|Cell area: 1055533.7681000116 2019-06-25 07:00:46,936|MF|app-20190625065934-0112|15|4| END| 73.19|F.Maximal disks found | 2.36| 17782|3 2019-06-25 07:00:46,936|MAXIMALS|app-20190625065934-0112|4|15|80.0|3|1350|8.778|17782 2019-06-25 07:00:47,943|FF|app-20190625065934-0112|15|4| END| 74.20|1.Maximal disks found | 9.79| 17782|3 2019-06-25 07:00:47,944|FF|app-20190625065934-0112|15|4|START| 74.20|2.Join done | 0.00| 0|3 2019-06-25 07:00:52,844|FF|app-20190625065934-0112|15|4| END| 79.10|2.Join done | 4.90| 37059|3 2019-06-25 07:00:52,844|FF|app-20190625065934-0112|15|4|START| 79.10|3.Flocks to report | 0.00| 0|3 2019-06-25 07:00:54,121|FF|app-20190625065934-0112|15|4| END| 80.38|3.Flocks to report | 1.28| 31049|3 2019-06-25 07:00:54,121|FF|app-20190625065934-0112|15|4|START| 80.38|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:00:54,213|FF|app-20190625065934-0112|15|4|START| 80.47|4a.Making expansions | 0.00| 0|3 2019-06-25 07:00:55,344|FF|app-20190625065934-0112|15|4| END| 81.60|4a.Making expansions | 1.13| 39878|3 2019-06-25 07:00:55,344|FF|app-20190625065934-0112|15|4|START| 81.60|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:00:56,251|FF|app-20190625065934-0112|15|4| END| 82.51|4b.Finding maximals | 0.91| 12384|3 2019-06-25 07:00:56,713|FF|app-20190625065934-0112|15|4| END| 82.97|4.Flocks prunned by expansion | 2.59| 12384|3 2019-06-25 07:00:56,713|FF|app-20190625065934-0112|15|4|START| 82.97|5.Flocks reported | 0.00| 0|3 2019-06-25 07:00:57,346|FF|app-20190625065934-0112|15|4| END| 83.60|5.Flocks reported | 0.63| 12384|3 2019-06-25 07:00:57,347|FF|app-20190625065934-0112|15|4|START| 83.60|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:00:59,020|FF|app-20190625065934-0112|15|4| END| 85.28|6.Candidates indexed | 1.67| 19484|3 2019-06-25 07:01:00,388|Number of flocks: 24609 2019-06-25 07:01:01,366|PFLOCK|app-20190625065934-0112|4|15|80.0|3|3|79.72|24609 2019-06-25 07:01:02,330|FF|app-20190625065934-0112|15|4| END| 88.59|Flock Finder run | 81.66| 24609|3 2019-06-25 07:01:02,330|FF|app-20190625065934-0112|15|4|START| 88.59|Session closed | 0.00| 0|3 2019-06-25 07:01:12,779|FF|app-20190625065934-0112|15|4| END| 99.03|Session closed | 10.45| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:01:15,091|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:01:16,172|FF|app-20190625070115-0113|10|4| END| 1.07|Session start | 1.08| 0|-1 2019-06-25 07:01:16,173|FF|app-20190625070115-0113|10|4|START| 1.07|Data read | 0.00| 0|-1 2019-06-25 07:01:20,337|FF|app-20190625070115-0113|10|4| END| 5.23|Data read | 4.17|220752|-1 2019-06-25 07:01:20,337|FF|app-20190625070115-0113|10|4|START| 5.23|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:01:20,534|FF|app-20190625070115-0113|10|4| END| 5.43|KDBTree partitioner | 0.20| 544|-1 2019-06-25 07:01:20,534|FF|app-20190625070115-0113|10|4|START| 5.43|MF partitioner | 0.00| 0|-1 2019-06-25 07:01:20,560|FF|app-20190625070115-0113|10|4| END| 5.45|MF partitioner | 0.03| 900|-1 2019-06-25 07:01:20,560|FF|app-20190625070115-0113|10|4|START| 5.45|Pointset done | 0.00| 0|-1 2019-06-25 07:01:21,616|FF|app-20190625070115-0113|10|4| END| 6.51|Pointset done | 1.06| 4|-1 2019-06-25 07:01:21,616|FF|app-20190625070115-0113|10|4|START| 6.51|Flock Finder run | 0.00| 0|-1 2019-06-25 07:01:21,633|FF|app-20190625070115-0113|10|4|START| 6.53|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:01:21,636|MF|app-20190625070115-0113|10|4|START| 6.53|A.Points indexed | 0.00| 0|0 2019-06-25 07:01:21,908|MF|app-20190625070115-0113|10|4| END| 6.80|A.Points indexed | 0.27| 36186|0 2019-06-25 07:01:21,908|MF|app-20190625070115-0113|10|4|START| 6.80|B.Pairs found | 0.00| 0|0 2019-06-25 07:01:24,277|MF|app-20190625070115-0113|10|4| END| 9.17|B.Pairs found | 2.37| 47786|0 2019-06-25 07:01:24,277|MF|app-20190625070115-0113|10|4|START| 9.17|C.Centers found | 0.00| 0|0 2019-06-25 07:01:25,854|MF|app-20190625070115-0113|10|4| END| 10.75|C.Centers found | 1.58| 95572|0 2019-06-25 07:01:25,854|MF|app-20190625070115-0113|10|4|START| 10.75|D.Disks found | 0.00| 0|0 2019-06-25 07:01:33,356|MF|app-20190625070115-0113|10|4| END| 18.25|D.Disks found | 7.50| 34902|0 2019-06-25 07:01:33,356|MF|app-20190625070115-0113|10|4|START| 18.25|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:01:36,450|MF|app-20190625070115-0113|10|4| END| 21.34|E.Disks partitioned | 3.09| 46456|0 2019-06-25 07:01:36,450|MF|app-20190625070115-0113|10|4|START| 21.34|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:01:36,452|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:01:36,452|Cell area: 1055533.7681000116 2019-06-25 07:01:39,579|MF|app-20190625070115-0113|10|4| END| 24.47|F.Maximal disks found | 3.13| 11354|0 2019-06-25 07:01:39,579|MAXIMALS|app-20190625070115-0113|4|10|80.0|3|900|17.944|11354 2019-06-25 07:01:41,168|FF|app-20190625070115-0113|10|4| END| 26.06|1.Maximal disks found | 19.54| 11354|0 2019-06-25 07:01:41,168|FF|app-20190625070115-0113|10|4|START| 26.06|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:01:41,168|MF|app-20190625070115-0113|10|4|START| 26.06|A.Points indexed | 0.00| 0|1 2019-06-25 07:01:41,275|MF|app-20190625070115-0113|10|4| END| 26.17|A.Points indexed | 0.11| 36490|1 2019-06-25 07:01:41,275|MF|app-20190625070115-0113|10|4|START| 26.17|B.Pairs found | 0.00| 0|1 2019-06-25 07:01:42,319|MF|app-20190625070115-0113|10|4| END| 27.21|B.Pairs found | 1.04| 48486|1 2019-06-25 07:01:42,319|MF|app-20190625070115-0113|10|4|START| 27.21|C.Centers found | 0.00| 0|1 2019-06-25 07:01:43,624|MF|app-20190625070115-0113|10|4| END| 28.52|C.Centers found | 1.31| 96972|1 2019-06-25 07:01:43,624|MF|app-20190625070115-0113|10|4|START| 28.52|D.Disks found | 0.00| 0|1 2019-06-25 07:01:48,034|MF|app-20190625070115-0113|10|4| END| 32.93|D.Disks found | 4.41| 35526|1 2019-06-25 07:01:48,034|MF|app-20190625070115-0113|10|4|START| 32.93|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:01:49,955|MF|app-20190625070115-0113|10|4| END| 34.85|E.Disks partitioned | 1.92| 47221|1 2019-06-25 07:01:49,955|MF|app-20190625070115-0113|10|4|START| 34.85|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:01:49,955|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:01:49,955|Cell area: 1055533.7681000116 2019-06-25 07:01:52,282|MF|app-20190625070115-0113|10|4| END| 37.17|F.Maximal disks found | 2.33| 11499|1 2019-06-25 07:01:52,282|MAXIMALS|app-20190625070115-0113|4|10|80.0|3|900|11.114|11499 2019-06-25 07:01:53,224|FF|app-20190625070115-0113|10|4| END| 38.12|1.Maximal disks found | 12.06| 11499|1 2019-06-25 07:01:53,225|FF|app-20190625070115-0113|10|4|START| 38.12|2.Join done | 0.00| 0|1 2019-06-25 07:01:57,640|FF|app-20190625070115-0113|10|4| END| 42.53|2.Join done | 4.42| 17993|1 2019-06-25 07:01:57,640|FF|app-20190625070115-0113|10|4|START| 42.53|3.Flocks to report | 0.00| 0|1 2019-06-25 07:01:58,271|FF|app-20190625070115-0113|10|4| END| 43.16|3.Flocks to report | 0.63| 0|1 2019-06-25 07:01:58,271|FF|app-20190625070115-0113|10|4|START| 43.16|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:01:58,331|FF|app-20190625070115-0113|10|4| END| 43.22|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 07:01:58,331|FF|app-20190625070115-0113|10|4|START| 43.22|5.Flocks reported | 0.00| 0|1 2019-06-25 07:01:58,337|FF|app-20190625070115-0113|10|4| END| 43.23|5.Flocks reported | 0.01| 0|1 2019-06-25 07:01:58,337|FF|app-20190625070115-0113|10|4|START| 43.23|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:01:59,863|FF|app-20190625070115-0113|10|4| END| 44.76|6.Candidates indexed | 1.53| 18703|1 2019-06-25 07:01:59,863|FF|app-20190625070115-0113|10|4|START| 44.76|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:01:59,863|MF|app-20190625070115-0113|10|4|START| 44.76|A.Points indexed | 0.00| 0|2 2019-06-25 07:01:59,960|MF|app-20190625070115-0113|10|4| END| 44.85|A.Points indexed | 0.10| 36788|2 2019-06-25 07:01:59,960|MF|app-20190625070115-0113|10|4|START| 44.85|B.Pairs found | 0.00| 0|2 2019-06-25 07:02:00,891|MF|app-20190625070115-0113|10|4| END| 45.78|B.Pairs found | 0.93| 49140|2 2019-06-25 07:02:00,891|MF|app-20190625070115-0113|10|4|START| 45.78|C.Centers found | 0.00| 0|2 2019-06-25 07:02:02,388|MF|app-20190625070115-0113|10|4| END| 47.28|C.Centers found | 1.50| 98280|2 2019-06-25 07:02:02,388|MF|app-20190625070115-0113|10|4|START| 47.28|D.Disks found | 0.00| 0|2 2019-06-25 07:02:06,251|MF|app-20190625070115-0113|10|4| END| 51.14|D.Disks found | 3.86| 36016|2 2019-06-25 07:02:06,251|MF|app-20190625070115-0113|10|4|START| 51.14|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:02:07,450|MF|app-20190625070115-0113|10|4| END| 52.34|E.Disks partitioned | 1.20| 47918|2 2019-06-25 07:02:07,450|MF|app-20190625070115-0113|10|4|START| 52.34|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:02:07,450|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:02:07,450|Cell area: 1055533.7681000116 2019-06-25 07:02:09,538|MF|app-20190625070115-0113|10|4| END| 54.43|F.Maximal disks found | 2.09| 11642|2 2019-06-25 07:02:09,539|MAXIMALS|app-20190625070115-0113|4|10|80.0|3|900|9.675|11642 2019-06-25 07:02:10,260|FF|app-20190625070115-0113|10|4| END| 55.15|1.Maximal disks found | 10.40| 11642|2 2019-06-25 07:02:10,260|FF|app-20190625070115-0113|10|4|START| 55.15|2.Join done | 0.00| 0|2 2019-06-25 07:02:14,650|FF|app-20190625070115-0113|10|4| END| 59.54|2.Join done | 4.39| 25538|2 2019-06-25 07:02:14,650|FF|app-20190625070115-0113|10|4|START| 59.54|3.Flocks to report | 0.00| 0|2 2019-06-25 07:02:15,375|FF|app-20190625070115-0113|10|4| END| 60.27|3.Flocks to report | 0.73| 22013|2 2019-06-25 07:02:15,375|FF|app-20190625070115-0113|10|4|START| 60.27|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:02:15,430|FF|app-20190625070115-0113|10|4|START| 60.32|4a.Making expansions | 0.00| 0|2 2019-06-25 07:02:16,205|FF|app-20190625070115-0113|10|4| END| 61.10|4a.Making expansions | 0.78| 27756|2 2019-06-25 07:02:16,205|FF|app-20190625070115-0113|10|4|START| 61.10|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:02:17,211|FF|app-20190625070115-0113|10|4| END| 62.10|4b.Finding maximals | 1.01| 8150|2 2019-06-25 07:02:17,560|FF|app-20190625070115-0113|10|4| END| 62.45|4.Flocks prunned by expansion | 2.19| 8150|2 2019-06-25 07:02:17,560|FF|app-20190625070115-0113|10|4|START| 62.45|5.Flocks reported | 0.00| 0|2 2019-06-25 07:02:17,969|FF|app-20190625070115-0113|10|4| END| 62.86|5.Flocks reported | 0.41| 8150|2 2019-06-25 07:02:17,969|FF|app-20190625070115-0113|10|4|START| 62.86|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:02:19,336|FF|app-20190625070115-0113|10|4| END| 64.23|6.Candidates indexed | 1.37| 12396|2 2019-06-25 07:02:19,336|FF|app-20190625070115-0113|10|4|START| 64.23|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:02:19,336|MF|app-20190625070115-0113|10|4|START| 64.23|A.Points indexed | 0.00| 0|3 2019-06-25 07:02:19,419|MF|app-20190625070115-0113|10|4| END| 64.31|A.Points indexed | 0.08| 37096|3 2019-06-25 07:02:19,419|MF|app-20190625070115-0113|10|4|START| 64.31|B.Pairs found | 0.00| 0|3 2019-06-25 07:02:20,042|MF|app-20190625070115-0113|10|4| END| 64.94|B.Pairs found | 0.62| 49914|3 2019-06-25 07:02:20,042|MF|app-20190625070115-0113|10|4|START| 64.94|C.Centers found | 0.00| 0|3 2019-06-25 07:02:21,252|MF|app-20190625070115-0113|10|4| END| 66.15|C.Centers found | 1.21| 99828|3 2019-06-25 07:02:21,252|MF|app-20190625070115-0113|10|4|START| 66.15|D.Disks found | 0.00| 0|3 2019-06-25 07:02:25,809|MF|app-20190625070115-0113|10|4| END| 70.70|D.Disks found | 4.56| 36620|3 2019-06-25 07:02:25,810|MF|app-20190625070115-0113|10|4|START| 70.70|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:02:28,572|MF|app-20190625070115-0113|10|4| END| 73.47|E.Disks partitioned | 2.76| 48737|3 2019-06-25 07:02:28,572|MF|app-20190625070115-0113|10|4|START| 73.47|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:02:28,573|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:02:28,573|Cell area: 1055533.7681000116 2019-06-25 07:02:31,643|MF|app-20190625070115-0113|10|4| END| 76.54|F.Maximal disks found | 3.07| 11852|3 2019-06-25 07:02:31,643|MAXIMALS|app-20190625070115-0113|4|10|80.0|3|900|12.307|11852 2019-06-25 07:02:33,043|FF|app-20190625070115-0113|10|4| END| 77.94|1.Maximal disks found | 13.71| 11852|3 2019-06-25 07:02:33,043|FF|app-20190625070115-0113|10|4|START| 77.94|2.Join done | 0.00| 0|3 2019-06-25 07:02:40,172|FF|app-20190625070115-0113|10|4| END| 85.07|2.Join done | 7.13| 24689|3 2019-06-25 07:02:40,172|FF|app-20190625070115-0113|10|4|START| 85.07|3.Flocks to report | 0.00| 0|3 2019-06-25 07:02:41,656|FF|app-20190625070115-0113|10|4| END| 86.55|3.Flocks to report | 1.48| 20688|3 2019-06-25 07:02:41,656|FF|app-20190625070115-0113|10|4|START| 86.55|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:02:41,745|FF|app-20190625070115-0113|10|4|START| 86.64|4a.Making expansions | 0.00| 0|3 2019-06-25 07:02:43,538|FF|app-20190625070115-0113|10|4| END| 88.43|4a.Making expansions | 1.79| 26563|3 2019-06-25 07:02:43,538|FF|app-20190625070115-0113|10|4|START| 88.43|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:02:44,886|FF|app-20190625070115-0113|10|4| END| 89.78|4b.Finding maximals | 1.35| 8256|3 2019-06-25 07:02:45,463|FF|app-20190625070115-0113|10|4| END| 90.36|4.Flocks prunned by expansion | 3.81| 8256|3 2019-06-25 07:02:45,463|FF|app-20190625070115-0113|10|4|START| 90.36|5.Flocks reported | 0.00| 0|3 2019-06-25 07:02:46,384|FF|app-20190625070115-0113|10|4| END| 91.28|5.Flocks reported | 0.92| 8256|3 2019-06-25 07:02:46,384|FF|app-20190625070115-0113|10|4|START| 91.28|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:02:49,228|FF|app-20190625070115-0113|10|4| END| 94.12|6.Candidates indexed | 2.84| 12984|3 2019-06-25 07:02:50,773|Number of flocks: 16406 2019-06-25 07:02:51,769|PFLOCK|app-20190625070115-0113|4|10|80.0|3|3|89.16|16406 2019-06-25 07:02:52,737|FF|app-20190625070115-0113|10|4| END| 97.63|Flock Finder run | 91.12| 16406|3 2019-06-25 07:02:52,737|FF|app-20190625070115-0113|10|4|START| 97.63|Session closed | 0.00| 0|3 2019-06-25 07:02:59,513|FF|app-20190625070115-0113|10|4| END|104.41|Session closed | 6.78| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:03:01,495|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:03:02,601|FF|app-20190625070302-0114|5|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 07:03:02,601|FF|app-20190625070302-0114|5|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 07:03:06,446|FF|app-20190625070302-0114|5|4| END| 4.93|Data read | 3.85|110376|-1 2019-06-25 07:03:06,447|FF|app-20190625070302-0114|5|4|START| 4.94|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:03:06,572|FF|app-20190625070302-0114|5|4| END| 5.06|KDBTree partitioner | 0.12| 272|-1 2019-06-25 07:03:06,572|FF|app-20190625070302-0114|5|4|START| 5.06|MF partitioner | 0.00| 0|-1 2019-06-25 07:03:06,587|FF|app-20190625070302-0114|5|4| END| 5.08|MF partitioner | 0.02| 450|-1 2019-06-25 07:03:06,587|FF|app-20190625070302-0114|5|4|START| 5.08|Pointset done | 0.00| 0|-1 2019-06-25 07:03:07,300|FF|app-20190625070302-0114|5|4| END| 5.79|Pointset done | 0.71| 4|-1 2019-06-25 07:03:07,300|FF|app-20190625070302-0114|5|4|START| 5.79|Flock Finder run | 0.00| 0|-1 2019-06-25 07:03:07,471|FF|app-20190625070302-0114|5|4|START| 5.96|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:03:07,475|MF|app-20190625070302-0114|5|4|START| 5.96|A.Points indexed | 0.00| 0|0 2019-06-25 07:03:07,650|MF|app-20190625070302-0114|5|4| END| 6.14|A.Points indexed | 0.18| 18093|0 2019-06-25 07:03:07,651|MF|app-20190625070302-0114|5|4|START| 6.14|B.Pairs found | 0.00| 0|0 2019-06-25 07:03:09,045|MF|app-20190625070302-0114|5|4| END| 7.53|B.Pairs found | 1.39| 23893|0 2019-06-25 07:03:09,046|MF|app-20190625070302-0114|5|4|START| 7.53|C.Centers found | 0.00| 0|0 2019-06-25 07:03:09,893|MF|app-20190625070302-0114|5|4| END| 8.38|C.Centers found | 0.85| 47786|0 2019-06-25 07:03:09,893|MF|app-20190625070302-0114|5|4|START| 8.38|D.Disks found | 0.00| 0|0 2019-06-25 07:03:12,493|MF|app-20190625070302-0114|5|4| END| 10.98|D.Disks found | 2.60| 17451|0 2019-06-25 07:03:12,493|MF|app-20190625070302-0114|5|4|START| 10.98|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:03:13,432|MF|app-20190625070302-0114|5|4| END| 11.92|E.Disks partitioned | 0.94| 23231|0 2019-06-25 07:03:13,433|MF|app-20190625070302-0114|5|4|START| 11.92|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:03:13,435|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:03:13,435|Cell area: 1055533.7681000116 2019-06-25 07:03:15,249|MF|app-20190625070302-0114|5|4| END| 13.74|F.Maximal disks found | 1.82| 5681|0 2019-06-25 07:03:15,249|MAXIMALS|app-20190625070302-0114|4|5|80.0|3|450|7.774|5681 2019-06-25 07:03:15,732|FF|app-20190625070302-0114|5|4| END| 14.22|1.Maximal disks found | 8.26| 5681|0 2019-06-25 07:03:15,732|FF|app-20190625070302-0114|5|4|START| 14.22|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:03:15,733|MF|app-20190625070302-0114|5|4|START| 14.22|A.Points indexed | 0.00| 0|1 2019-06-25 07:03:15,809|MF|app-20190625070302-0114|5|4| END| 14.30|A.Points indexed | 0.08| 18245|1 2019-06-25 07:03:15,809|MF|app-20190625070302-0114|5|4|START| 14.30|B.Pairs found | 0.00| 0|1 2019-06-25 07:03:16,261|MF|app-20190625070302-0114|5|4| END| 14.75|B.Pairs found | 0.45| 24243|1 2019-06-25 07:03:16,261|MF|app-20190625070302-0114|5|4|START| 14.75|C.Centers found | 0.00| 0|1 2019-06-25 07:03:16,646|MF|app-20190625070302-0114|5|4| END| 15.13|C.Centers found | 0.39| 48486|1 2019-06-25 07:03:16,646|MF|app-20190625070302-0114|5|4|START| 15.13|D.Disks found | 0.00| 0|1 2019-06-25 07:03:18,460|MF|app-20190625070302-0114|5|4| END| 16.95|D.Disks found | 1.81| 17763|1 2019-06-25 07:03:18,461|MF|app-20190625070302-0114|5|4|START| 16.95|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:03:19,115|MF|app-20190625070302-0114|5|4| END| 17.60|E.Disks partitioned | 0.65| 23611|1 2019-06-25 07:03:19,115|MF|app-20190625070302-0114|5|4|START| 17.60|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:03:19,115|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:03:19,115|Cell area: 1055533.7681000116 2019-06-25 07:03:20,868|MF|app-20190625070302-0114|5|4| END| 19.36|F.Maximal disks found | 1.75| 5752|1 2019-06-25 07:03:20,868|MAXIMALS|app-20190625070302-0114|4|5|80.0|3|450|5.136|5752 2019-06-25 07:03:21,292|FF|app-20190625070302-0114|5|4| END| 19.78|1.Maximal disks found | 5.56| 5752|1 2019-06-25 07:03:21,292|FF|app-20190625070302-0114|5|4|START| 19.78|2.Join done | 0.00| 0|1 2019-06-25 07:03:23,057|FF|app-20190625070302-0114|5|4| END| 21.55|2.Join done | 1.77| 8996|1 2019-06-25 07:03:23,058|FF|app-20190625070302-0114|5|4|START| 21.55|3.Flocks to report | 0.00| 0|1 2019-06-25 07:03:23,388|FF|app-20190625070302-0114|5|4| END| 21.88|3.Flocks to report | 0.33| 0|1 2019-06-25 07:03:23,388|FF|app-20190625070302-0114|5|4|START| 21.88|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:03:23,425|FF|app-20190625070302-0114|5|4| END| 21.91|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 07:03:23,425|FF|app-20190625070302-0114|5|4|START| 21.91|5.Flocks reported | 0.00| 0|1 2019-06-25 07:03:23,429|FF|app-20190625070302-0114|5|4| END| 21.92|5.Flocks reported | 0.00| 0|1 2019-06-25 07:03:23,429|FF|app-20190625070302-0114|5|4|START| 21.92|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:03:24,483|FF|app-20190625070302-0114|5|4| END| 22.97|6.Candidates indexed | 1.05| 9351|1 2019-06-25 07:03:24,483|FF|app-20190625070302-0114|5|4|START| 22.97|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:03:24,484|MF|app-20190625070302-0114|5|4|START| 22.97|A.Points indexed | 0.00| 0|2 2019-06-25 07:03:24,549|MF|app-20190625070302-0114|5|4| END| 23.04|A.Points indexed | 0.07| 18394|2 2019-06-25 07:03:24,549|MF|app-20190625070302-0114|5|4|START| 23.04|B.Pairs found | 0.00| 0|2 2019-06-25 07:03:24,965|MF|app-20190625070302-0114|5|4| END| 23.45|B.Pairs found | 0.42| 24570|2 2019-06-25 07:03:24,966|MF|app-20190625070302-0114|5|4|START| 23.45|C.Centers found | 0.00| 0|2 2019-06-25 07:03:25,367|MF|app-20190625070302-0114|5|4| END| 23.86|C.Centers found | 0.40| 49140|2 2019-06-25 07:03:25,368|MF|app-20190625070302-0114|5|4|START| 23.86|D.Disks found | 0.00| 0|2 2019-06-25 07:03:27,232|MF|app-20190625070302-0114|5|4| END| 25.72|D.Disks found | 1.86| 18008|2 2019-06-25 07:03:27,233|MF|app-20190625070302-0114|5|4|START| 25.72|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:03:27,859|MF|app-20190625070302-0114|5|4| END| 26.35|E.Disks partitioned | 0.63| 23955|2 2019-06-25 07:03:27,859|MF|app-20190625070302-0114|5|4|START| 26.35|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:03:27,859|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:03:27,859|Cell area: 1055533.7681000116 2019-06-25 07:03:29,614|MF|app-20190625070302-0114|5|4| END| 28.10|F.Maximal disks found | 1.76| 5821|2 2019-06-25 07:03:29,614|MAXIMALS|app-20190625070302-0114|4|5|80.0|3|450|5.131|5821 2019-06-25 07:03:30,028|FF|app-20190625070302-0114|5|4| END| 28.52|1.Maximal disks found | 5.55| 5821|2 2019-06-25 07:03:30,028|FF|app-20190625070302-0114|5|4|START| 28.52|2.Join done | 0.00| 0|2 2019-06-25 07:03:34,478|FF|app-20190625070302-0114|5|4| END| 32.97|2.Join done | 4.45| 12766|2 2019-06-25 07:03:34,479|FF|app-20190625070302-0114|5|4|START| 32.97|3.Flocks to report | 0.00| 0|2 2019-06-25 07:03:35,366|FF|app-20190625070302-0114|5|4| END| 33.85|3.Flocks to report | 0.89| 11004|2 2019-06-25 07:03:35,366|FF|app-20190625070302-0114|5|4|START| 33.85|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:03:35,420|FF|app-20190625070302-0114|5|4|START| 33.91|4a.Making expansions | 0.00| 0|2 2019-06-25 07:03:36,239|FF|app-20190625070302-0114|5|4| END| 34.73|4a.Making expansions | 0.82| 13855|2 2019-06-25 07:03:36,239|FF|app-20190625070302-0114|5|4|START| 34.73|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:03:37,211|FF|app-20190625070302-0114|5|4| END| 35.70|4b.Finding maximals | 0.97| 4075|2 2019-06-25 07:03:37,496|FF|app-20190625070302-0114|5|4| END| 35.98|4.Flocks prunned by expansion | 2.13| 4075|2 2019-06-25 07:03:37,496|FF|app-20190625070302-0114|5|4|START| 35.98|5.Flocks reported | 0.00| 0|2 2019-06-25 07:03:37,953|FF|app-20190625070302-0114|5|4| END| 36.44|5.Flocks reported | 0.46| 4075|2 2019-06-25 07:03:37,953|FF|app-20190625070302-0114|5|4|START| 36.44|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:03:40,065|FF|app-20190625070302-0114|5|4| END| 38.55|6.Candidates indexed | 2.11| 6197|2 2019-06-25 07:03:40,065|FF|app-20190625070302-0114|5|4|START| 38.55|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:03:40,065|MF|app-20190625070302-0114|5|4|START| 38.55|A.Points indexed | 0.00| 0|3 2019-06-25 07:03:40,128|MF|app-20190625070302-0114|5|4| END| 38.62|A.Points indexed | 0.06| 18548|3 2019-06-25 07:03:40,128|MF|app-20190625070302-0114|5|4|START| 38.62|B.Pairs found | 0.00| 0|3 2019-06-25 07:03:40,767|MF|app-20190625070302-0114|5|4| END| 39.26|B.Pairs found | 0.64| 24957|3 2019-06-25 07:03:40,767|MF|app-20190625070302-0114|5|4|START| 39.26|C.Centers found | 0.00| 0|3 2019-06-25 07:03:41,423|MF|app-20190625070302-0114|5|4| END| 39.91|C.Centers found | 0.66| 49914|3 2019-06-25 07:03:41,423|MF|app-20190625070302-0114|5|4|START| 39.91|D.Disks found | 0.00| 0|3 2019-06-25 07:03:44,045|MF|app-20190625070302-0114|5|4| END| 42.53|D.Disks found | 2.62| 18310|3 2019-06-25 07:03:44,045|MF|app-20190625070302-0114|5|4|START| 42.53|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:03:44,844|MF|app-20190625070302-0114|5|4| END| 43.33|E.Disks partitioned | 0.80| 24367|3 2019-06-25 07:03:44,844|MF|app-20190625070302-0114|5|4|START| 43.33|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:03:44,844|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:03:44,844|Cell area: 1055533.7681000116 2019-06-25 07:03:46,894|MF|app-20190625070302-0114|5|4| END| 45.38|F.Maximal disks found | 2.05| 5926|3 2019-06-25 07:03:46,894|MAXIMALS|app-20190625070302-0114|4|5|80.0|3|450|6.829|5926 2019-06-25 07:03:47,307|FF|app-20190625070302-0114|5|4| END| 45.80|1.Maximal disks found | 7.24| 5926|3 2019-06-25 07:03:47,307|FF|app-20190625070302-0114|5|4|START| 45.80|2.Join done | 0.00| 0|3 2019-06-25 07:03:49,498|FF|app-20190625070302-0114|5|4| END| 47.99|2.Join done | 2.19| 12337|3 2019-06-25 07:03:49,498|FF|app-20190625070302-0114|5|4|START| 47.99|3.Flocks to report | 0.00| 0|3 2019-06-25 07:03:50,025|FF|app-20190625070302-0114|5|4| END| 48.51|3.Flocks to report | 0.53| 10340|3 2019-06-25 07:03:50,025|FF|app-20190625070302-0114|5|4|START| 48.51|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:03:50,066|FF|app-20190625070302-0114|5|4|START| 48.55|4a.Making expansions | 0.00| 0|3 2019-06-25 07:03:50,566|FF|app-20190625070302-0114|5|4| END| 49.05|4a.Making expansions | 0.50| 13276|3 2019-06-25 07:03:50,566|FF|app-20190625070302-0114|5|4|START| 49.05|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:03:51,189|FF|app-20190625070302-0114|5|4| END| 49.68|4b.Finding maximals | 0.62| 4128|3 2019-06-25 07:03:51,368|FF|app-20190625070302-0114|5|4| END| 49.86|4.Flocks prunned by expansion | 1.34| 4128|3 2019-06-25 07:03:51,368|FF|app-20190625070302-0114|5|4|START| 49.86|5.Flocks reported | 0.00| 0|3 2019-06-25 07:03:51,654|FF|app-20190625070302-0114|5|4| END| 50.14|5.Flocks reported | 0.29| 4128|3 2019-06-25 07:03:51,654|FF|app-20190625070302-0114|5|4|START| 50.14|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:03:53,015|FF|app-20190625070302-0114|5|4| END| 51.50|6.Candidates indexed | 1.36| 6487|3 2019-06-25 07:03:53,870|Number of flocks: 8203 2019-06-25 07:03:54,324|PFLOCK|app-20190625070302-0114|4|5|80.0|3|3|46.57|8203 2019-06-25 07:03:54,782|FF|app-20190625070302-0114|5|4| END| 53.27|Flock Finder run | 47.48| 8203|3 2019-06-25 07:03:54,782|FF|app-20190625070302-0114|5|4|START| 53.27|Session closed | 0.00| 0|3 2019-06-25 07:04:01,648|FF|app-20190625070302-0114|5|4| END| 60.14|Session closed | 6.87| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:04:03,625|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:04:04,772|FF|app-20190625070404-0115|15|4| END| 1.13|Session start | 1.15| 0|-1 2019-06-25 07:04:04,773|FF|app-20190625070404-0115|15|4|START| 1.13|Data read | 0.00| 0|-1 2019-06-25 07:04:08,920|FF|app-20190625070404-0115|15|4| END| 5.28|Data read | 4.15|331128|-1 2019-06-25 07:04:08,920|FF|app-20190625070404-0115|15|4|START| 5.28|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:04:09,199|FF|app-20190625070404-0115|15|4| END| 5.56|KDBTree partitioner | 0.28| 816|-1 2019-06-25 07:04:09,199|FF|app-20190625070404-0115|15|4|START| 5.56|MF partitioner | 0.00| 0|-1 2019-06-25 07:04:09,226|FF|app-20190625070404-0115|15|4| END| 5.58|MF partitioner | 0.03| 1350|-1 2019-06-25 07:04:09,226|FF|app-20190625070404-0115|15|4|START| 5.58|Pointset done | 0.00| 0|-1 2019-06-25 07:04:10,372|FF|app-20190625070404-0115|15|4| END| 6.73|Pointset done | 1.15| 4|-1 2019-06-25 07:04:10,372|FF|app-20190625070404-0115|15|4|START| 6.73|Flock Finder run | 0.00| 0|-1 2019-06-25 07:04:10,389|FF|app-20190625070404-0115|15|4|START| 6.75|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:04:10,391|MF|app-20190625070404-0115|15|4|START| 6.75|A.Points indexed | 0.00| 0|0 2019-06-25 07:04:10,682|MF|app-20190625070404-0115|15|4| END| 7.04|A.Points indexed | 0.29| 54279|0 2019-06-25 07:04:10,682|MF|app-20190625070404-0115|15|4|START| 7.04|B.Pairs found | 0.00| 0|0 2019-06-25 07:04:12,659|MF|app-20190625070404-0115|15|4| END| 9.02|B.Pairs found | 1.98| 86157|0 2019-06-25 07:04:12,659|MF|app-20190625070404-0115|15|4|START| 9.02|C.Centers found | 0.00| 0|0 2019-06-25 07:04:14,488|MF|app-20190625070404-0115|15|4| END| 10.85|C.Centers found | 1.83|172314|0 2019-06-25 07:04:14,488|MF|app-20190625070404-0115|15|4|START| 10.85|D.Disks found | 0.00| 0|0 2019-06-25 07:04:20,593|MF|app-20190625070404-0115|15|4| END| 16.95|D.Disks found | 6.11| 67818|0 2019-06-25 07:04:20,593|MF|app-20190625070404-0115|15|4|START| 16.95|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:04:23,055|MF|app-20190625070404-0115|15|4| END| 19.41|E.Disks partitioned | 2.46| 93058|0 2019-06-25 07:04:23,056|MF|app-20190625070404-0115|15|4|START| 19.41|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:04:23,058|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:04:23,058|Cell area: 1055533.7681000116 2019-06-25 07:04:27,559|MF|app-20190625070404-0115|15|4| END| 23.92|F.Maximal disks found | 4.50| 20937|0 2019-06-25 07:04:27,559|MAXIMALS|app-20190625070404-0115|4|15|90.0|3|1350|17.168|20937 2019-06-25 07:04:28,614|FF|app-20190625070404-0115|15|4| END| 24.97|1.Maximal disks found | 18.23| 20937|0 2019-06-25 07:04:28,614|FF|app-20190625070404-0115|15|4|START| 24.97|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:04:28,614|MF|app-20190625070404-0115|15|4|START| 24.97|A.Points indexed | 0.00| 0|1 2019-06-25 07:04:28,735|MF|app-20190625070404-0115|15|4| END| 25.09|A.Points indexed | 0.12| 54735|1 2019-06-25 07:04:28,735|MF|app-20190625070404-0115|15|4|START| 25.09|B.Pairs found | 0.00| 0|1 2019-06-25 07:04:29,814|MF|app-20190625070404-0115|15|4| END| 26.17|B.Pairs found | 1.08| 87324|1 2019-06-25 07:04:29,814|MF|app-20190625070404-0115|15|4|START| 26.17|C.Centers found | 0.00| 0|1 2019-06-25 07:04:31,098|MF|app-20190625070404-0115|15|4| END| 27.46|C.Centers found | 1.28|174648|1 2019-06-25 07:04:31,098|MF|app-20190625070404-0115|15|4|START| 27.46|D.Disks found | 0.00| 0|1 2019-06-25 07:04:34,820|MF|app-20190625070404-0115|15|4| END| 31.18|D.Disks found | 3.72| 68973|1 2019-06-25 07:04:34,821|MF|app-20190625070404-0115|15|4|START| 31.18|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:04:35,707|MF|app-20190625070404-0115|15|4| END| 32.07|E.Disks partitioned | 0.89| 94410|1 2019-06-25 07:04:35,707|MF|app-20190625070404-0115|15|4|START| 32.07|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:04:35,708|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:04:35,708|Cell area: 1055533.7681000116 2019-06-25 07:04:40,354|MF|app-20190625070404-0115|15|4| END| 36.71|F.Maximal disks found | 4.65| 21134|1 2019-06-25 07:04:40,354|MAXIMALS|app-20190625070404-0115|4|15|90.0|3|1350|11.74|21134 2019-06-25 07:04:41,374|FF|app-20190625070404-0115|15|4| END| 37.73|1.Maximal disks found | 12.76| 21134|1 2019-06-25 07:04:41,374|FF|app-20190625070404-0115|15|4|START| 37.73|2.Join done | 0.00| 0|1 2019-06-25 07:04:45,187|FF|app-20190625070404-0115|15|4| END| 41.55|2.Join done | 3.81| 37959|1 2019-06-25 07:04:45,187|FF|app-20190625070404-0115|15|4|START| 41.55|3.Flocks to report | 0.00| 0|1 2019-06-25 07:04:46,205|FF|app-20190625070404-0115|15|4| END| 42.56|3.Flocks to report | 1.02| 0|1 2019-06-25 07:04:46,205|FF|app-20190625070404-0115|15|4|START| 42.56|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:04:46,295|FF|app-20190625070404-0115|15|4| END| 42.65|4.Flocks prunned by expansion | 0.09| 0|1 2019-06-25 07:04:46,295|FF|app-20190625070404-0115|15|4|START| 42.65|5.Flocks reported | 0.00| 0|1 2019-06-25 07:04:46,299|FF|app-20190625070404-0115|15|4| END| 42.66|5.Flocks reported | 0.00| 0|1 2019-06-25 07:04:46,300|FF|app-20190625070404-0115|15|4|START| 42.66|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:04:47,866|FF|app-20190625070404-0115|15|4| END| 44.22|6.Candidates indexed | 1.57| 39178|1 2019-06-25 07:04:47,866|FF|app-20190625070404-0115|15|4|START| 44.22|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:04:47,866|MF|app-20190625070404-0115|15|4|START| 44.22|A.Points indexed | 0.00| 0|2 2019-06-25 07:04:47,984|MF|app-20190625070404-0115|15|4| END| 44.34|A.Points indexed | 0.12| 55182|2 2019-06-25 07:04:47,984|MF|app-20190625070404-0115|15|4|START| 44.34|B.Pairs found | 0.00| 0|2 2019-06-25 07:04:48,673|MF|app-20190625070404-0115|15|4| END| 45.03|B.Pairs found | 0.69| 88509|2 2019-06-25 07:04:48,673|MF|app-20190625070404-0115|15|4|START| 45.03|C.Centers found | 0.00| 0|2 2019-06-25 07:04:49,999|MF|app-20190625070404-0115|15|4| END| 46.36|C.Centers found | 1.33|177018|2 2019-06-25 07:04:49,999|MF|app-20190625070404-0115|15|4|START| 46.36|D.Disks found | 0.00| 0|2 2019-06-25 07:04:53,194|MF|app-20190625070404-0115|15|4| END| 49.55|D.Disks found | 3.20| 69927|2 2019-06-25 07:04:53,194|MF|app-20190625070404-0115|15|4|START| 49.55|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:04:54,316|MF|app-20190625070404-0115|15|4| END| 50.67|E.Disks partitioned | 1.12| 95823|2 2019-06-25 07:04:54,316|MF|app-20190625070404-0115|15|4|START| 50.67|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:04:54,317|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:04:54,317|Cell area: 1055533.7681000116 2019-06-25 07:04:58,515|MF|app-20190625070404-0115|15|4| END| 54.87|F.Maximal disks found | 4.20| 21483|2 2019-06-25 07:04:58,516|MAXIMALS|app-20190625070404-0115|4|15|90.0|3|1350|10.65|21483 2019-06-25 07:04:59,509|FF|app-20190625070404-0115|15|4| END| 55.87|1.Maximal disks found | 11.64| 21483|2 2019-06-25 07:04:59,510|FF|app-20190625070404-0115|15|4|START| 55.87|2.Join done | 0.00| 0|2 2019-06-25 07:05:05,531|FF|app-20190625070404-0115|15|4| END| 61.89|2.Join done | 6.02| 60752|2 2019-06-25 07:05:05,531|FF|app-20190625070404-0115|15|4|START| 61.89|3.Flocks to report | 0.00| 0|2 2019-06-25 07:05:06,867|FF|app-20190625070404-0115|15|4| END| 63.23|3.Flocks to report | 1.34| 52714|2 2019-06-25 07:05:06,867|FF|app-20190625070404-0115|15|4|START| 63.23|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:05:06,941|FF|app-20190625070404-0115|15|4|START| 63.30|4a.Making expansions | 0.00| 0|2 2019-06-25 07:05:07,895|FF|app-20190625070404-0115|15|4| END| 64.25|4a.Making expansions | 0.95| 65744|2 2019-06-25 07:05:07,895|FF|app-20190625070404-0115|15|4|START| 64.25|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:05:10,998|FF|app-20190625070404-0115|15|4| END| 67.36|4b.Finding maximals | 3.10| 14592|2 2019-06-25 07:05:11,438|FF|app-20190625070404-0115|15|4| END| 67.80|4.Flocks prunned by expansion | 4.57| 14592|2 2019-06-25 07:05:11,438|FF|app-20190625070404-0115|15|4|START| 67.80|5.Flocks reported | 0.00| 0|2 2019-06-25 07:05:12,020|FF|app-20190625070404-0115|15|4| END| 68.38|5.Flocks reported | 0.58| 14592|2 2019-06-25 07:05:12,020|FF|app-20190625070404-0115|15|4|START| 68.38|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:05:13,628|FF|app-20190625070404-0115|15|4| END| 69.99|6.Candidates indexed | 1.61| 23966|2 2019-06-25 07:05:13,628|FF|app-20190625070404-0115|15|4|START| 69.99|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:05:13,629|MF|app-20190625070404-0115|15|4|START| 69.99|A.Points indexed | 0.00| 0|3 2019-06-25 07:05:13,735|MF|app-20190625070404-0115|15|4| END| 70.09|A.Points indexed | 0.11| 55644|3 2019-06-25 07:05:13,735|MF|app-20190625070404-0115|15|4|START| 70.09|B.Pairs found | 0.00| 0|3 2019-06-25 07:05:14,508|MF|app-20190625070404-0115|15|4| END| 70.87|B.Pairs found | 0.77| 90000|3 2019-06-25 07:05:14,508|MF|app-20190625070404-0115|15|4|START| 70.87|C.Centers found | 0.00| 0|3 2019-06-25 07:05:15,892|MF|app-20190625070404-0115|15|4| END| 72.25|C.Centers found | 1.38|180000|3 2019-06-25 07:05:15,892|MF|app-20190625070404-0115|15|4|START| 72.25|D.Disks found | 0.00| 0|3 2019-06-25 07:05:19,557|MF|app-20190625070404-0115|15|4| END| 75.92|D.Disks found | 3.67| 71127|3 2019-06-25 07:05:19,557|MF|app-20190625070404-0115|15|4|START| 75.92|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:05:20,552|MF|app-20190625070404-0115|15|4| END| 76.91|E.Disks partitioned | 1.00| 97462|3 2019-06-25 07:05:20,552|MF|app-20190625070404-0115|15|4|START| 76.91|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:05:20,553|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:05:20,553|Cell area: 1055533.7681000116 2019-06-25 07:05:25,188|MF|app-20190625070404-0115|15|4| END| 81.55|F.Maximal disks found | 4.64| 21988|3 2019-06-25 07:05:25,188|MAXIMALS|app-20190625070404-0115|4|15|90.0|3|1350|11.559|21988 2019-06-25 07:05:26,214|FF|app-20190625070404-0115|15|4| END| 82.57|1.Maximal disks found | 12.59| 21988|3 2019-06-25 07:05:26,214|FF|app-20190625070404-0115|15|4|START| 82.57|2.Join done | 0.00| 0|3 2019-06-25 07:05:31,986|FF|app-20190625070404-0115|15|4| END| 88.34|2.Join done | 5.77| 56919|3 2019-06-25 07:05:31,986|FF|app-20190625070404-0115|15|4|START| 88.34|3.Flocks to report | 0.00| 0|3 2019-06-25 07:05:33,789|FF|app-20190625070404-0115|15|4| END| 90.15|3.Flocks to report | 1.80| 48321|3 2019-06-25 07:05:33,789|FF|app-20190625070404-0115|15|4|START| 90.15|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:05:33,873|FF|app-20190625070404-0115|15|4|START| 90.23|4a.Making expansions | 0.00| 0|3 2019-06-25 07:05:34,811|FF|app-20190625070404-0115|15|4| END| 91.17|4a.Making expansions | 0.94| 61653|3 2019-06-25 07:05:34,811|FF|app-20190625070404-0115|15|4|START| 91.17|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:05:37,108|FF|app-20190625070404-0115|15|4| END| 93.47|4b.Finding maximals | 2.30| 14847|3 2019-06-25 07:05:37,571|FF|app-20190625070404-0115|15|4| END| 93.93|4.Flocks prunned by expansion | 3.78| 14847|3 2019-06-25 07:05:37,571|FF|app-20190625070404-0115|15|4|START| 93.93|5.Flocks reported | 0.00| 0|3 2019-06-25 07:05:38,197|FF|app-20190625070404-0115|15|4| END| 94.56|5.Flocks reported | 0.63| 14847|3 2019-06-25 07:05:38,197|FF|app-20190625070404-0115|15|4|START| 94.56|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:05:39,956|FF|app-20190625070404-0115|15|4| END| 96.31|6.Candidates indexed | 1.76| 24850|3 2019-06-25 07:05:41,338|Number of flocks: 29439 2019-06-25 07:05:42,236|PFLOCK|app-20190625070404-0115|4|15|90.0|3|3|90.97|29439 2019-06-25 07:05:43,174|FF|app-20190625070404-0115|15|4| END| 99.53|Flock Finder run | 92.80| 29439|3 2019-06-25 07:05:43,174|FF|app-20190625070404-0115|15|4|START| 99.53|Session closed | 0.00| 0|3 2019-06-25 07:05:50,917|FF|app-20190625070404-0115|15|4| END|107.28|Session closed | 7.74| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:05:52,902|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:05:54,020|FF|app-20190625070553-0116|10|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 07:05:54,021|FF|app-20190625070553-0116|10|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 07:05:57,906|FF|app-20190625070553-0116|10|4| END| 4.99|Data read | 3.89|220752|-1 2019-06-25 07:05:57,906|FF|app-20190625070553-0116|10|4|START| 4.99|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:05:58,134|FF|app-20190625070553-0116|10|4| END| 5.22|KDBTree partitioner | 0.23| 544|-1 2019-06-25 07:05:58,134|FF|app-20190625070553-0116|10|4|START| 5.22|MF partitioner | 0.00| 0|-1 2019-06-25 07:05:58,155|FF|app-20190625070553-0116|10|4| END| 5.24|MF partitioner | 0.02| 900|-1 2019-06-25 07:05:58,155|FF|app-20190625070553-0116|10|4|START| 5.24|Pointset done | 0.00| 0|-1 2019-06-25 07:05:59,452|FF|app-20190625070553-0116|10|4| END| 6.53|Pointset done | 1.30| 4|-1 2019-06-25 07:05:59,452|FF|app-20190625070553-0116|10|4|START| 6.53|Flock Finder run | 0.00| 0|-1 2019-06-25 07:05:59,468|FF|app-20190625070553-0116|10|4|START| 6.55|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:05:59,471|MF|app-20190625070553-0116|10|4|START| 6.55|A.Points indexed | 0.00| 0|0 2019-06-25 07:05:59,657|MF|app-20190625070553-0116|10|4| END| 6.74|A.Points indexed | 0.19| 36186|0 2019-06-25 07:05:59,658|MF|app-20190625070553-0116|10|4|START| 6.74|B.Pairs found | 0.00| 0|0 2019-06-25 07:06:01,887|MF|app-20190625070553-0116|10|4| END| 8.97|B.Pairs found | 2.23| 57438|0 2019-06-25 07:06:01,887|MF|app-20190625070553-0116|10|4|START| 8.97|C.Centers found | 0.00| 0|0 2019-06-25 07:06:03,766|MF|app-20190625070553-0116|10|4| END| 10.85|C.Centers found | 1.88|114876|0 2019-06-25 07:06:03,766|MF|app-20190625070553-0116|10|4|START| 10.85|D.Disks found | 0.00| 0|0 2019-06-25 07:06:11,598|MF|app-20190625070553-0116|10|4| END| 18.68|D.Disks found | 7.83| 45212|0 2019-06-25 07:06:11,598|MF|app-20190625070553-0116|10|4|START| 18.68|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:06:15,080|MF|app-20190625070553-0116|10|4| END| 22.16|E.Disks partitioned | 3.48| 62040|0 2019-06-25 07:06:15,080|MF|app-20190625070553-0116|10|4|START| 22.16|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:06:15,081|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:06:15,081|Cell area: 1055533.7681000116 2019-06-25 07:06:21,051|MF|app-20190625070553-0116|10|4| END| 28.13|F.Maximal disks found | 5.97| 13955|0 2019-06-25 07:06:21,051|MAXIMALS|app-20190625070553-0116|4|10|90.0|3|900|21.581|13955 2019-06-25 07:06:22,534|FF|app-20190625070553-0116|10|4| END| 29.62|1.Maximal disks found | 23.07| 13955|0 2019-06-25 07:06:22,534|FF|app-20190625070553-0116|10|4|START| 29.62|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:06:22,534|MF|app-20190625070553-0116|10|4|START| 29.62|A.Points indexed | 0.00| 0|1 2019-06-25 07:06:22,631|MF|app-20190625070553-0116|10|4| END| 29.71|A.Points indexed | 0.10| 36490|1 2019-06-25 07:06:22,632|MF|app-20190625070553-0116|10|4|START| 29.71|B.Pairs found | 0.00| 0|1 2019-06-25 07:06:23,713|MF|app-20190625070553-0116|10|4| END| 30.79|B.Pairs found | 1.08| 58216|1 2019-06-25 07:06:23,713|MF|app-20190625070553-0116|10|4|START| 30.79|C.Centers found | 0.00| 0|1 2019-06-25 07:06:25,011|MF|app-20190625070553-0116|10|4| END| 32.09|C.Centers found | 1.30|116432|1 2019-06-25 07:06:25,011|MF|app-20190625070553-0116|10|4|START| 32.09|D.Disks found | 0.00| 0|1 2019-06-25 07:06:30,042|MF|app-20190625070553-0116|10|4| END| 37.12|D.Disks found | 5.03| 45982|1 2019-06-25 07:06:30,042|MF|app-20190625070553-0116|10|4|START| 37.12|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:06:32,123|MF|app-20190625070553-0116|10|4| END| 39.20|E.Disks partitioned | 2.08| 62923|1 2019-06-25 07:06:32,124|MF|app-20190625070553-0116|10|4|START| 39.21|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:06:32,124|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:06:32,124|Cell area: 1055533.7681000116 2019-06-25 07:06:36,717|MF|app-20190625070553-0116|10|4| END| 43.80|F.Maximal disks found | 4.59| 14084|1 2019-06-25 07:06:36,717|MAXIMALS|app-20190625070553-0116|4|10|90.0|3|900|14.183|14084 2019-06-25 07:06:37,612|FF|app-20190625070553-0116|10|4| END| 44.69|1.Maximal disks found | 15.08| 14084|1 2019-06-25 07:06:37,612|FF|app-20190625070553-0116|10|4|START| 44.69|2.Join done | 0.00| 0|1 2019-06-25 07:06:42,546|FF|app-20190625070553-0116|10|4| END| 49.63|2.Join done | 4.93| 25295|1 2019-06-25 07:06:42,546|FF|app-20190625070553-0116|10|4|START| 49.63|3.Flocks to report | 0.00| 0|1 2019-06-25 07:06:43,366|FF|app-20190625070553-0116|10|4| END| 50.45|3.Flocks to report | 0.82| 0|1 2019-06-25 07:06:43,366|FF|app-20190625070553-0116|10|4|START| 50.45|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:06:43,426|FF|app-20190625070553-0116|10|4| END| 50.51|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 07:06:43,426|FF|app-20190625070553-0116|10|4|START| 50.51|5.Flocks reported | 0.00| 0|1 2019-06-25 07:06:43,431|FF|app-20190625070553-0116|10|4| END| 50.51|5.Flocks reported | 0.01| 0|1 2019-06-25 07:06:43,431|FF|app-20190625070553-0116|10|4|START| 50.51|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:06:45,285|FF|app-20190625070553-0116|10|4| END| 52.37|6.Candidates indexed | 1.85| 26108|1 2019-06-25 07:06:45,285|FF|app-20190625070553-0116|10|4|START| 52.37|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:06:45,286|MF|app-20190625070553-0116|10|4|START| 52.37|A.Points indexed | 0.00| 0|2 2019-06-25 07:06:45,371|MF|app-20190625070553-0116|10|4| END| 52.45|A.Points indexed | 0.09| 36788|2 2019-06-25 07:06:45,371|MF|app-20190625070553-0116|10|4|START| 52.45|B.Pairs found | 0.00| 0|2 2019-06-25 07:06:46,335|MF|app-20190625070553-0116|10|4| END| 53.42|B.Pairs found | 0.96| 59006|2 2019-06-25 07:06:46,335|MF|app-20190625070553-0116|10|4|START| 53.42|C.Centers found | 0.00| 0|2 2019-06-25 07:06:47,236|MF|app-20190625070553-0116|10|4| END| 54.32|C.Centers found | 0.90|118012|2 2019-06-25 07:06:47,236|MF|app-20190625070553-0116|10|4|START| 54.32|D.Disks found | 0.00| 0|2 2019-06-25 07:06:51,612|MF|app-20190625070553-0116|10|4| END| 58.69|D.Disks found | 4.38| 46618|2 2019-06-25 07:06:51,613|MF|app-20190625070553-0116|10|4|START| 58.69|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:06:53,557|MF|app-20190625070553-0116|10|4| END| 60.64|E.Disks partitioned | 1.94| 63871|2 2019-06-25 07:06:53,557|MF|app-20190625070553-0116|10|4|START| 60.64|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:06:53,558|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:06:53,558|Cell area: 1055533.7681000116 2019-06-25 07:06:58,374|MF|app-20190625070553-0116|10|4| END| 65.46|F.Maximal disks found | 4.82| 14320|2 2019-06-25 07:06:58,374|MAXIMALS|app-20190625070553-0116|4|10|90.0|3|900|13.088|14320 2019-06-25 07:06:59,256|FF|app-20190625070553-0116|10|4| END| 66.34|1.Maximal disks found | 13.97| 14320|2 2019-06-25 07:06:59,256|FF|app-20190625070553-0116|10|4|START| 66.34|2.Join done | 0.00| 0|2 2019-06-25 07:07:06,928|FF|app-20190625070553-0116|10|4| END| 74.01|2.Join done | 7.67| 40483|2 2019-06-25 07:07:06,928|FF|app-20190625070553-0116|10|4|START| 74.01|3.Flocks to report | 0.00| 0|2 2019-06-25 07:07:08,280|FF|app-20190625070553-0116|10|4| END| 75.36|3.Flocks to report | 1.35| 35129|2 2019-06-25 07:07:08,280|FF|app-20190625070553-0116|10|4|START| 75.36|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:07:08,342|FF|app-20190625070553-0116|10|4|START| 75.42|4a.Making expansions | 0.00| 0|2 2019-06-25 07:07:09,496|FF|app-20190625070553-0116|10|4| END| 76.58|4a.Making expansions | 1.15| 43827|2 2019-06-25 07:07:09,496|FF|app-20190625070553-0116|10|4|START| 76.58|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:07:12,833|FF|app-20190625070553-0116|10|4| END| 79.91|4b.Finding maximals | 3.34| 9728|2 2019-06-25 07:07:13,252|FF|app-20190625070553-0116|10|4| END| 80.33|4.Flocks prunned by expansion | 4.97| 9728|2 2019-06-25 07:07:13,252|FF|app-20190625070553-0116|10|4|START| 80.33|5.Flocks reported | 0.00| 0|2 2019-06-25 07:07:13,829|FF|app-20190625070553-0116|10|4| END| 80.91|5.Flocks reported | 0.58| 9728|2 2019-06-25 07:07:13,829|FF|app-20190625070553-0116|10|4|START| 80.91|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:07:15,667|FF|app-20190625070553-0116|10|4| END| 82.75|6.Candidates indexed | 1.84| 15972|2 2019-06-25 07:07:15,667|FF|app-20190625070553-0116|10|4|START| 82.75|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:07:15,667|MF|app-20190625070553-0116|10|4|START| 82.75|A.Points indexed | 0.00| 0|3 2019-06-25 07:07:15,748|MF|app-20190625070553-0116|10|4| END| 82.83|A.Points indexed | 0.08| 37096|3 2019-06-25 07:07:15,748|MF|app-20190625070553-0116|10|4|START| 82.83|B.Pairs found | 0.00| 0|3 2019-06-25 07:07:16,491|MF|app-20190625070553-0116|10|4| END| 83.57|B.Pairs found | 0.74| 60000|3 2019-06-25 07:07:16,492|MF|app-20190625070553-0116|10|4|START| 83.57|C.Centers found | 0.00| 0|3 2019-06-25 07:07:17,094|MF|app-20190625070553-0116|10|4| END| 84.17|C.Centers found | 0.60|120000|3 2019-06-25 07:07:17,094|MF|app-20190625070553-0116|10|4|START| 84.18|D.Disks found | 0.00| 0|3 2019-06-25 07:07:20,808|MF|app-20190625070553-0116|10|4| END| 87.89|D.Disks found | 3.71| 47418|3 2019-06-25 07:07:20,808|MF|app-20190625070553-0116|10|4|START| 87.89|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:07:22,331|MF|app-20190625070553-0116|10|4| END| 89.41|E.Disks partitioned | 1.52| 64956|3 2019-06-25 07:07:22,331|MF|app-20190625070553-0116|10|4|START| 89.41|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:07:22,331|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:07:22,331|Cell area: 1055533.7681000116 2019-06-25 07:07:26,947|MF|app-20190625070553-0116|10|4| END| 94.03|F.Maximal disks found | 4.62| 14656|3 2019-06-25 07:07:26,947|MAXIMALS|app-20190625070553-0116|4|10|90.0|3|900|11.28|14656 2019-06-25 07:07:27,755|FF|app-20190625070553-0116|10|4| END| 94.84|1.Maximal disks found | 12.09| 14656|3 2019-06-25 07:07:27,755|FF|app-20190625070553-0116|10|4|START| 94.84|2.Join done | 0.00| 0|3 2019-06-25 07:07:32,257|FF|app-20190625070553-0116|10|4| END| 99.34|2.Join done | 4.50| 37923|3 2019-06-25 07:07:32,257|FF|app-20190625070553-0116|10|4|START| 99.34|3.Flocks to report | 0.00| 0|3 2019-06-25 07:07:33,201|FF|app-20190625070553-0116|10|4| END|100.28|3.Flocks to report | 0.94| 32203|3 2019-06-25 07:07:33,201|FF|app-20190625070553-0116|10|4|START|100.28|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:07:33,270|FF|app-20190625070553-0116|10|4|START|100.35|4a.Making expansions | 0.00| 0|3 2019-06-25 07:07:34,164|FF|app-20190625070553-0116|10|4| END|101.25|4a.Making expansions | 0.89| 40984|3 2019-06-25 07:07:34,164|FF|app-20190625070553-0116|10|4|START|101.25|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:07:36,272|FF|app-20190625070553-0116|10|4| END|103.35|4b.Finding maximals | 2.11| 9898|3 2019-06-25 07:07:36,596|FF|app-20190625070553-0116|10|4| END|103.68|4.Flocks prunned by expansion | 3.40| 9898|3 2019-06-25 07:07:36,596|FF|app-20190625070553-0116|10|4|START|103.68|5.Flocks reported | 0.00| 0|3 2019-06-25 07:07:37,080|FF|app-20190625070553-0116|10|4| END|104.16|5.Flocks reported | 0.48| 9898|3 2019-06-25 07:07:37,080|FF|app-20190625070553-0116|10|4|START|104.16|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:07:38,741|FF|app-20190625070553-0116|10|4| END|105.82|6.Candidates indexed | 1.66| 16555|3 2019-06-25 07:07:39,812|Number of flocks: 19626 2019-06-25 07:07:40,491|PFLOCK|app-20190625070553-0116|4|10|90.0|3|3|100.36|19626 2019-06-25 07:07:41,165|FF|app-20190625070553-0116|10|4| END|108.25|Flock Finder run |101.71| 19626|3 2019-06-25 07:07:41,165|FF|app-20190625070553-0116|10|4|START|108.25|Session closed | 0.00| 0|3 2019-06-25 07:07:47,974|FF|app-20190625070553-0116|10|4| END|115.06|Session closed | 6.81| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:07:49,938|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:07:51,044|FF|app-20190625070750-0117|5|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 07:07:51,044|FF|app-20190625070750-0117|5|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 07:07:54,817|FF|app-20190625070750-0117|5|4| END| 4.86|Data read | 3.77|110376|-1 2019-06-25 07:07:54,817|FF|app-20190625070750-0117|5|4|START| 4.86|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:07:54,945|FF|app-20190625070750-0117|5|4| END| 4.99|KDBTree partitioner | 0.13| 272|-1 2019-06-25 07:07:54,945|FF|app-20190625070750-0117|5|4|START| 4.99|MF partitioner | 0.00| 0|-1 2019-06-25 07:07:54,956|FF|app-20190625070750-0117|5|4| END| 5.00|MF partitioner | 0.01| 450|-1 2019-06-25 07:07:54,956|FF|app-20190625070750-0117|5|4|START| 5.00|Pointset done | 0.00| 0|-1 2019-06-25 07:07:55,980|FF|app-20190625070750-0117|5|4| END| 6.03|Pointset done | 1.02| 4|-1 2019-06-25 07:07:55,980|FF|app-20190625070750-0117|5|4|START| 6.03|Flock Finder run | 0.00| 0|-1 2019-06-25 07:07:56,002|FF|app-20190625070750-0117|5|4|START| 6.05|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:07:56,004|MF|app-20190625070750-0117|5|4|START| 6.05|A.Points indexed | 0.00| 0|0 2019-06-25 07:07:56,146|MF|app-20190625070750-0117|5|4| END| 6.19|A.Points indexed | 0.14| 18093|0 2019-06-25 07:07:56,146|MF|app-20190625070750-0117|5|4|START| 6.19|B.Pairs found | 0.00| 0|0 2019-06-25 07:07:57,532|MF|app-20190625070750-0117|5|4| END| 7.58|B.Pairs found | 1.39| 28719|0 2019-06-25 07:07:57,532|MF|app-20190625070750-0117|5|4|START| 7.58|C.Centers found | 0.00| 0|0 2019-06-25 07:07:58,289|MF|app-20190625070750-0117|5|4| END| 8.33|C.Centers found | 0.76| 57438|0 2019-06-25 07:07:58,289|MF|app-20190625070750-0117|5|4|START| 8.33|D.Disks found | 0.00| 0|0 2019-06-25 07:08:01,130|MF|app-20190625070750-0117|5|4| END| 11.18|D.Disks found | 2.84| 22606|0 2019-06-25 07:08:01,130|MF|app-20190625070750-0117|5|4|START| 11.18|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:08:02,071|MF|app-20190625070750-0117|5|4| END| 12.12|E.Disks partitioned | 0.94| 31017|0 2019-06-25 07:08:02,071|MF|app-20190625070750-0117|5|4|START| 12.12|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:08:02,072|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:08:02,073|Cell area: 1055533.7681000116 2019-06-25 07:08:06,326|MF|app-20190625070750-0117|5|4| END| 16.37|F.Maximal disks found | 4.25| 6974|0 2019-06-25 07:08:06,326|MAXIMALS|app-20190625070750-0117|4|5|90.0|3|450|10.322|6974 2019-06-25 07:08:06,827|FF|app-20190625070750-0117|5|4| END| 16.87|1.Maximal disks found | 10.83| 6974|0 2019-06-25 07:08:06,827|FF|app-20190625070750-0117|5|4|START| 16.87|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:08:06,828|MF|app-20190625070750-0117|5|4|START| 16.87|A.Points indexed | 0.00| 0|1 2019-06-25 07:08:06,915|MF|app-20190625070750-0117|5|4| END| 16.96|A.Points indexed | 0.09| 18245|1 2019-06-25 07:08:06,915|MF|app-20190625070750-0117|5|4|START| 16.96|B.Pairs found | 0.00| 0|1 2019-06-25 07:08:07,505|MF|app-20190625070750-0117|5|4| END| 17.55|B.Pairs found | 0.59| 29108|1 2019-06-25 07:08:07,505|MF|app-20190625070750-0117|5|4|START| 17.55|C.Centers found | 0.00| 0|1 2019-06-25 07:08:07,886|MF|app-20190625070750-0117|5|4| END| 17.93|C.Centers found | 0.38| 58216|1 2019-06-25 07:08:07,886|MF|app-20190625070750-0117|5|4|START| 17.93|D.Disks found | 0.00| 0|1 2019-06-25 07:08:09,855|MF|app-20190625070750-0117|5|4| END| 19.90|D.Disks found | 1.97| 22991|1 2019-06-25 07:08:09,855|MF|app-20190625070750-0117|5|4|START| 19.90|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:08:10,687|MF|app-20190625070750-0117|5|4| END| 20.73|E.Disks partitioned | 0.83| 31459|1 2019-06-25 07:08:10,687|MF|app-20190625070750-0117|5|4|START| 20.73|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:08:10,688|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:08:10,688|Cell area: 1055533.7681000116 2019-06-25 07:08:14,621|MF|app-20190625070750-0117|5|4| END| 24.67|F.Maximal disks found | 3.93| 7040|1 2019-06-25 07:08:14,621|MAXIMALS|app-20190625070750-0117|4|5|90.0|3|450|7.793|7040 2019-06-25 07:08:15,054|FF|app-20190625070750-0117|5|4| END| 25.10|1.Maximal disks found | 8.23| 7040|1 2019-06-25 07:08:15,054|FF|app-20190625070750-0117|5|4|START| 25.10|2.Join done | 0.00| 0|1 2019-06-25 07:08:17,052|FF|app-20190625070750-0117|5|4| END| 27.10|2.Join done | 2.00| 12653|1 2019-06-25 07:08:17,052|FF|app-20190625070750-0117|5|4|START| 27.10|3.Flocks to report | 0.00| 0|1 2019-06-25 07:08:17,445|FF|app-20190625070750-0117|5|4| END| 27.49|3.Flocks to report | 0.39| 0|1 2019-06-25 07:08:17,446|FF|app-20190625070750-0117|5|4|START| 27.49|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:08:17,484|FF|app-20190625070750-0117|5|4| END| 27.53|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 07:08:17,484|FF|app-20190625070750-0117|5|4|START| 27.53|5.Flocks reported | 0.00| 0|1 2019-06-25 07:08:17,489|FF|app-20190625070750-0117|5|4| END| 27.53|5.Flocks reported | 0.01| 0|1 2019-06-25 07:08:17,489|FF|app-20190625070750-0117|5|4|START| 27.53|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:08:18,909|FF|app-20190625070750-0117|5|4| END| 28.95|6.Candidates indexed | 1.42| 13060|1 2019-06-25 07:08:18,909|FF|app-20190625070750-0117|5|4|START| 28.95|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:08:18,909|MF|app-20190625070750-0117|5|4|START| 28.95|A.Points indexed | 0.00| 0|2 2019-06-25 07:08:18,978|MF|app-20190625070750-0117|5|4| END| 29.02|A.Points indexed | 0.07| 18394|2 2019-06-25 07:08:18,978|MF|app-20190625070750-0117|5|4|START| 29.02|B.Pairs found | 0.00| 0|2 2019-06-25 07:08:19,450|MF|app-20190625070750-0117|5|4| END| 29.50|B.Pairs found | 0.47| 29503|2 2019-06-25 07:08:19,451|MF|app-20190625070750-0117|5|4|START| 29.50|C.Centers found | 0.00| 0|2 2019-06-25 07:08:19,895|MF|app-20190625070750-0117|5|4| END| 29.94|C.Centers found | 0.44| 59006|2 2019-06-25 07:08:19,895|MF|app-20190625070750-0117|5|4|START| 29.94|D.Disks found | 0.00| 0|2 2019-06-25 07:08:21,832|MF|app-20190625070750-0117|5|4| END| 31.88|D.Disks found | 1.94| 23309|2 2019-06-25 07:08:21,832|MF|app-20190625070750-0117|5|4|START| 31.88|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:08:22,495|MF|app-20190625070750-0117|5|4| END| 32.54|E.Disks partitioned | 0.66| 31937|2 2019-06-25 07:08:22,495|MF|app-20190625070750-0117|5|4|START| 32.54|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:08:22,495|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:08:22,495|Cell area: 1055533.7681000116 2019-06-25 07:08:26,443|MF|app-20190625070750-0117|5|4| END| 36.49|F.Maximal disks found | 3.95| 7158|2 2019-06-25 07:08:26,444|MAXIMALS|app-20190625070750-0117|4|5|90.0|3|450|7.535|7158 2019-06-25 07:08:26,820|FF|app-20190625070750-0117|5|4| END| 36.86|1.Maximal disks found | 7.91| 7158|2 2019-06-25 07:08:26,820|FF|app-20190625070750-0117|5|4|START| 36.87|2.Join done | 0.00| 0|2 2019-06-25 07:08:30,765|FF|app-20190625070750-0117|5|4| END| 40.81|2.Join done | 3.95| 20251|2 2019-06-25 07:08:30,765|FF|app-20190625070750-0117|5|4|START| 40.81|3.Flocks to report | 0.00| 0|2 2019-06-25 07:08:31,555|FF|app-20190625070750-0117|5|4| END| 41.60|3.Flocks to report | 0.79| 17573|2 2019-06-25 07:08:31,555|FF|app-20190625070750-0117|5|4|START| 41.60|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:08:31,596|FF|app-20190625070750-0117|5|4|START| 41.64|4a.Making expansions | 0.00| 0|2 2019-06-25 07:08:32,166|FF|app-20190625070750-0117|5|4| END| 42.21|4a.Making expansions | 0.57| 21932|2 2019-06-25 07:08:32,166|FF|app-20190625070750-0117|5|4|START| 42.21|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:08:35,194|FF|app-20190625070750-0117|5|4| END| 45.24|4b.Finding maximals | 3.03| 4864|2 2019-06-25 07:08:35,405|FF|app-20190625070750-0117|5|4| END| 45.45|4.Flocks prunned by expansion | 3.85| 4864|2 2019-06-25 07:08:35,405|FF|app-20190625070750-0117|5|4|START| 45.45|5.Flocks reported | 0.00| 0|2 2019-06-25 07:08:35,734|FF|app-20190625070750-0117|5|4| END| 45.78|5.Flocks reported | 0.33| 4864|2 2019-06-25 07:08:35,734|FF|app-20190625070750-0117|5|4|START| 45.78|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:08:37,260|FF|app-20190625070750-0117|5|4| END| 47.31|6.Candidates indexed | 1.53| 7987|2 2019-06-25 07:08:37,260|FF|app-20190625070750-0117|5|4|START| 47.31|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:08:37,260|MF|app-20190625070750-0117|5|4|START| 47.31|A.Points indexed | 0.00| 0|3 2019-06-25 07:08:37,319|MF|app-20190625070750-0117|5|4| END| 47.36|A.Points indexed | 0.06| 18548|3 2019-06-25 07:08:37,320|MF|app-20190625070750-0117|5|4|START| 47.36|B.Pairs found | 0.00| 0|3 2019-06-25 07:08:38,167|MF|app-20190625070750-0117|5|4| END| 48.21|B.Pairs found | 0.85| 30000|3 2019-06-25 07:08:38,167|MF|app-20190625070750-0117|5|4|START| 48.21|C.Centers found | 0.00| 0|3 2019-06-25 07:08:38,758|MF|app-20190625070750-0117|5|4| END| 48.80|C.Centers found | 0.59| 60000|3 2019-06-25 07:08:38,759|MF|app-20190625070750-0117|5|4|START| 48.80|D.Disks found | 0.00| 0|3 2019-06-25 07:08:41,725|MF|app-20190625070750-0117|5|4| END| 51.77|D.Disks found | 2.97| 23709|3 2019-06-25 07:08:41,725|MF|app-20190625070750-0117|5|4|START| 51.77|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:08:42,622|MF|app-20190625070750-0117|5|4| END| 52.67|E.Disks partitioned | 0.90| 32468|3 2019-06-25 07:08:42,622|MF|app-20190625070750-0117|5|4|START| 52.67|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:08:42,622|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:08:42,622|Cell area: 1055533.7681000116 2019-06-25 07:08:46,847|MF|app-20190625070750-0117|5|4| END| 56.89|F.Maximal disks found | 4.23| 7325|3 2019-06-25 07:08:46,848|MAXIMALS|app-20190625070750-0117|4|5|90.0|3|450|9.587|7325 2019-06-25 07:08:47,302|FF|app-20190625070750-0117|5|4| END| 57.35|1.Maximal disks found | 10.04| 7325|3 2019-06-25 07:08:47,302|FF|app-20190625070750-0117|5|4|START| 57.35|2.Join done | 0.00| 0|3 2019-06-25 07:08:50,345|FF|app-20190625070750-0117|5|4| END| 60.39|2.Join done | 3.04| 18963|3 2019-06-25 07:08:50,345|FF|app-20190625070750-0117|5|4|START| 60.39|3.Flocks to report | 0.00| 0|3 2019-06-25 07:08:51,079|FF|app-20190625070750-0117|5|4| END| 61.12|3.Flocks to report | 0.73| 16098|3 2019-06-25 07:08:51,079|FF|app-20190625070750-0117|5|4|START| 61.12|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:08:51,121|FF|app-20190625070750-0117|5|4|START| 61.17|4a.Making expansions | 0.00| 0|3 2019-06-25 07:08:51,738|FF|app-20190625070750-0117|5|4| END| 61.78|4a.Making expansions | 0.62| 20528|3 2019-06-25 07:08:51,739|FF|app-20190625070750-0117|5|4|START| 61.78|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:08:53,653|FF|app-20190625070750-0117|5|4| END| 63.70|4b.Finding maximals | 1.92| 4949|3 2019-06-25 07:08:53,864|FF|app-20190625070750-0117|5|4| END| 63.91|4.Flocks prunned by expansion | 2.79| 4949|3 2019-06-25 07:08:53,864|FF|app-20190625070750-0117|5|4|START| 63.91|5.Flocks reported | 0.00| 0|3 2019-06-25 07:08:54,151|FF|app-20190625070750-0117|5|4| END| 64.20|5.Flocks reported | 0.29| 4949|3 2019-06-25 07:08:54,151|FF|app-20190625070750-0117|5|4|START| 64.20|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:08:55,861|FF|app-20190625070750-0117|5|4| END| 65.91|6.Candidates indexed | 1.71| 8283|3 2019-06-25 07:08:56,532|Number of flocks: 9813 2019-06-25 07:08:56,892|PFLOCK|app-20190625070750-0117|4|5|90.0|3|3|60.55|9813 2019-06-25 07:08:57,258|FF|app-20190625070750-0117|5|4| END| 67.30|Flock Finder run | 61.28| 9813|3 2019-06-25 07:08:57,258|FF|app-20190625070750-0117|5|4|START| 67.30|Session closed | 0.00| 0|3 2019-06-25 07:09:04,127|FF|app-20190625070750-0117|5|4| END| 74.17|Session closed | 6.87| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:09:06,045|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:09:07,137|FF|app-20190625070906-0118|15|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 07:09:07,137|FF|app-20190625070906-0118|15|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 07:09:11,245|FF|app-20190625070906-0118|15|4| END| 5.18|Data read | 4.11|331128|-1 2019-06-25 07:09:11,245|FF|app-20190625070906-0118|15|4|START| 5.18|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:09:11,563|FF|app-20190625070906-0118|15|4| END| 5.50|KDBTree partitioner | 0.32| 816|-1 2019-06-25 07:09:11,564|FF|app-20190625070906-0118|15|4|START| 5.50|MF partitioner | 0.00| 0|-1 2019-06-25 07:09:11,592|FF|app-20190625070906-0118|15|4| END| 5.53|MF partitioner | 0.03| 1350|-1 2019-06-25 07:09:11,592|FF|app-20190625070906-0118|15|4|START| 5.53|Pointset done | 0.00| 0|-1 2019-06-25 07:09:12,695|FF|app-20190625070906-0118|15|4| END| 6.63|Pointset done | 1.10| 4|-1 2019-06-25 07:09:12,695|FF|app-20190625070906-0118|15|4|START| 6.63|Flock Finder run | 0.00| 0|-1 2019-06-25 07:09:12,712|FF|app-20190625070906-0118|15|4|START| 6.65|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:09:12,714|MF|app-20190625070906-0118|15|4|START| 6.65|A.Points indexed | 0.00| 0|0 2019-06-25 07:09:12,919|MF|app-20190625070906-0118|15|4| END| 6.86|A.Points indexed | 0.20| 54279|0 2019-06-25 07:09:12,919|MF|app-20190625070906-0118|15|4|START| 6.86|B.Pairs found | 0.00| 0|0 2019-06-25 07:09:15,203|MF|app-20190625070906-0118|15|4| END| 9.14|B.Pairs found | 2.28|101871|0 2019-06-25 07:09:15,203|MF|app-20190625070906-0118|15|4|START| 9.14|C.Centers found | 0.00| 0|0 2019-06-25 07:09:16,946|MF|app-20190625070906-0118|15|4| END| 10.89|C.Centers found | 1.74|203742|0 2019-06-25 07:09:16,946|MF|app-20190625070906-0118|15|4|START| 10.89|D.Disks found | 0.00| 0|0 2019-06-25 07:09:26,519|MF|app-20190625070906-0118|15|4| END| 20.46|D.Disks found | 9.57| 85998|0 2019-06-25 07:09:26,519|MF|app-20190625070906-0118|15|4|START| 20.46|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:09:29,379|MF|app-20190625070906-0118|15|4| END| 23.32|E.Disks partitioned | 2.86|121693|0 2019-06-25 07:09:29,380|MF|app-20190625070906-0118|15|4|START| 23.32|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:09:29,382|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:09:29,382|Cell area: 1055533.7681000116 2019-06-25 07:09:39,521|MF|app-20190625070906-0118|15|4| END| 33.46|F.Maximal disks found | 10.14| 25114|0 2019-06-25 07:09:39,522|MAXIMALS|app-20190625070906-0118|4|15|100.0|3|1350|26.808|25114 2019-06-25 07:09:40,555|FF|app-20190625070906-0118|15|4| END| 34.49|1.Maximal disks found | 27.84| 25114|0 2019-06-25 07:09:40,555|FF|app-20190625070906-0118|15|4|START| 34.49|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:09:40,555|MF|app-20190625070906-0118|15|4|START| 34.49|A.Points indexed | 0.00| 0|1 2019-06-25 07:09:40,678|MF|app-20190625070906-0118|15|4| END| 34.62|A.Points indexed | 0.12| 54735|1 2019-06-25 07:09:40,678|MF|app-20190625070906-0118|15|4|START| 34.62|B.Pairs found | 0.00| 0|1 2019-06-25 07:09:41,611|MF|app-20190625070906-0118|15|4| END| 35.55|B.Pairs found | 0.93|103386|1 2019-06-25 07:09:41,611|MF|app-20190625070906-0118|15|4|START| 35.55|C.Centers found | 0.00| 0|1 2019-06-25 07:09:43,481|MF|app-20190625070906-0118|15|4| END| 37.42|C.Centers found | 1.87|206772|1 2019-06-25 07:09:43,482|MF|app-20190625070906-0118|15|4|START| 37.42|D.Disks found | 0.00| 0|1 2019-06-25 07:09:48,529|MF|app-20190625070906-0118|15|4| END| 42.47|D.Disks found | 5.05| 87348|1 2019-06-25 07:09:48,530|MF|app-20190625070906-0118|15|4|START| 42.47|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:09:49,597|MF|app-20190625070906-0118|15|4| END| 43.54|E.Disks partitioned | 1.07|123553|1 2019-06-25 07:09:49,597|MF|app-20190625070906-0118|15|4|START| 43.54|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:09:49,598|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:09:49,598|Cell area: 1055533.7681000116 2019-06-25 07:09:59,694|MF|app-20190625070906-0118|15|4| END| 53.63|F.Maximal disks found | 10.10| 25640|1 2019-06-25 07:09:59,694|MAXIMALS|app-20190625070906-0118|4|15|100.0|3|1350|19.139|25640 2019-06-25 07:10:00,724|FF|app-20190625070906-0118|15|4| END| 54.66|1.Maximal disks found | 20.17| 25640|1 2019-06-25 07:10:00,724|FF|app-20190625070906-0118|15|4|START| 54.66|2.Join done | 0.00| 0|1 2019-06-25 07:10:08,503|FF|app-20190625070906-0118|15|4| END| 62.44|2.Join done | 7.78| 51443|1 2019-06-25 07:10:08,503|FF|app-20190625070906-0118|15|4|START| 62.44|3.Flocks to report | 0.00| 0|1 2019-06-25 07:10:11,656|FF|app-20190625070906-0118|15|4| END| 65.60|3.Flocks to report | 3.15| 0|1 2019-06-25 07:10:11,657|FF|app-20190625070906-0118|15|4|START| 65.60|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:10:11,796|FF|app-20190625070906-0118|15|4| END| 65.74|4.Flocks prunned by expansion | 0.14| 0|1 2019-06-25 07:10:11,797|FF|app-20190625070906-0118|15|4|START| 65.74|5.Flocks reported | 0.00| 0|1 2019-06-25 07:10:11,802|FF|app-20190625070906-0118|15|4| END| 65.74|5.Flocks reported | 0.01| 0|1 2019-06-25 07:10:11,802|FF|app-20190625070906-0118|15|4|START| 65.74|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:10:15,304|FF|app-20190625070906-0118|15|4| END| 69.24|6.Candidates indexed | 3.50| 52931|1 2019-06-25 07:10:15,304|FF|app-20190625070906-0118|15|4|START| 69.24|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:10:15,304|MF|app-20190625070906-0118|15|4|START| 69.24|A.Points indexed | 0.00| 0|2 2019-06-25 07:10:15,424|MF|app-20190625070906-0118|15|4| END| 69.36|A.Points indexed | 0.12| 55182|2 2019-06-25 07:10:15,424|MF|app-20190625070906-0118|15|4|START| 69.36|B.Pairs found | 0.00| 0|2 2019-06-25 07:10:16,226|MF|app-20190625070906-0118|15|4| END| 70.17|B.Pairs found | 0.80|104754|2 2019-06-25 07:10:16,226|MF|app-20190625070906-0118|15|4|START| 70.17|C.Centers found | 0.00| 0|2 2019-06-25 07:10:17,396|MF|app-20190625070906-0118|15|4| END| 71.34|C.Centers found | 1.17|209508|2 2019-06-25 07:10:17,396|MF|app-20190625070906-0118|15|4|START| 71.34|D.Disks found | 0.00| 0|2 2019-06-25 07:10:21,027|MF|app-20190625070906-0118|15|4| END| 74.97|D.Disks found | 3.63| 88647|2 2019-06-25 07:10:21,028|MF|app-20190625070906-0118|15|4|START| 74.97|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:10:22,060|MF|app-20190625070906-0118|15|4| END| 76.00|E.Disks partitioned | 1.03|125639|2 2019-06-25 07:10:22,060|MF|app-20190625070906-0118|15|4|START| 76.00|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:10:22,061|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:10:22,061|Cell area: 1055533.7681000116 2019-06-25 07:10:32,572|MF|app-20190625070906-0118|15|4| END| 86.51|F.Maximal disks found | 10.51| 26055|2 2019-06-25 07:10:32,572|MAXIMALS|app-20190625070906-0118|4|15|100.0|3|1350|17.268|26055 2019-06-25 07:10:33,562|FF|app-20190625070906-0118|15|4| END| 87.50|1.Maximal disks found | 18.26| 26055|2 2019-06-25 07:10:33,562|FF|app-20190625070906-0118|15|4|START| 87.50|2.Join done | 0.00| 0|2 2019-06-25 07:10:43,944|FF|app-20190625070906-0118|15|4| END| 97.88|2.Join done | 10.38| 98061|2 2019-06-25 07:10:43,944|FF|app-20190625070906-0118|15|4|START| 97.88|3.Flocks to report | 0.00| 0|2 2019-06-25 07:10:45,775|FF|app-20190625070906-0118|15|4| END| 99.71|3.Flocks to report | 1.83| 83680|2 2019-06-25 07:10:45,775|FF|app-20190625070906-0118|15|4|START| 99.71|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:10:45,852|FF|app-20190625070906-0118|15|4|START| 99.79|4a.Making expansions | 0.00| 0|2 2019-06-25 07:10:46,924|FF|app-20190625070906-0118|15|4| END|100.86|4a.Making expansions | 1.07|103963|2 2019-06-25 07:10:46,925|FF|app-20190625070906-0118|15|4|START|100.86|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:11:00,337|FF|app-20190625070906-0118|15|4| END|114.28|4b.Finding maximals | 13.41| 17091|2 2019-06-25 07:11:00,764|FF|app-20190625070906-0118|15|4| END|114.70|4.Flocks prunned by expansion | 14.99| 17091|2 2019-06-25 07:11:00,764|FF|app-20190625070906-0118|15|4|START|114.70|5.Flocks reported | 0.00| 0|2 2019-06-25 07:11:01,386|FF|app-20190625070906-0118|15|4| END|115.33|5.Flocks reported | 0.62| 17091|2 2019-06-25 07:11:01,386|FF|app-20190625070906-0118|15|4|START|115.33|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:11:03,195|FF|app-20190625070906-0118|15|4| END|117.13|6.Candidates indexed | 1.81| 33209|2 2019-06-25 07:11:03,195|FF|app-20190625070906-0118|15|4|START|117.13|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:11:03,195|MF|app-20190625070906-0118|15|4|START|117.13|A.Points indexed | 0.00| 0|3 2019-06-25 07:11:03,310|MF|app-20190625070906-0118|15|4| END|117.25|A.Points indexed | 0.12| 55644|3 2019-06-25 07:11:03,310|MF|app-20190625070906-0118|15|4|START|117.25|B.Pairs found | 0.00| 0|3 2019-06-25 07:11:04,047|MF|app-20190625070906-0118|15|4| END|117.99|B.Pairs found | 0.74|106545|3 2019-06-25 07:11:04,047|MF|app-20190625070906-0118|15|4|START|117.99|C.Centers found | 0.00| 0|3 2019-06-25 07:11:05,369|MF|app-20190625070906-0118|15|4| END|119.31|C.Centers found | 1.32|213090|3 2019-06-25 07:11:05,369|MF|app-20190625070906-0118|15|4|START|119.31|D.Disks found | 0.00| 0|3 2019-06-25 07:11:08,719|MF|app-20190625070906-0118|15|4| END|122.66|D.Disks found | 3.35| 90426|3 2019-06-25 07:11:08,719|MF|app-20190625070906-0118|15|4|START|122.66|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:11:09,752|MF|app-20190625070906-0118|15|4| END|123.69|E.Disks partitioned | 1.03|128174|3 2019-06-25 07:11:09,752|MF|app-20190625070906-0118|15|4|START|123.69|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:11:09,753|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:11:09,753|Cell area: 1055533.7681000116 2019-06-25 07:11:22,417|MF|app-20190625070906-0118|15|4| END|136.36|F.Maximal disks found | 12.67| 26538|3 2019-06-25 07:11:22,417|MAXIMALS|app-20190625070906-0118|4|15|100.0|3|1350|19.222|26538 2019-06-25 07:11:23,419|FF|app-20190625070906-0118|15|4| END|137.36|1.Maximal disks found | 20.22| 26538|3 2019-06-25 07:11:23,419|FF|app-20190625070906-0118|15|4|START|137.36|2.Join done | 0.00| 0|3 2019-06-25 07:11:30,896|FF|app-20190625070906-0118|15|4| END|144.84|2.Join done | 7.48| 90379|3 2019-06-25 07:11:30,896|FF|app-20190625070906-0118|15|4|START|144.84|3.Flocks to report | 0.00| 0|3 2019-06-25 07:11:32,744|FF|app-20190625070906-0118|15|4| END|146.68|3.Flocks to report | 1.85| 75867|3 2019-06-25 07:11:32,744|FF|app-20190625070906-0118|15|4|START|146.68|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:11:32,861|FF|app-20190625070906-0118|15|4|START|146.80|4a.Making expansions | 0.00| 0|3 2019-06-25 07:11:33,787|FF|app-20190625070906-0118|15|4| END|147.73|4a.Making expansions | 0.93| 96493|3 2019-06-25 07:11:33,787|FF|app-20190625070906-0118|15|4|START|147.73|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:11:44,544|FF|app-20190625070906-0118|15|4| END|158.48|4b.Finding maximals | 10.76| 17301|3 2019-06-25 07:11:45,013|FF|app-20190625070906-0118|15|4| END|158.95|4.Flocks prunned by expansion | 12.27| 17301|3 2019-06-25 07:11:45,013|FF|app-20190625070906-0118|15|4|START|158.95|5.Flocks reported | 0.00| 0|3 2019-06-25 07:11:45,611|FF|app-20190625070906-0118|15|4| END|159.55|5.Flocks reported | 0.60| 17301|3 2019-06-25 07:11:45,611|FF|app-20190625070906-0118|15|4|START|159.55|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:11:47,455|FF|app-20190625070906-0118|15|4| END|161.39|6.Candidates indexed | 1.84| 33436|3 2019-06-25 07:11:48,839|Number of flocks: 34392 2019-06-25 07:11:49,769|PFLOCK|app-20190625070906-0118|4|15|100.0|3|3|156.14|34392 2019-06-25 07:11:50,676|FF|app-20190625070906-0118|15|4| END|164.62|Flock Finder run |157.98| 34392|3 2019-06-25 07:11:50,676|FF|app-20190625070906-0118|15|4|START|164.62|Session closed | 0.00| 0|3 2019-06-25 07:11:57,774|FF|app-20190625070906-0118|15|4| END|171.71|Session closed | 7.10| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:11:59,806|FF|app-00000000000000-0000|10|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 07:12:00,952|FF|app-20190625071200-0119|10|4| END| 1.13|Session start | 1.15| 0|-1 2019-06-25 07:12:00,953|FF|app-20190625071200-0119|10|4|START| 1.13|Data read | 0.00| 0|-1 2019-06-25 07:12:05,238|FF|app-20190625071200-0119|10|4| END| 5.42|Data read | 4.29|220752|-1 2019-06-25 07:12:05,238|FF|app-20190625071200-0119|10|4|START| 5.42|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:12:05,509|FF|app-20190625071200-0119|10|4| END| 5.69|KDBTree partitioner | 0.27| 544|-1 2019-06-25 07:12:05,509|FF|app-20190625071200-0119|10|4|START| 5.69|MF partitioner | 0.00| 0|-1 2019-06-25 07:12:05,530|FF|app-20190625071200-0119|10|4| END| 5.71|MF partitioner | 0.02| 900|-1 2019-06-25 07:12:05,530|FF|app-20190625071200-0119|10|4|START| 5.71|Pointset done | 0.00| 0|-1 2019-06-25 07:12:06,383|FF|app-20190625071200-0119|10|4| END| 6.56|Pointset done | 0.85| 4|-1 2019-06-25 07:12:06,383|FF|app-20190625071200-0119|10|4|START| 6.56|Flock Finder run | 0.00| 0|-1 2019-06-25 07:12:06,403|FF|app-20190625071200-0119|10|4|START| 6.58|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:12:06,405|MF|app-20190625071200-0119|10|4|START| 6.58|A.Points indexed | 0.00| 0|0 2019-06-25 07:12:06,579|MF|app-20190625071200-0119|10|4| END| 6.76|A.Points indexed | 0.17| 36186|0 2019-06-25 07:12:06,579|MF|app-20190625071200-0119|10|4|START| 6.76|B.Pairs found | 0.00| 0|0 2019-06-25 07:12:08,892|MF|app-20190625071200-0119|10|4| END| 9.07|B.Pairs found | 2.31| 67914|0 2019-06-25 07:12:08,892|MF|app-20190625071200-0119|10|4|START| 9.07|C.Centers found | 0.00| 0|0 2019-06-25 07:12:10,633|MF|app-20190625071200-0119|10|4| END| 10.81|C.Centers found | 1.74|135828|0 2019-06-25 07:12:10,633|MF|app-20190625071200-0119|10|4|START| 10.81|D.Disks found | 0.00| 0|0 2019-06-25 07:12:19,244|MF|app-20190625071200-0119|10|4| END| 19.42|D.Disks found | 8.61| 57332|0 2019-06-25 07:12:19,244|MF|app-20190625071200-0119|10|4|START| 19.42|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:12:23,238|MF|app-20190625071200-0119|10|4| END| 23.42|E.Disks partitioned | 3.99| 81114|0 2019-06-25 07:12:23,238|MF|app-20190625071200-0119|10|4|START| 23.42|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:12:23,240|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:12:23,240|Cell area: 1055533.7681000116 2019-06-25 07:12:35,962|MF|app-20190625071200-0119|10|4| END| 36.14|F.Maximal disks found | 12.72| 16742|0 2019-06-25 07:12:35,962|MAXIMALS|app-20190625071200-0119|4|10|100.0|3|900|29.557|16742 2019-06-25 07:12:37,575|FF|app-20190625071200-0119|10|4| END| 37.75|1.Maximal disks found | 31.17| 16742|0 2019-06-25 07:12:37,575|FF|app-20190625071200-0119|10|4|START| 37.75|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:12:37,575|MF|app-20190625071200-0119|10|4|START| 37.75|A.Points indexed | 0.00| 0|1 2019-06-25 07:12:37,676|MF|app-20190625071200-0119|10|4| END| 37.85|A.Points indexed | 0.10| 36490|1 2019-06-25 07:12:37,676|MF|app-20190625071200-0119|10|4|START| 37.85|B.Pairs found | 0.00| 0|1 2019-06-25 07:12:38,777|MF|app-20190625071200-0119|10|4| END| 38.95|B.Pairs found | 1.10| 68924|1 2019-06-25 07:12:38,777|MF|app-20190625071200-0119|10|4|START| 38.95|C.Centers found | 0.00| 0|1 2019-06-25 07:12:40,274|MF|app-20190625071200-0119|10|4| END| 40.45|C.Centers found | 1.50|137848|1 2019-06-25 07:12:40,274|MF|app-20190625071200-0119|10|4|START| 40.45|D.Disks found | 0.00| 0|1 2019-06-25 07:12:45,378|MF|app-20190625071200-0119|10|4| END| 45.56|D.Disks found | 5.10| 58232|1 2019-06-25 07:12:45,378|MF|app-20190625071200-0119|10|4|START| 45.56|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:12:47,491|MF|app-20190625071200-0119|10|4| END| 47.67|E.Disks partitioned | 2.11| 82341|1 2019-06-25 07:12:47,491|MF|app-20190625071200-0119|10|4|START| 47.67|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:12:47,492|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:12:47,492|Cell area: 1055533.7681000116 2019-06-25 07:12:57,938|MF|app-20190625071200-0119|10|4| END| 58.12|F.Maximal disks found | 10.45| 17096|1 2019-06-25 07:12:57,939|MAXIMALS|app-20190625071200-0119|4|10|100.0|3|900|20.364|17096 2019-06-25 07:12:58,855|FF|app-20190625071200-0119|10|4| END| 59.03|1.Maximal disks found | 21.28| 17096|1 2019-06-25 07:12:58,856|FF|app-20190625071200-0119|10|4|START| 59.03|2.Join done | 0.00| 0|1 2019-06-25 07:13:04,291|FF|app-20190625071200-0119|10|4| END| 64.47|2.Join done | 5.44| 34283|1 2019-06-25 07:13:04,291|FF|app-20190625071200-0119|10|4|START| 64.47|3.Flocks to report | 0.00| 0|1 2019-06-25 07:13:05,315|FF|app-20190625071200-0119|10|4| END| 65.49|3.Flocks to report | 1.02| 0|1 2019-06-25 07:13:05,315|FF|app-20190625071200-0119|10|4|START| 65.49|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:13:05,400|FF|app-20190625071200-0119|10|4| END| 65.58|4.Flocks prunned by expansion | 0.09| 0|1 2019-06-25 07:13:05,400|FF|app-20190625071200-0119|10|4|START| 65.58|5.Flocks reported | 0.00| 0|1 2019-06-25 07:13:05,406|FF|app-20190625071200-0119|10|4| END| 65.58|5.Flocks reported | 0.01| 0|1 2019-06-25 07:13:05,407|FF|app-20190625071200-0119|10|4|START| 65.58|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:13:07,662|FF|app-20190625071200-0119|10|4| END| 67.84|6.Candidates indexed | 2.26| 35275|1 2019-06-25 07:13:07,662|FF|app-20190625071200-0119|10|4|START| 67.84|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:13:07,662|MF|app-20190625071200-0119|10|4|START| 67.84|A.Points indexed | 0.00| 0|2 2019-06-25 07:13:07,752|MF|app-20190625071200-0119|10|4| END| 67.93|A.Points indexed | 0.09| 36788|2 2019-06-25 07:13:07,752|MF|app-20190625071200-0119|10|4|START| 67.93|B.Pairs found | 0.00| 0|2 2019-06-25 07:13:08,348|MF|app-20190625071200-0119|10|4| END| 68.52|B.Pairs found | 0.60| 69836|2 2019-06-25 07:13:08,348|MF|app-20190625071200-0119|10|4|START| 68.53|C.Centers found | 0.00| 0|2 2019-06-25 07:13:09,078|MF|app-20190625071200-0119|10|4| END| 69.26|C.Centers found | 0.73|139672|2 2019-06-25 07:13:09,078|MF|app-20190625071200-0119|10|4|START| 69.26|D.Disks found | 0.00| 0|2 2019-06-25 07:13:14,213|MF|app-20190625071200-0119|10|4| END| 74.39|D.Disks found | 5.14| 59098|2 2019-06-25 07:13:14,213|MF|app-20190625071200-0119|10|4|START| 74.39|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:13:17,860|MF|app-20190625071200-0119|10|4| END| 78.04|E.Disks partitioned | 3.65| 83724|2 2019-06-25 07:13:17,860|MF|app-20190625071200-0119|10|4|START| 78.04|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:13:17,860|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:13:17,861|Cell area: 1055533.7681000116 2019-06-25 07:13:30,492|MF|app-20190625071200-0119|10|4| END| 90.67|F.Maximal disks found | 12.63| 17376|2 2019-06-25 07:13:30,492|MAXIMALS|app-20190625071200-0119|4|10|100.0|3|900|22.83|17376 2019-06-25 07:13:31,939|FF|app-20190625071200-0119|10|4| END| 92.12|1.Maximal disks found | 24.28| 17376|2 2019-06-25 07:13:31,939|FF|app-20190625071200-0119|10|4|START| 92.12|2.Join done | 0.00| 0|2 2019-06-25 07:13:51,247|FF|app-20190625071200-0119|10|4| END|111.42|2.Join done | 19.31| 65350|2 2019-06-25 07:13:51,247|FF|app-20190625071200-0119|10|4|START|111.42|3.Flocks to report | 0.00| 0|2 2019-06-25 07:13:54,096|FF|app-20190625071200-0119|10|4| END|114.27|3.Flocks to report | 2.85| 55753|2 2019-06-25 07:13:54,096|FF|app-20190625071200-0119|10|4|START|114.27|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:13:54,187|FF|app-20190625071200-0119|10|4|START|114.36|4a.Making expansions | 0.00| 0|2 2019-06-25 07:13:56,345|FF|app-20190625071200-0119|10|4| END|116.52|4a.Making expansions | 2.16| 69239|2 2019-06-25 07:13:56,345|FF|app-20190625071200-0119|10|4|START|116.52|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:14:11,977|FF|app-20190625071200-0119|10|4| END|132.15|4b.Finding maximals | 15.63| 11394|2 2019-06-25 07:14:12,558|FF|app-20190625071200-0119|10|4| END|132.74|4.Flocks prunned by expansion | 18.46| 11394|2 2019-06-25 07:14:12,558|FF|app-20190625071200-0119|10|4|START|132.74|5.Flocks reported | 0.00| 0|2 2019-06-25 07:14:13,516|FF|app-20190625071200-0119|10|4| END|133.69|5.Flocks reported | 0.96| 11394|2 2019-06-25 07:14:13,517|FF|app-20190625071200-0119|10|4|START|133.69|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:14:16,995|FF|app-20190625071200-0119|10|4| END|137.17|6.Candidates indexed | 3.48| 22156|2 2019-06-25 07:14:16,995|FF|app-20190625071200-0119|10|4|START|137.17|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:14:16,995|MF|app-20190625071200-0119|10|4|START|137.17|A.Points indexed | 0.00| 0|3 2019-06-25 07:14:17,086|MF|app-20190625071200-0119|10|4| END|137.26|A.Points indexed | 0.09| 37096|3 2019-06-25 07:14:17,086|MF|app-20190625071200-0119|10|4|START|137.26|B.Pairs found | 0.00| 0|3 2019-06-25 07:14:17,620|MF|app-20190625071200-0119|10|4| END|137.80|B.Pairs found | 0.53| 71030|3 2019-06-25 07:14:17,620|MF|app-20190625071200-0119|10|4|START|137.80|C.Centers found | 0.00| 0|3 2019-06-25 07:14:19,026|MF|app-20190625071200-0119|10|4| END|139.20|C.Centers found | 1.41|142060|3 2019-06-25 07:14:19,026|MF|app-20190625071200-0119|10|4|START|139.20|D.Disks found | 0.00| 0|3 2019-06-25 07:14:22,272|MF|app-20190625071200-0119|10|4| END|142.45|D.Disks found | 3.25| 60284|3 2019-06-25 07:14:22,272|MF|app-20190625071200-0119|10|4|START|142.45|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:14:23,024|MF|app-20190625071200-0119|10|4| END|143.20|E.Disks partitioned | 0.75| 85409|3 2019-06-25 07:14:23,025|MF|app-20190625071200-0119|10|4|START|143.20|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:14:23,025|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:14:23,025|Cell area: 1055533.7681000116 2019-06-25 07:14:34,711|MF|app-20190625071200-0119|10|4| END|154.89|F.Maximal disks found | 11.69| 17693|3 2019-06-25 07:14:34,711|MAXIMALS|app-20190625071200-0119|4|10|100.0|3|900|17.716|17693 2019-06-25 07:14:35,388|FF|app-20190625071200-0119|10|4| END|155.57|1.Maximal disks found | 18.39| 17693|3 2019-06-25 07:14:35,388|FF|app-20190625071200-0119|10|4|START|155.57|2.Join done | 0.00| 0|3 2019-06-25 07:14:41,212|FF|app-20190625071200-0119|10|4| END|161.39|2.Join done | 5.82| 60349|3 2019-06-25 07:14:41,212|FF|app-20190625071200-0119|10|4|START|161.39|3.Flocks to report | 0.00| 0|3 2019-06-25 07:14:42,512|FF|app-20190625071200-0119|10|4| END|162.69|3.Flocks to report | 1.30| 50613|3 2019-06-25 07:14:42,512|FF|app-20190625071200-0119|10|4|START|162.69|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:14:42,578|FF|app-20190625071200-0119|10|4|START|162.76|4a.Making expansions | 0.00| 0|3 2019-06-25 07:14:43,689|FF|app-20190625071200-0119|10|4| END|163.87|4a.Making expansions | 1.11| 64303|3 2019-06-25 07:14:43,689|FF|app-20190625071200-0119|10|4|START|163.87|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:14:53,446|FF|app-20190625071200-0119|10|4| END|173.62|4b.Finding maximals | 9.76| 11534|3 2019-06-25 07:14:53,794|FF|app-20190625071200-0119|10|4| END|173.97|4.Flocks prunned by expansion | 11.28| 11534|3 2019-06-25 07:14:53,794|FF|app-20190625071200-0119|10|4|START|173.97|5.Flocks reported | 0.00| 0|3 2019-06-25 07:14:54,283|FF|app-20190625071200-0119|10|4| END|174.46|5.Flocks reported | 0.49| 11534|3 2019-06-25 07:14:54,283|FF|app-20190625071200-0119|10|4|START|174.46|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:14:56,040|FF|app-20190625071200-0119|10|4| END|176.22|6.Candidates indexed | 1.76| 22352|3 2019-06-25 07:14:57,608|Number of flocks: 22928 2019-06-25 07:14:58,493|PFLOCK|app-20190625071200-0119|4|10|100.0|3|3|171.23|22928 2019-06-25 07:14:59,304|FF|app-20190625071200-0119|10|4| END|179.48|Flock Finder run |172.92| 22928|3 2019-06-25 07:14:59,304|FF|app-20190625071200-0119|10|4|START|179.48|Session closed | 0.00| 0|3 2019-06-25 07:15:06,159|FF|app-20190625071200-0119|10|4| END|186.34|Session closed | 6.86| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:15:08,158|FF|app-00000000000000-0000|5|4|START| 0.13|Session start | 0.00| 0|-1 2019-06-25 07:15:09,243|FF|app-20190625071508-0120|5|4| END| 1.07|Session start | 1.09| 0|-1 2019-06-25 07:15:09,243|FF|app-20190625071508-0120|5|4|START| 1.07|Data read | 0.00| 0|-1 2019-06-25 07:15:12,916|FF|app-20190625071508-0120|5|4| END| 4.74|Data read | 3.67|110376|-1 2019-06-25 07:15:12,916|FF|app-20190625071508-0120|5|4|START| 4.74|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:15:13,036|FF|app-20190625071508-0120|5|4| END| 4.86|KDBTree partitioner | 0.12| 272|-1 2019-06-25 07:15:13,037|FF|app-20190625071508-0120|5|4|START| 4.86|MF partitioner | 0.00| 0|-1 2019-06-25 07:15:13,051|FF|app-20190625071508-0120|5|4| END| 4.88|MF partitioner | 0.02| 450|-1 2019-06-25 07:15:13,052|FF|app-20190625071508-0120|5|4|START| 4.88|Pointset done | 0.00| 0|-1 2019-06-25 07:15:13,806|FF|app-20190625071508-0120|5|4| END| 5.63|Pointset done | 0.76| 4|-1 2019-06-25 07:15:13,806|FF|app-20190625071508-0120|5|4|START| 5.63|Flock Finder run | 0.00| 0|-1 2019-06-25 07:15:13,963|FF|app-20190625071508-0120|5|4|START| 5.79|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:15:13,966|MF|app-20190625071508-0120|5|4|START| 5.79|A.Points indexed | 0.00| 0|0 2019-06-25 07:15:14,146|MF|app-20190625071508-0120|5|4| END| 5.97|A.Points indexed | 0.18| 18093|0 2019-06-25 07:15:14,146|MF|app-20190625071508-0120|5|4|START| 5.97|B.Pairs found | 0.00| 0|0 2019-06-25 07:15:15,411|MF|app-20190625071508-0120|5|4| END| 7.24|B.Pairs found | 1.27| 33957|0 2019-06-25 07:15:15,411|MF|app-20190625071508-0120|5|4|START| 7.24|C.Centers found | 0.00| 0|0 2019-06-25 07:15:16,132|MF|app-20190625071508-0120|5|4| END| 7.96|C.Centers found | 0.72| 67914|0 2019-06-25 07:15:16,132|MF|app-20190625071508-0120|5|4|START| 7.96|D.Disks found | 0.00| 0|0 2019-06-25 07:15:19,222|MF|app-20190625071508-0120|5|4| END| 11.05|D.Disks found | 3.09| 28666|0 2019-06-25 07:15:19,223|MF|app-20190625071508-0120|5|4|START| 11.05|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:15:20,637|MF|app-20190625071508-0120|5|4| END| 12.46|E.Disks partitioned | 1.42| 40550|0 2019-06-25 07:15:20,637|MF|app-20190625071508-0120|5|4|START| 12.46|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:15:20,639|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:15:20,639|Cell area: 1055533.7681000116 2019-06-25 07:15:31,179|MF|app-20190625071508-0120|5|4| END| 23.00|F.Maximal disks found | 10.54| 8371|0 2019-06-25 07:15:31,179|MAXIMALS|app-20190625071508-0120|4|5|100.0|3|450|17.213|8371 2019-06-25 07:15:31,721|FF|app-20190625071508-0120|5|4| END| 23.55|1.Maximal disks found | 17.76| 8371|0 2019-06-25 07:15:31,721|FF|app-20190625071508-0120|5|4|START| 23.55|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:15:31,721|MF|app-20190625071508-0120|5|4|START| 23.55|A.Points indexed | 0.00| 0|1 2019-06-25 07:15:31,791|MF|app-20190625071508-0120|5|4| END| 23.62|A.Points indexed | 0.07| 18245|1 2019-06-25 07:15:31,792|MF|app-20190625071508-0120|5|4|START| 23.62|B.Pairs found | 0.00| 0|1 2019-06-25 07:15:32,246|MF|app-20190625071508-0120|5|4| END| 24.07|B.Pairs found | 0.46| 34462|1 2019-06-25 07:15:32,246|MF|app-20190625071508-0120|5|4|START| 24.07|C.Centers found | 0.00| 0|1 2019-06-25 07:15:32,634|MF|app-20190625071508-0120|5|4| END| 24.46|C.Centers found | 0.39| 68924|1 2019-06-25 07:15:32,635|MF|app-20190625071508-0120|5|4|START| 24.46|D.Disks found | 0.00| 0|1 2019-06-25 07:15:34,622|MF|app-20190625071508-0120|5|4| END| 26.45|D.Disks found | 1.99| 29116|1 2019-06-25 07:15:34,622|MF|app-20190625071508-0120|5|4|START| 26.45|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:15:35,390|MF|app-20190625071508-0120|5|4| END| 27.22|E.Disks partitioned | 0.77| 41162|1 2019-06-25 07:15:35,391|MF|app-20190625071508-0120|5|4|START| 27.22|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:15:35,391|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:15:35,391|Cell area: 1055533.7681000116 2019-06-25 07:15:44,519|MF|app-20190625071508-0120|5|4| END| 36.34|F.Maximal disks found | 9.13| 8547|1 2019-06-25 07:15:44,519|MAXIMALS|app-20190625071508-0120|4|5|100.0|3|450|12.798|8547 2019-06-25 07:15:44,960|FF|app-20190625071508-0120|5|4| END| 36.79|1.Maximal disks found | 13.24| 8547|1 2019-06-25 07:15:44,960|FF|app-20190625071508-0120|5|4|START| 36.79|2.Join done | 0.00| 0|1 2019-06-25 07:15:47,172|FF|app-20190625071508-0120|5|4| END| 39.00|2.Join done | 2.21| 17137|1 2019-06-25 07:15:47,172|FF|app-20190625071508-0120|5|4|START| 39.00|3.Flocks to report | 0.00| 0|1 2019-06-25 07:15:47,658|FF|app-20190625071508-0120|5|4| END| 39.48|3.Flocks to report | 0.49| 0|1 2019-06-25 07:15:47,658|FF|app-20190625071508-0120|5|4|START| 39.48|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:15:47,697|FF|app-20190625071508-0120|5|4| END| 39.52|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 07:15:47,697|FF|app-20190625071508-0120|5|4|START| 39.52|5.Flocks reported | 0.00| 0|1 2019-06-25 07:15:47,701|FF|app-20190625071508-0120|5|4| END| 39.53|5.Flocks reported | 0.00| 0|1 2019-06-25 07:15:47,701|FF|app-20190625071508-0120|5|4|START| 39.53|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:15:49,288|FF|app-20190625071508-0120|5|4| END| 41.11|6.Candidates indexed | 1.59| 17633|1 2019-06-25 07:15:49,289|FF|app-20190625071508-0120|5|4|START| 41.11|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:15:49,289|MF|app-20190625071508-0120|5|4|START| 41.11|A.Points indexed | 0.00| 0|2 2019-06-25 07:15:49,347|MF|app-20190625071508-0120|5|4| END| 41.17|A.Points indexed | 0.06| 18394|2 2019-06-25 07:15:49,347|MF|app-20190625071508-0120|5|4|START| 41.17|B.Pairs found | 0.00| 0|2 2019-06-25 07:15:49,774|MF|app-20190625071508-0120|5|4| END| 41.60|B.Pairs found | 0.43| 34918|2 2019-06-25 07:15:49,775|MF|app-20190625071508-0120|5|4|START| 41.60|C.Centers found | 0.00| 0|2 2019-06-25 07:15:50,194|MF|app-20190625071508-0120|5|4| END| 42.02|C.Centers found | 0.42| 69836|2 2019-06-25 07:15:50,194|MF|app-20190625071508-0120|5|4|START| 42.02|D.Disks found | 0.00| 0|2 2019-06-25 07:15:52,283|MF|app-20190625071508-0120|5|4| END| 44.11|D.Disks found | 2.09| 29549|2 2019-06-25 07:15:52,283|MF|app-20190625071508-0120|5|4|START| 44.11|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:15:53,023|MF|app-20190625071508-0120|5|4| END| 44.85|E.Disks partitioned | 0.74| 41840|2 2019-06-25 07:15:53,023|MF|app-20190625071508-0120|5|4|START| 44.85|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:15:53,023|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:15:53,023|Cell area: 1055533.7681000116 2019-06-25 07:16:02,785|MF|app-20190625071508-0120|5|4| END| 54.61|F.Maximal disks found | 9.76| 8685|2 2019-06-25 07:16:02,785|MAXIMALS|app-20190625071508-0120|4|5|100.0|3|450|13.496|8685 2019-06-25 07:16:03,206|FF|app-20190625071508-0120|5|4| END| 55.03|1.Maximal disks found | 13.92| 8685|2 2019-06-25 07:16:03,206|FF|app-20190625071508-0120|5|4|START| 55.03|2.Join done | 0.00| 0|2 2019-06-25 07:16:11,609|FF|app-20190625071508-0120|5|4| END| 63.43|2.Join done | 8.40| 32671|2 2019-06-25 07:16:11,609|FF|app-20190625071508-0120|5|4|START| 63.43|3.Flocks to report | 0.00| 0|2 2019-06-25 07:16:12,619|FF|app-20190625071508-0120|5|4| END| 64.44|3.Flocks to report | 1.01| 27872|2 2019-06-25 07:16:12,619|FF|app-20190625071508-0120|5|4|START| 64.44|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:16:12,660|FF|app-20190625071508-0120|5|4|START| 64.49|4a.Making expansions | 0.00| 0|2 2019-06-25 07:16:13,293|FF|app-20190625071508-0120|5|4| END| 65.12|4a.Making expansions | 0.63| 34686|2 2019-06-25 07:16:13,294|FF|app-20190625071508-0120|5|4|START| 65.12|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:16:26,212|FF|app-20190625071508-0120|5|4| END| 78.04|4b.Finding maximals | 12.92| 5697|2 2019-06-25 07:16:26,433|FF|app-20190625071508-0120|5|4| END| 78.26|4.Flocks prunned by expansion | 13.81| 5697|2 2019-06-25 07:16:26,433|FF|app-20190625071508-0120|5|4|START| 78.26|5.Flocks reported | 0.00| 0|2 2019-06-25 07:16:26,719|FF|app-20190625071508-0120|5|4| END| 78.54|5.Flocks reported | 0.29| 5697|2 2019-06-25 07:16:26,719|FF|app-20190625071508-0120|5|4|START| 78.54|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:16:28,549|FF|app-20190625071508-0120|5|4| END| 80.37|6.Candidates indexed | 1.83| 11079|2 2019-06-25 07:16:28,549|FF|app-20190625071508-0120|5|4|START| 80.37|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:16:28,549|MF|app-20190625071508-0120|5|4|START| 80.37|A.Points indexed | 0.00| 0|3 2019-06-25 07:16:28,606|MF|app-20190625071508-0120|5|4| END| 80.43|A.Points indexed | 0.06| 18548|3 2019-06-25 07:16:28,606|MF|app-20190625071508-0120|5|4|START| 80.43|B.Pairs found | 0.00| 0|3 2019-06-25 07:16:29,350|MF|app-20190625071508-0120|5|4| END| 81.18|B.Pairs found | 0.74| 35515|3 2019-06-25 07:16:29,350|MF|app-20190625071508-0120|5|4|START| 81.18|C.Centers found | 0.00| 0|3 2019-06-25 07:16:30,006|MF|app-20190625071508-0120|5|4| END| 81.83|C.Centers found | 0.66| 71030|3 2019-06-25 07:16:30,007|MF|app-20190625071508-0120|5|4|START| 81.83|D.Disks found | 0.00| 0|3 2019-06-25 07:16:33,034|MF|app-20190625071508-0120|5|4| END| 84.86|D.Disks found | 3.03| 30142|3 2019-06-25 07:16:33,034|MF|app-20190625071508-0120|5|4|START| 84.86|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:16:34,028|MF|app-20190625071508-0120|5|4| END| 85.85|E.Disks partitioned | 0.99| 42665|3 2019-06-25 07:16:34,028|MF|app-20190625071508-0120|5|4|START| 85.85|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:16:34,028|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:16:34,029|Cell area: 1055533.7681000116 2019-06-25 07:16:45,768|MF|app-20190625071508-0120|5|4| END| 97.59|F.Maximal disks found | 11.74| 8846|3 2019-06-25 07:16:45,768|MAXIMALS|app-20190625071508-0120|4|5|100.0|3|450|17.219|8846 2019-06-25 07:16:46,216|FF|app-20190625071508-0120|5|4| END| 98.04|1.Maximal disks found | 17.67| 8846|3 2019-06-25 07:16:46,216|FF|app-20190625071508-0120|5|4|START| 98.04|2.Join done | 0.00| 0|3 2019-06-25 07:16:52,908|FF|app-20190625071508-0120|5|4| END|104.73|2.Join done | 6.69| 30190|3 2019-06-25 07:16:52,908|FF|app-20190625071508-0120|5|4|START|104.73|3.Flocks to report | 0.00| 0|3 2019-06-25 07:16:54,532|FF|app-20190625071508-0120|5|4| END|106.36|3.Flocks to report | 1.62| 25328|3 2019-06-25 07:16:54,532|FF|app-20190625071508-0120|5|4|START|106.36|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:16:54,593|FF|app-20190625071508-0120|5|4|START|106.42|4a.Making expansions | 0.00| 0|3 2019-06-25 07:16:55,721|FF|app-20190625071508-0120|5|4| END|107.55|4a.Making expansions | 1.13| 32302|3 2019-06-25 07:16:55,721|FF|app-20190625071508-0120|5|4|START|107.55|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:17:06,989|FF|app-20190625071508-0120|5|4| END|118.81|4b.Finding maximals | 11.27| 5767|3 2019-06-25 07:17:07,305|FF|app-20190625071508-0120|5|4| END|119.13|4.Flocks prunned by expansion | 12.77| 5767|3 2019-06-25 07:17:07,306|FF|app-20190625071508-0120|5|4|START|119.13|5.Flocks reported | 0.00| 0|3 2019-06-25 07:17:07,786|FF|app-20190625071508-0120|5|4| END|119.61|5.Flocks reported | 0.48| 5767|3 2019-06-25 07:17:07,786|FF|app-20190625071508-0120|5|4|START|119.61|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:17:09,964|FF|app-20190625071508-0120|5|4| END|121.79|6.Candidates indexed | 2.18| 11171|3 2019-06-25 07:17:10,591|Number of flocks: 11464 2019-06-25 07:17:10,984|PFLOCK|app-20190625071508-0120|4|5|100.0|3|3|116.79|11464 2019-06-25 07:17:11,400|FF|app-20190625071508-0120|5|4| END|123.23|Flock Finder run |117.59| 11464|3 2019-06-25 07:17:11,400|FF|app-20190625071508-0120|5|4|START|123.23|Session closed | 0.00| 0|3 2019-06-25 07:17:18,290|FF|app-20190625071508-0120|5|4| END|130.12|Session closed | 6.89| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:17:20,224|FF|app-00000000000000-0000|15|4|START| 0.13|Session start | 0.00| 0|-1 2019-06-25 07:17:21,343|FF|app-20190625071721-0121|15|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 07:17:21,343|FF|app-20190625071721-0121|15|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 07:17:25,500|FF|app-20190625071721-0121|15|4| END| 5.26|Data read | 4.16|331128|-1 2019-06-25 07:17:25,501|FF|app-20190625071721-0121|15|4|START| 5.26|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:17:25,828|FF|app-20190625071721-0121|15|4| END| 5.59|KDBTree partitioner | 0.33| 816|-1 2019-06-25 07:17:25,829|FF|app-20190625071721-0121|15|4|START| 5.59|MF partitioner | 0.00| 0|-1 2019-06-25 07:17:25,849|FF|app-20190625071721-0121|15|4| END| 5.61|MF partitioner | 0.02| 1350|-1 2019-06-25 07:17:25,850|FF|app-20190625071721-0121|15|4|START| 5.61|Pointset done | 0.00| 0|-1 2019-06-25 07:17:26,961|FF|app-20190625071721-0121|15|4| END| 6.72|Pointset done | 1.11| 4|-1 2019-06-25 07:17:26,961|FF|app-20190625071721-0121|15|4|START| 6.72|Flock Finder run | 0.00| 0|-1 2019-06-25 07:17:26,982|FF|app-20190625071721-0121|15|4|START| 6.74|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:17:26,984|MF|app-20190625071721-0121|15|4|START| 6.74|A.Points indexed | 0.00| 0|0 2019-06-25 07:17:27,196|MF|app-20190625071721-0121|15|4| END| 6.96|A.Points indexed | 0.21| 54279|0 2019-06-25 07:17:27,196|MF|app-20190625071721-0121|15|4|START| 6.96|B.Pairs found | 0.00| 0|0 2019-06-25 07:17:29,161|MF|app-20190625071721-0121|15|4| END| 8.92|B.Pairs found | 1.97|118212|0 2019-06-25 07:17:29,161|MF|app-20190625071721-0121|15|4|START| 8.92|C.Centers found | 0.00| 0|0 2019-06-25 07:17:31,064|MF|app-20190625071721-0121|15|4| END| 10.82|C.Centers found | 1.90|236424|0 2019-06-25 07:17:31,064|MF|app-20190625071721-0121|15|4|START| 10.82|D.Disks found | 0.00| 0|0 2019-06-25 07:17:40,091|MF|app-20190625071721-0121|15|4| END| 19.85|D.Disks found | 9.03|105687|0 2019-06-25 07:17:40,091|MF|app-20190625071721-0121|15|4|START| 19.85|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:17:43,282|MF|app-20190625071721-0121|15|4| END| 23.04|E.Disks partitioned | 3.19|154597|0 2019-06-25 07:17:43,283|MF|app-20190625071721-0121|15|4|START| 23.04|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:17:43,286|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:17:43,286|Cell area: 1055533.7681000116 2019-06-25 07:18:08,824|MF|app-20190625071721-0121|15|4| END| 48.58|F.Maximal disks found | 25.54| 30002|0 2019-06-25 07:18:08,824|MAXIMALS|app-20190625071721-0121|4|15|110.0|3|1350|41.84|30002 2019-06-25 07:18:09,884|FF|app-20190625071721-0121|15|4| END| 49.64|1.Maximal disks found | 42.90| 30002|0 2019-06-25 07:18:09,884|FF|app-20190625071721-0121|15|4|START| 49.64|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:18:09,884|MF|app-20190625071721-0121|15|4|START| 49.64|A.Points indexed | 0.00| 0|1 2019-06-25 07:18:10,008|MF|app-20190625071721-0121|15|4| END| 49.77|A.Points indexed | 0.12| 54735|1 2019-06-25 07:18:10,008|MF|app-20190625071721-0121|15|4|START| 49.77|B.Pairs found | 0.00| 0|1 2019-06-25 07:18:11,099|MF|app-20190625071721-0121|15|4| END| 50.86|B.Pairs found | 1.09|119997|1 2019-06-25 07:18:11,100|MF|app-20190625071721-0121|15|4|START| 50.86|C.Centers found | 0.00| 0|1 2019-06-25 07:18:12,807|MF|app-20190625071721-0121|15|4| END| 52.57|C.Centers found | 1.71|239994|1 2019-06-25 07:18:12,807|MF|app-20190625071721-0121|15|4|START| 52.57|D.Disks found | 0.00| 0|1 2019-06-25 07:18:21,127|MF|app-20190625071721-0121|15|4| END| 60.89|D.Disks found | 8.32|107547|1 2019-06-25 07:18:21,128|MF|app-20190625071721-0121|15|4|START| 60.89|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:18:24,139|MF|app-20190625071721-0121|15|4| END| 63.90|E.Disks partitioned | 3.01|157199|1 2019-06-25 07:18:24,139|MF|app-20190625071721-0121|15|4|START| 63.90|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:18:24,141|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:18:24,141|Cell area: 1055533.7681000116 2019-06-25 07:18:49,956|MF|app-20190625071721-0121|15|4| END| 89.72|F.Maximal disks found | 25.82| 30329|1 2019-06-25 07:18:49,957|MAXIMALS|app-20190625071721-0121|4|15|110.0|3|1350|40.073|30329 2019-06-25 07:18:50,980|FF|app-20190625071721-0121|15|4| END| 90.74|1.Maximal disks found | 41.10| 30329|1 2019-06-25 07:18:50,980|FF|app-20190625071721-0121|15|4|START| 90.74|2.Join done | 0.00| 0|1 2019-06-25 07:18:54,380|FF|app-20190625071721-0121|15|4| END| 94.14|2.Join done | 3.40| 65661|1 2019-06-25 07:18:54,380|FF|app-20190625071721-0121|15|4|START| 94.14|3.Flocks to report | 0.00| 0|1 2019-06-25 07:18:54,973|FF|app-20190625071721-0121|15|4| END| 94.73|3.Flocks to report | 0.59| 0|1 2019-06-25 07:18:54,973|FF|app-20190625071721-0121|15|4|START| 94.73|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:18:55,044|FF|app-20190625071721-0121|15|4| END| 94.80|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 07:18:55,044|FF|app-20190625071721-0121|15|4|START| 94.80|5.Flocks reported | 0.00| 0|1 2019-06-25 07:18:55,049|FF|app-20190625071721-0121|15|4| END| 94.81|5.Flocks reported | 0.01| 0|1 2019-06-25 07:18:55,049|FF|app-20190625071721-0121|15|4|START| 94.81|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:18:56,852|FF|app-20190625071721-0121|15|4| END| 96.61|6.Candidates indexed | 1.80| 67476|1 2019-06-25 07:18:56,852|FF|app-20190625071721-0121|15|4|START| 96.61|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:18:56,852|MF|app-20190625071721-0121|15|4|START| 96.61|A.Points indexed | 0.00| 0|2 2019-06-25 07:18:56,971|MF|app-20190625071721-0121|15|4| END| 96.73|A.Points indexed | 0.12| 55182|2 2019-06-25 07:18:56,971|MF|app-20190625071721-0121|15|4|START| 96.73|B.Pairs found | 0.00| 0|2 2019-06-25 07:18:57,811|MF|app-20190625071721-0121|15|4| END| 97.57|B.Pairs found | 0.84|121698|2 2019-06-25 07:18:57,811|MF|app-20190625071721-0121|15|4|START| 97.57|C.Centers found | 0.00| 0|2 2019-06-25 07:18:59,577|MF|app-20190625071721-0121|15|4| END| 99.34|C.Centers found | 1.77|243396|2 2019-06-25 07:18:59,577|MF|app-20190625071721-0121|15|4|START| 99.34|D.Disks found | 0.00| 0|2 2019-06-25 07:19:03,355|MF|app-20190625071721-0121|15|4| END|103.11|D.Disks found | 3.78|109059|2 2019-06-25 07:19:03,356|MF|app-20190625071721-0121|15|4|START|103.12|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:19:04,448|MF|app-20190625071721-0121|15|4| END|104.21|E.Disks partitioned | 1.09|159559|2 2019-06-25 07:19:04,448|MF|app-20190625071721-0121|15|4|START|104.21|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:19:04,449|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:19:04,449|Cell area: 1055533.7681000116 2019-06-25 07:19:30,604|MF|app-20190625071721-0121|15|4| END|130.36|F.Maximal disks found | 26.16| 31016|2 2019-06-25 07:19:30,605|MAXIMALS|app-20190625071721-0121|4|15|110.0|3|1350|33.753|31016 2019-06-25 07:19:31,656|FF|app-20190625071721-0121|15|4| END|131.42|1.Maximal disks found | 34.80| 31016|2 2019-06-25 07:19:31,657|FF|app-20190625071721-0121|15|4|START|131.42|2.Join done | 0.00| 0|2 2019-06-25 07:19:55,545|FF|app-20190625071721-0121|15|4| END|155.30|2.Join done | 23.89|134462|2 2019-06-25 07:19:55,545|FF|app-20190625071721-0121|15|4|START|155.30|3.Flocks to report | 0.00| 0|2 2019-06-25 07:19:59,451|FF|app-20190625071721-0121|15|4| END|159.21|3.Flocks to report | 3.91|114833|2 2019-06-25 07:19:59,451|FF|app-20190625071721-0121|15|4|START|159.21|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:19:59,542|FF|app-20190625071721-0121|15|4|START|159.30|4a.Making expansions | 0.00| 0|2 2019-06-25 07:20:00,981|FF|app-20190625071721-0121|15|4| END|160.74|4a.Making expansions | 1.44|143292|2 2019-06-25 07:20:00,981|FF|app-20190625071721-0121|15|4|START|160.74|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:20:48,726|FF|app-20190625071721-0121|15|4| END|208.49|4b.Finding maximals | 47.75| 19803|2 2019-06-25 07:20:49,181|FF|app-20190625071721-0121|15|4| END|208.94|4.Flocks prunned by expansion | 49.73| 19803|2 2019-06-25 07:20:49,181|FF|app-20190625071721-0121|15|4|START|208.94|5.Flocks reported | 0.00| 0|2 2019-06-25 07:20:49,769|FF|app-20190625071721-0121|15|4| END|209.53|5.Flocks reported | 0.59| 19803|2 2019-06-25 07:20:49,769|FF|app-20190625071721-0121|15|4|START|209.53|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:20:52,074|FF|app-20190625071721-0121|15|4| END|211.83|6.Candidates indexed | 2.31| 41368|2 2019-06-25 07:20:52,074|FF|app-20190625071721-0121|15|4|START|211.83|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:20:52,075|MF|app-20190625071721-0121|15|4|START|211.83|A.Points indexed | 0.00| 0|3 2019-06-25 07:20:52,190|MF|app-20190625071721-0121|15|4| END|211.95|A.Points indexed | 0.12| 55644|3 2019-06-25 07:20:52,190|MF|app-20190625071721-0121|15|4|START|211.95|B.Pairs found | 0.00| 0|3 2019-06-25 07:20:53,036|MF|app-20190625071721-0121|15|4| END|212.79|B.Pairs found | 0.85|123771|3 2019-06-25 07:20:53,036|MF|app-20190625071721-0121|15|4|START|212.80|C.Centers found | 0.00| 0|3 2019-06-25 07:20:53,927|MF|app-20190625071721-0121|15|4| END|213.69|C.Centers found | 0.89|247542|3 2019-06-25 07:20:53,927|MF|app-20190625071721-0121|15|4|START|213.69|D.Disks found | 0.00| 0|3 2019-06-25 07:20:59,535|MF|app-20190625071721-0121|15|4| END|219.29|D.Disks found | 5.61|111261|3 2019-06-25 07:20:59,535|MF|app-20190625071721-0121|15|4|START|219.29|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:21:02,646|MF|app-20190625071721-0121|15|4| END|222.41|E.Disks partitioned | 3.11|162756|3 2019-06-25 07:21:02,647|MF|app-20190625071721-0121|15|4|START|222.41|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:21:02,647|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:21:02,647|Cell area: 1055533.7681000116 2019-06-25 07:21:36,271|MF|app-20190625071721-0121|15|4| END|256.03|F.Maximal disks found | 33.63| 31512|3 2019-06-25 07:21:36,271|MAXIMALS|app-20190625071721-0121|4|15|110.0|3|1350|44.196|31512 2019-06-25 07:21:37,324|FF|app-20190625071721-0121|15|4| END|257.08|1.Maximal disks found | 45.25| 31512|3 2019-06-25 07:21:37,324|FF|app-20190625071721-0121|15|4|START|257.08|2.Join done | 0.00| 0|3 2019-06-25 07:21:49,469|FF|app-20190625071721-0121|15|4| END|269.23|2.Join done | 12.15|134798|3 2019-06-25 07:21:49,469|FF|app-20190625071721-0121|15|4|START|269.23|3.Flocks to report | 0.00| 0|3 2019-06-25 07:21:52,073|FF|app-20190625071721-0121|15|4| END|271.83|3.Flocks to report | 2.60|115131|3 2019-06-25 07:21:52,073|FF|app-20190625071721-0121|15|4|START|271.83|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:21:52,157|FF|app-20190625071721-0121|15|4|START|271.92|4a.Making expansions | 0.00| 0|3 2019-06-25 07:21:53,345|FF|app-20190625071721-0121|15|4| END|273.10|4a.Making expansions | 1.19|143339|3 2019-06-25 07:21:53,346|FF|app-20190625071721-0121|15|4|START|273.11|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:23:01,898|FF|app-20190625071721-0121|15|4| END|341.66|4b.Finding maximals | 68.55| 20007|3 2019-06-25 07:23:02,367|FF|app-20190625071721-0121|15|4| END|342.13|4.Flocks prunned by expansion | 70.29| 20007|3 2019-06-25 07:23:02,367|FF|app-20190625071721-0121|15|4|START|342.13|5.Flocks reported | 0.00| 0|3 2019-06-25 07:23:02,996|FF|app-20190625071721-0121|15|4| END|342.76|5.Flocks reported | 0.63| 20007|3 2019-06-25 07:23:02,996|FF|app-20190625071721-0121|15|4|START|342.76|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:23:05,199|FF|app-20190625071721-0121|15|4| END|344.96|6.Candidates indexed | 2.20| 41642|3 2019-06-25 07:23:06,549|Number of flocks: 39810 2019-06-25 07:23:07,478|PFLOCK|app-20190625071721-0121|4|15|110.0|3|3|339.59|39810 2019-06-25 07:23:08,415|FF|app-20190625071721-0121|15|4| END|348.17|Flock Finder run |341.45| 39810|3 2019-06-25 07:23:08,415|FF|app-20190625071721-0121|15|4|START|348.17|Session closed | 0.00| 0|3 2019-06-25 07:23:15,796|FF|app-20190625071721-0121|15|4| END|355.56|Session closed | 7.38| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:23:17,767|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:23:18,894|FF|app-20190625072318-0122|10|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 07:23:18,894|FF|app-20190625072318-0122|10|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 07:23:23,048|FF|app-20190625072318-0122|10|4| END| 5.26|Data read | 4.15|220752|-1 2019-06-25 07:23:23,048|FF|app-20190625072318-0122|10|4|START| 5.26|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:23:23,189|FF|app-20190625072318-0122|10|4| END| 5.41|KDBTree partitioner | 0.14| 544|-1 2019-06-25 07:23:23,189|FF|app-20190625072318-0122|10|4|START| 5.41|MF partitioner | 0.00| 0|-1 2019-06-25 07:23:23,206|FF|app-20190625072318-0122|10|4| END| 5.42|MF partitioner | 0.02| 900|-1 2019-06-25 07:23:23,206|FF|app-20190625072318-0122|10|4|START| 5.42|Pointset done | 0.00| 0|-1 2019-06-25 07:23:24,257|FF|app-20190625072318-0122|10|4| END| 6.47|Pointset done | 1.05| 4|-1 2019-06-25 07:23:24,257|FF|app-20190625072318-0122|10|4|START| 6.47|Flock Finder run | 0.00| 0|-1 2019-06-25 07:23:24,276|FF|app-20190625072318-0122|10|4|START| 6.49|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:23:24,279|MF|app-20190625072318-0122|10|4|START| 6.50|A.Points indexed | 0.00| 0|0 2019-06-25 07:23:24,453|MF|app-20190625072318-0122|10|4| END| 6.67|A.Points indexed | 0.17| 36186|0 2019-06-25 07:23:24,454|MF|app-20190625072318-0122|10|4|START| 6.67|B.Pairs found | 0.00| 0|0 2019-06-25 07:23:26,814|MF|app-20190625072318-0122|10|4| END| 9.03|B.Pairs found | 2.36| 78808|0 2019-06-25 07:23:26,814|MF|app-20190625072318-0122|10|4|START| 9.03|C.Centers found | 0.00| 0|0 2019-06-25 07:23:28,487|MF|app-20190625072318-0122|10|4| END| 10.70|C.Centers found | 1.67|157616|0 2019-06-25 07:23:28,488|MF|app-20190625072318-0122|10|4|START| 10.70|D.Disks found | 0.00| 0|0 2019-06-25 07:23:37,211|MF|app-20190625072318-0122|10|4| END| 19.43|D.Disks found | 8.72| 70458|0 2019-06-25 07:23:37,212|MF|app-20190625072318-0122|10|4|START| 19.43|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:23:41,599|MF|app-20190625072318-0122|10|4| END| 23.82|E.Disks partitioned | 4.39|103004|0 2019-06-25 07:23:41,600|MF|app-20190625072318-0122|10|4|START| 23.82|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:23:41,602|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:23:41,602|Cell area: 1055533.7681000116 2019-06-25 07:24:10,841|MF|app-20190625072318-0122|10|4| END| 53.06|F.Maximal disks found | 29.24| 20001|0 2019-06-25 07:24:10,841|MAXIMALS|app-20190625072318-0122|4|10|110.0|3|900|46.562|20001 2019-06-25 07:24:12,508|FF|app-20190625072318-0122|10|4| END| 54.72|1.Maximal disks found | 48.23| 20001|0 2019-06-25 07:24:12,508|FF|app-20190625072318-0122|10|4|START| 54.72|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:24:12,508|MF|app-20190625072318-0122|10|4|START| 54.72|A.Points indexed | 0.00| 0|1 2019-06-25 07:24:12,605|MF|app-20190625072318-0122|10|4| END| 54.82|A.Points indexed | 0.10| 36490|1 2019-06-25 07:24:12,605|MF|app-20190625072318-0122|10|4|START| 54.82|B.Pairs found | 0.00| 0|1 2019-06-25 07:24:13,736|MF|app-20190625072318-0122|10|4| END| 55.95|B.Pairs found | 1.13| 79998|1 2019-06-25 07:24:13,736|MF|app-20190625072318-0122|10|4|START| 55.95|C.Centers found | 0.00| 0|1 2019-06-25 07:24:15,011|MF|app-20190625072318-0122|10|4| END| 57.23|C.Centers found | 1.28|159996|1 2019-06-25 07:24:15,011|MF|app-20190625072318-0122|10|4|START| 57.23|D.Disks found | 0.00| 0|1 2019-06-25 07:24:20,657|MF|app-20190625072318-0122|10|4| END| 62.87|D.Disks found | 5.65| 71698|1 2019-06-25 07:24:20,657|MF|app-20190625072318-0122|10|4|START| 62.87|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:24:23,205|MF|app-20190625072318-0122|10|4| END| 65.42|E.Disks partitioned | 2.55|104758|1 2019-06-25 07:24:23,205|MF|app-20190625072318-0122|10|4|START| 65.42|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:24:23,206|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:24:23,206|Cell area: 1055533.7681000116 2019-06-25 07:24:49,538|MF|app-20190625072318-0122|10|4| END| 91.75|F.Maximal disks found | 26.33| 20222|1 2019-06-25 07:24:49,539|MAXIMALS|app-20190625072318-0122|4|10|110.0|3|900|37.031|20222 2019-06-25 07:24:50,573|FF|app-20190625072318-0122|10|4| END| 92.79|1.Maximal disks found | 38.07| 20222|1 2019-06-25 07:24:50,573|FF|app-20190625072318-0122|10|4|START| 92.79|2.Join done | 0.00| 0|1 2019-06-25 07:24:56,824|FF|app-20190625072318-0122|10|4| END| 99.04|2.Join done | 6.25| 43837|1 2019-06-25 07:24:56,824|FF|app-20190625072318-0122|10|4|START| 99.04|3.Flocks to report | 0.00| 0|1 2019-06-25 07:24:58,049|FF|app-20190625072318-0122|10|4| END|100.27|3.Flocks to report | 1.23| 0|1 2019-06-25 07:24:58,050|FF|app-20190625072318-0122|10|4|START|100.27|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:24:58,110|FF|app-20190625072318-0122|10|4| END|100.33|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 07:24:58,110|FF|app-20190625072318-0122|10|4|START|100.33|5.Flocks reported | 0.00| 0|1 2019-06-25 07:24:58,116|FF|app-20190625072318-0122|10|4| END|100.33|5.Flocks reported | 0.01| 0|1 2019-06-25 07:24:58,117|FF|app-20190625072318-0122|10|4|START|100.33|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:25:00,678|FF|app-20190625072318-0122|10|4| END|102.89|6.Candidates indexed | 2.56| 45047|1 2019-06-25 07:25:00,678|FF|app-20190625072318-0122|10|4|START|102.89|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:25:00,678|MF|app-20190625072318-0122|10|4|START|102.89|A.Points indexed | 0.00| 0|2 2019-06-25 07:25:00,793|MF|app-20190625072318-0122|10|4| END|103.01|A.Points indexed | 0.12| 36788|2 2019-06-25 07:25:00,793|MF|app-20190625072318-0122|10|4|START|103.01|B.Pairs found | 0.00| 0|2 2019-06-25 07:25:01,561|MF|app-20190625072318-0122|10|4| END|103.78|B.Pairs found | 0.77| 81132|2 2019-06-25 07:25:01,561|MF|app-20190625072318-0122|10|4|START|103.78|C.Centers found | 0.00| 0|2 2019-06-25 07:25:02,998|MF|app-20190625072318-0122|10|4| END|105.21|C.Centers found | 1.44|162264|2 2019-06-25 07:25:02,998|MF|app-20190625072318-0122|10|4|START|105.21|D.Disks found | 0.00| 0|2 2019-06-25 07:25:07,608|MF|app-20190625072318-0122|10|4| END|109.82|D.Disks found | 4.61| 72706|2 2019-06-25 07:25:07,608|MF|app-20190625072318-0122|10|4|START|109.82|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:25:10,069|MF|app-20190625072318-0122|10|4| END|112.29|E.Disks partitioned | 2.46|106347|2 2019-06-25 07:25:10,069|MF|app-20190625072318-0122|10|4|START|112.29|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:25:10,069|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:25:10,070|Cell area: 1055533.7681000116 2019-06-25 07:25:36,995|MF|app-20190625072318-0122|10|4| END|139.21|F.Maximal disks found | 26.93| 20682|2 2019-06-25 07:25:36,995|MAXIMALS|app-20190625072318-0122|4|10|110.0|3|900|36.317|20682 2019-06-25 07:25:38,004|FF|app-20190625072318-0122|10|4| END|140.22|1.Maximal disks found | 37.33| 20682|2 2019-06-25 07:25:38,005|FF|app-20190625072318-0122|10|4|START|140.22|2.Join done | 0.00| 0|2 2019-06-25 07:25:58,660|FF|app-20190625072318-0122|10|4| END|160.88|2.Join done | 20.66| 89740|2 2019-06-25 07:25:58,660|FF|app-20190625072318-0122|10|4|START|160.88|3.Flocks to report | 0.00| 0|2 2019-06-25 07:26:01,035|FF|app-20190625072318-0122|10|4| END|163.25|3.Flocks to report | 2.38| 76643|2 2019-06-25 07:26:01,036|FF|app-20190625072318-0122|10|4|START|163.25|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:26:01,098|FF|app-20190625072318-0122|10|4|START|163.31|4a.Making expansions | 0.00| 0|2 2019-06-25 07:26:02,465|FF|app-20190625072318-0122|10|4| END|164.68|4a.Making expansions | 1.37| 95535|2 2019-06-25 07:26:02,465|FF|app-20190625072318-0122|10|4|START|164.68|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:26:47,987|FF|app-20190625072318-0122|10|4| END|210.20|4b.Finding maximals | 45.52| 13202|2 2019-06-25 07:26:48,415|FF|app-20190625072318-0122|10|4| END|210.63|4.Flocks prunned by expansion | 47.38| 13202|2 2019-06-25 07:26:48,415|FF|app-20190625072318-0122|10|4|START|210.63|5.Flocks reported | 0.00| 0|2 2019-06-25 07:26:49,040|FF|app-20190625072318-0122|10|4| END|211.26|5.Flocks reported | 0.63| 13202|2 2019-06-25 07:26:49,040|FF|app-20190625072318-0122|10|4|START|211.26|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:26:51,673|FF|app-20190625072318-0122|10|4| END|213.89|6.Candidates indexed | 2.63| 27595|2 2019-06-25 07:26:51,673|FF|app-20190625072318-0122|10|4|START|213.89|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:26:51,673|MF|app-20190625072318-0122|10|4|START|213.89|A.Points indexed | 0.00| 0|3 2019-06-25 07:26:51,762|MF|app-20190625072318-0122|10|4| END|213.98|A.Points indexed | 0.09| 37096|3 2019-06-25 07:26:51,762|MF|app-20190625072318-0122|10|4|START|213.98|B.Pairs found | 0.00| 0|3 2019-06-25 07:26:52,491|MF|app-20190625072318-0122|10|4| END|214.71|B.Pairs found | 0.73| 82514|3 2019-06-25 07:26:52,492|MF|app-20190625072318-0122|10|4|START|214.71|C.Centers found | 0.00| 0|3 2019-06-25 07:26:53,730|MF|app-20190625072318-0122|10|4| END|215.95|C.Centers found | 1.24|165028|3 2019-06-25 07:26:53,730|MF|app-20190625072318-0122|10|4|START|215.95|D.Disks found | 0.00| 0|3 2019-06-25 07:26:59,519|MF|app-20190625072318-0122|10|4| END|221.74|D.Disks found | 5.79| 74174|3 2019-06-25 07:26:59,519|MF|app-20190625072318-0122|10|4|START|221.74|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:27:03,961|MF|app-20190625072318-0122|10|4| END|226.18|E.Disks partitioned | 4.44|108468|3 2019-06-25 07:27:03,962|MF|app-20190625072318-0122|10|4|START|226.18|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:27:03,962|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:27:03,962|Cell area: 1055533.7681000116 2019-06-25 07:27:41,245|MF|app-20190625072318-0122|10|4| END|263.46|F.Maximal disks found | 37.28| 21009|3 2019-06-25 07:27:41,245|MAXIMALS|app-20190625072318-0122|4|10|110.0|3|900|49.572|21009 2019-06-25 07:27:42,709|FF|app-20190625072318-0122|10|4| END|264.93|1.Maximal disks found | 51.04| 21009|3 2019-06-25 07:27:42,709|FF|app-20190625072318-0122|10|4|START|264.93|2.Join done | 0.00| 0|3 2019-06-25 07:28:04,224|FF|app-20190625072318-0122|10|4| END|286.44|2.Join done | 21.52| 90003|3 2019-06-25 07:28:04,225|FF|app-20190625072318-0122|10|4|START|286.44|3.Flocks to report | 0.00| 0|3 2019-06-25 07:28:08,639|FF|app-20190625072318-0122|10|4| END|290.86|3.Flocks to report | 4.41| 76861|3 2019-06-25 07:28:08,639|FF|app-20190625072318-0122|10|4|START|290.86|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:28:08,743|FF|app-20190625072318-0122|10|4|START|290.96|4a.Making expansions | 0.00| 0|3 2019-06-25 07:28:11,143|FF|app-20190625072318-0122|10|4| END|293.36|4a.Making expansions | 2.40| 95919|3 2019-06-25 07:28:11,143|FF|app-20190625072318-0122|10|4|START|293.36|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:29:14,070|FF|app-20190625072318-0122|10|4| END|356.29|4b.Finding maximals | 62.93| 13338|3 2019-06-25 07:29:14,701|FF|app-20190625072318-0122|10|4| END|356.92|4.Flocks prunned by expansion | 66.06| 13338|3 2019-06-25 07:29:14,701|FF|app-20190625072318-0122|10|4|START|356.92|5.Flocks reported | 0.00| 0|3 2019-06-25 07:29:15,745|FF|app-20190625072318-0122|10|4| END|357.96|5.Flocks reported | 1.04| 13338|3 2019-06-25 07:29:15,745|FF|app-20190625072318-0122|10|4|START|357.96|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:29:20,075|FF|app-20190625072318-0122|10|4| END|362.29|6.Candidates indexed | 4.33| 27789|3 2019-06-25 07:29:21,933|Number of flocks: 26540 2019-06-25 07:29:23,070|PFLOCK|app-20190625072318-0122|4|10|110.0|3|3|357.68|26540 2019-06-25 07:29:24,170|FF|app-20190625072318-0122|10|4| END|366.39|Flock Finder run |359.91| 26540|3 2019-06-25 07:29:24,170|FF|app-20190625072318-0122|10|4|START|366.39|Session closed | 0.00| 0|3 2019-06-25 07:29:30,989|FF|app-20190625072318-0122|10|4| END|373.21|Session closed | 6.82| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:29:32,911|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:29:34,026|FF|app-20190625072933-0123|5|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 07:29:34,026|FF|app-20190625072933-0123|5|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 07:29:37,749|FF|app-20190625072933-0123|5|4| END| 4.82|Data read | 3.72|110376|-1 2019-06-25 07:29:37,749|FF|app-20190625072933-0123|5|4|START| 4.82|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:29:37,854|FF|app-20190625072933-0123|5|4| END| 4.93|KDBTree partitioner | 0.11| 272|-1 2019-06-25 07:29:37,854|FF|app-20190625072933-0123|5|4|START| 4.93|MF partitioner | 0.00| 0|-1 2019-06-25 07:29:37,863|FF|app-20190625072933-0123|5|4| END| 4.94|MF partitioner | 0.01| 450|-1 2019-06-25 07:29:37,863|FF|app-20190625072933-0123|5|4|START| 4.94|Pointset done | 0.00| 0|-1 2019-06-25 07:29:38,756|FF|app-20190625072933-0123|5|4| END| 5.83|Pointset done | 0.89| 4|-1 2019-06-25 07:29:38,756|FF|app-20190625072933-0123|5|4|START| 5.83|Flock Finder run | 0.00| 0|-1 2019-06-25 07:29:38,777|FF|app-20190625072933-0123|5|4|START| 5.85|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:29:38,779|MF|app-20190625072933-0123|5|4|START| 5.85|A.Points indexed | 0.00| 0|0 2019-06-25 07:29:39,116|MF|app-20190625072933-0123|5|4| END| 6.19|A.Points indexed | 0.34| 18093|0 2019-06-25 07:29:39,117|MF|app-20190625072933-0123|5|4|START| 6.19|B.Pairs found | 0.00| 0|0 2019-06-25 07:29:40,433|MF|app-20190625072933-0123|5|4| END| 7.51|B.Pairs found | 1.32| 39404|0 2019-06-25 07:29:40,433|MF|app-20190625072933-0123|5|4|START| 7.51|C.Centers found | 0.00| 0|0 2019-06-25 07:29:41,204|MF|app-20190625072933-0123|5|4| END| 8.28|C.Centers found | 0.77| 78808|0 2019-06-25 07:29:41,204|MF|app-20190625072933-0123|5|4|START| 8.28|D.Disks found | 0.00| 0|0 2019-06-25 07:29:44,312|MF|app-20190625072933-0123|5|4| END| 11.39|D.Disks found | 3.11| 35229|0 2019-06-25 07:29:44,312|MF|app-20190625072933-0123|5|4|START| 11.39|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:29:45,494|MF|app-20190625072933-0123|5|4| END| 12.57|E.Disks partitioned | 1.18| 51442|0 2019-06-25 07:29:45,494|MF|app-20190625072933-0123|5|4|START| 12.57|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:29:45,496|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:29:45,496|Cell area: 1055533.7681000116 2019-06-25 07:30:10,484|MF|app-20190625072933-0123|5|4| END| 37.56|F.Maximal disks found | 24.99| 10001|0 2019-06-25 07:30:10,484|MAXIMALS|app-20190625072933-0123|4|5|110.0|3|450|31.705|10001 2019-06-25 07:30:10,973|FF|app-20190625072933-0123|5|4| END| 38.05|1.Maximal disks found | 32.20| 10001|0 2019-06-25 07:30:10,974|FF|app-20190625072933-0123|5|4|START| 38.05|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:30:10,974|MF|app-20190625072933-0123|5|4|START| 38.05|A.Points indexed | 0.00| 0|1 2019-06-25 07:30:11,046|MF|app-20190625072933-0123|5|4| END| 38.12|A.Points indexed | 0.07| 18245|1 2019-06-25 07:30:11,046|MF|app-20190625072933-0123|5|4|START| 38.12|B.Pairs found | 0.00| 0|1 2019-06-25 07:30:11,450|MF|app-20190625072933-0123|5|4| END| 38.52|B.Pairs found | 0.40| 39999|1 2019-06-25 07:30:11,450|MF|app-20190625072933-0123|5|4|START| 38.52|C.Centers found | 0.00| 0|1 2019-06-25 07:30:11,861|MF|app-20190625072933-0123|5|4| END| 38.93|C.Centers found | 0.41| 79998|1 2019-06-25 07:30:11,861|MF|app-20190625072933-0123|5|4|START| 38.93|D.Disks found | 0.00| 0|1 2019-06-25 07:30:14,018|MF|app-20190625072933-0123|5|4| END| 41.09|D.Disks found | 2.16| 35849|1 2019-06-25 07:30:14,019|MF|app-20190625072933-0123|5|4|START| 41.09|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:30:14,956|MF|app-20190625072933-0123|5|4| END| 42.03|E.Disks partitioned | 0.94| 52317|1 2019-06-25 07:30:14,956|MF|app-20190625072933-0123|5|4|START| 42.03|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:30:14,957|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:30:14,957|Cell area: 1055533.7681000116 2019-06-25 07:30:40,067|MF|app-20190625072933-0123|5|4| END| 67.14|F.Maximal disks found | 25.11| 10110|1 2019-06-25 07:30:40,067|MAXIMALS|app-20190625072933-0123|4|5|110.0|3|450|29.093|10110 2019-06-25 07:30:40,554|FF|app-20190625072933-0123|5|4| END| 67.63|1.Maximal disks found | 29.58| 10110|1 2019-06-25 07:30:40,554|FF|app-20190625072933-0123|5|4|START| 67.63|2.Join done | 0.00| 0|1 2019-06-25 07:30:43,041|FF|app-20190625072933-0123|5|4| END| 70.11|2.Join done | 2.49| 21993|1 2019-06-25 07:30:43,041|FF|app-20190625072933-0123|5|4|START| 70.11|3.Flocks to report | 0.00| 0|1 2019-06-25 07:30:43,676|FF|app-20190625072933-0123|5|4| END| 70.75|3.Flocks to report | 0.64| 0|1 2019-06-25 07:30:43,677|FF|app-20190625072933-0123|5|4|START| 70.75|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:30:43,713|FF|app-20190625072933-0123|5|4| END| 70.79|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 07:30:43,713|FF|app-20190625072933-0123|5|4|START| 70.79|5.Flocks reported | 0.00| 0|1 2019-06-25 07:30:43,718|FF|app-20190625072933-0123|5|4| END| 70.79|5.Flocks reported | 0.01| 0|1 2019-06-25 07:30:43,718|FF|app-20190625072933-0123|5|4|START| 70.79|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:30:45,587|FF|app-20190625072933-0123|5|4| END| 72.66|6.Candidates indexed | 1.87| 22599|1 2019-06-25 07:30:45,587|FF|app-20190625072933-0123|5|4|START| 72.66|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:30:45,587|MF|app-20190625072933-0123|5|4|START| 72.66|A.Points indexed | 0.00| 0|2 2019-06-25 07:30:45,648|MF|app-20190625072933-0123|5|4| END| 72.72|A.Points indexed | 0.06| 18394|2 2019-06-25 07:30:45,648|MF|app-20190625072933-0123|5|4|START| 72.72|B.Pairs found | 0.00| 0|2 2019-06-25 07:30:46,059|MF|app-20190625072933-0123|5|4| END| 73.13|B.Pairs found | 0.41| 40566|2 2019-06-25 07:30:46,059|MF|app-20190625072933-0123|5|4|START| 73.13|C.Centers found | 0.00| 0|2 2019-06-25 07:30:46,422|MF|app-20190625072933-0123|5|4| END| 73.50|C.Centers found | 0.36| 81132|2 2019-06-25 07:30:46,422|MF|app-20190625072933-0123|5|4|START| 73.50|D.Disks found | 0.00| 0|2 2019-06-25 07:30:48,400|MF|app-20190625072933-0123|5|4| END| 75.47|D.Disks found | 1.98| 36353|2 2019-06-25 07:30:48,400|MF|app-20190625072933-0123|5|4|START| 75.47|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:30:49,238|MF|app-20190625072933-0123|5|4| END| 76.31|E.Disks partitioned | 0.84| 53134|2 2019-06-25 07:30:49,238|MF|app-20190625072933-0123|5|4|START| 76.31|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:30:49,238|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:30:49,239|Cell area: 1055533.7681000116 2019-06-25 07:31:14,862|MF|app-20190625072933-0123|5|4| END|101.93|F.Maximal disks found | 25.62| 10342|2 2019-06-25 07:31:14,862|MAXIMALS|app-20190625072933-0123|4|5|110.0|3|450|29.275|10342 2019-06-25 07:31:15,251|FF|app-20190625072933-0123|5|4| END|102.32|1.Maximal disks found | 29.66| 10342|2 2019-06-25 07:31:15,251|FF|app-20190625072933-0123|5|4|START|102.32|2.Join done | 0.00| 0|2 2019-06-25 07:31:29,001|FF|app-20190625072933-0123|5|4| END|116.07|2.Join done | 13.75| 45000|2 2019-06-25 07:31:29,001|FF|app-20190625072933-0123|5|4|START|116.07|3.Flocks to report | 0.00| 0|2 2019-06-25 07:31:31,171|FF|app-20190625072933-0123|5|4| END|118.24|3.Flocks to report | 2.17| 38432|2 2019-06-25 07:31:31,171|FF|app-20190625072933-0123|5|4|START|118.24|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:31:31,251|FF|app-20190625072933-0123|5|4|START|118.32|4a.Making expansions | 0.00| 0|2 2019-06-25 07:31:32,439|FF|app-20190625072933-0123|5|4| END|119.51|4a.Making expansions | 1.19| 47766|2 2019-06-25 07:31:32,439|FF|app-20190625072933-0123|5|4|START|119.51|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:32:19,035|FF|app-20190625072933-0123|5|4| END|166.11|4b.Finding maximals | 46.60| 6601|2 2019-06-25 07:32:19,357|FF|app-20190625072933-0123|5|4| END|166.43|4.Flocks prunned by expansion | 48.19| 6601|2 2019-06-25 07:32:19,357|FF|app-20190625072933-0123|5|4|START|166.43|5.Flocks reported | 0.00| 0|2 2019-06-25 07:32:19,892|FF|app-20190625072933-0123|5|4| END|166.97|5.Flocks reported | 0.54| 6601|2 2019-06-25 07:32:19,892|FF|app-20190625072933-0123|5|4|START|166.97|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:32:23,374|FF|app-20190625072933-0123|5|4| END|170.45|6.Candidates indexed | 3.48| 13819|2 2019-06-25 07:32:23,374|FF|app-20190625072933-0123|5|4|START|170.45|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:32:23,374|MF|app-20190625072933-0123|5|4|START|170.45|A.Points indexed | 0.00| 0|3 2019-06-25 07:32:23,433|MF|app-20190625072933-0123|5|4| END|170.51|A.Points indexed | 0.06| 18548|3 2019-06-25 07:32:23,433|MF|app-20190625072933-0123|5|4|START|170.51|B.Pairs found | 0.00| 0|3 2019-06-25 07:32:24,134|MF|app-20190625072933-0123|5|4| END|171.21|B.Pairs found | 0.70| 41257|3 2019-06-25 07:32:24,134|MF|app-20190625072933-0123|5|4|START|171.21|C.Centers found | 0.00| 0|3 2019-06-25 07:32:24,856|MF|app-20190625072933-0123|5|4| END|171.93|C.Centers found | 0.72| 82514|3 2019-06-25 07:32:24,856|MF|app-20190625072933-0123|5|4|START|171.93|D.Disks found | 0.00| 0|3 2019-06-25 07:32:28,266|MF|app-20190625072933-0123|5|4| END|175.34|D.Disks found | 3.41| 37087|3 2019-06-25 07:32:28,266|MF|app-20190625072933-0123|5|4|START|175.34|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:32:29,391|MF|app-20190625072933-0123|5|4| END|176.46|E.Disks partitioned | 1.13| 54196|3 2019-06-25 07:32:29,392|MF|app-20190625072933-0123|5|4|START|176.47|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:32:29,392|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:32:29,392|Cell area: 1055533.7681000116 2019-06-25 07:33:01,936|MF|app-20190625072933-0123|5|4| END|209.01|F.Maximal disks found | 32.54| 10503|3 2019-06-25 07:33:01,937|MAXIMALS|app-20190625072933-0123|4|5|110.0|3|450|38.563|10503 2019-06-25 07:33:02,392|FF|app-20190625072933-0123|5|4| END|209.47|1.Maximal disks found | 39.02| 10503|3 2019-06-25 07:33:02,392|FF|app-20190625072933-0123|5|4|START|209.47|2.Join done | 0.00| 0|3 2019-06-25 07:33:10,091|FF|app-20190625072933-0123|5|4| END|217.16|2.Join done | 7.70| 45190|3 2019-06-25 07:33:10,091|FF|app-20190625072933-0123|5|4|START|217.16|3.Flocks to report | 0.00| 0|3 2019-06-25 07:33:11,434|FF|app-20190625072933-0123|5|4| END|218.51|3.Flocks to report | 1.34| 38589|3 2019-06-25 07:33:11,434|FF|app-20190625072933-0123|5|4|START|218.51|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:33:11,479|FF|app-20190625072933-0123|5|4|START|218.55|4a.Making expansions | 0.00| 0|3 2019-06-25 07:33:12,200|FF|app-20190625072933-0123|5|4| END|219.27|4a.Making expansions | 0.72| 47874|3 2019-06-25 07:33:12,200|FF|app-20190625072933-0123|5|4|START|219.27|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:34:14,404|FF|app-20190625072933-0123|5|4| END|281.48|4b.Finding maximals | 62.20| 6669|3 2019-06-25 07:34:14,607|FF|app-20190625072933-0123|5|4| END|281.68|4.Flocks prunned by expansion | 63.17| 6669|3 2019-06-25 07:34:14,607|FF|app-20190625072933-0123|5|4|START|281.68|5.Flocks reported | 0.00| 0|3 2019-06-25 07:34:14,936|FF|app-20190625072933-0123|5|4| END|282.01|5.Flocks reported | 0.33| 6669|3 2019-06-25 07:34:14,936|FF|app-20190625072933-0123|5|4|START|282.01|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:34:17,335|FF|app-20190625072933-0123|5|4| END|284.41|6.Candidates indexed | 2.40| 13927|3 2019-06-25 07:34:18,107|Number of flocks: 13270 2019-06-25 07:34:18,503|PFLOCK|app-20190625072933-0123|4|5|110.0|3|3|279.35|13270 2019-06-25 07:34:18,906|FF|app-20190625072933-0123|5|4| END|285.98|Flock Finder run |280.15| 13270|3 2019-06-25 07:34:18,906|FF|app-20190625072933-0123|5|4|START|285.98|Session closed | 0.00| 0|3 2019-06-25 07:34:25,785|FF|app-20190625072933-0123|5|4| END|292.86|Session closed | 6.88| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:34:27,712|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:34:28,835|FF|app-20190625073428-0124|15|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 07:34:28,835|FF|app-20190625073428-0124|15|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 07:34:33,087|FF|app-20190625073428-0124|15|4| END| 5.36|Data read | 4.25|331128|-1 2019-06-25 07:34:33,087|FF|app-20190625073428-0124|15|4|START| 5.36|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:34:33,436|FF|app-20190625073428-0124|15|4| END| 5.71|KDBTree partitioner | 0.35| 816|-1 2019-06-25 07:34:33,437|FF|app-20190625073428-0124|15|4|START| 5.71|MF partitioner | 0.00| 0|-1 2019-06-25 07:34:33,460|FF|app-20190625073428-0124|15|4| END| 5.73|MF partitioner | 0.02| 1350|-1 2019-06-25 07:34:33,460|FF|app-20190625073428-0124|15|4|START| 5.73|Pointset done | 0.00| 0|-1 2019-06-25 07:34:34,639|FF|app-20190625073428-0124|15|4| END| 6.91|Pointset done | 1.18| 4|-1 2019-06-25 07:34:34,639|FF|app-20190625073428-0124|15|4|START| 6.91|Flock Finder run | 0.00| 0|-1 2019-06-25 07:34:34,656|FF|app-20190625073428-0124|15|4|START| 6.93|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:34:34,658|MF|app-20190625073428-0124|15|4|START| 6.93|A.Points indexed | 0.00| 0|0 2019-06-25 07:34:34,875|MF|app-20190625073428-0124|15|4| END| 7.15|A.Points indexed | 0.22| 54279|0 2019-06-25 07:34:34,875|MF|app-20190625073428-0124|15|4|START| 7.15|B.Pairs found | 0.00| 0|0 2019-06-25 07:34:37,088|MF|app-20190625073428-0124|15|4| END| 9.36|B.Pairs found | 2.21| 71679|0 2019-06-25 07:34:37,088|MF|app-20190625073428-0124|15|4|START| 9.36|C.Centers found | 0.00| 0|0 2019-06-25 07:34:38,814|MF|app-20190625073428-0124|15|4| END| 11.09|C.Centers found | 1.73|143358|0 2019-06-25 07:34:38,814|MF|app-20190625073428-0124|15|4|START| 11.09|D.Disks found | 0.00| 0|0 2019-06-25 07:34:45,503|MF|app-20190625073428-0124|15|4| END| 17.78|D.Disks found | 6.69| 52353|0 2019-06-25 07:34:45,503|MF|app-20190625073428-0124|15|4|START| 17.78|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:34:47,247|MF|app-20190625073428-0124|15|4| END| 19.52|E.Disks partitioned | 1.74| 69681|0 2019-06-25 07:34:47,247|MF|app-20190625073428-0124|15|4|START| 19.52|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:34:47,249|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:34:47,249|Cell area: 1055533.7681000116 2019-06-25 07:34:49,483|MF|app-20190625073428-0124|15|4| END| 21.76|F.Maximal disks found | 2.24| 17026|0 2019-06-25 07:34:49,483|MAXIMALS|app-20190625073428-0124|4|15|80.0|3|1350|14.825|17026 2019-06-25 07:34:50,546|FF|app-20190625073428-0124|15|4| END| 22.82|1.Maximal disks found | 15.89| 17026|0 2019-06-25 07:34:50,546|FF|app-20190625073428-0124|15|4|START| 22.82|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:34:50,547|MF|app-20190625073428-0124|15|4|START| 22.82|A.Points indexed | 0.00| 0|1 2019-06-25 07:34:50,674|MF|app-20190625073428-0124|15|4| END| 22.95|A.Points indexed | 0.13| 54735|1 2019-06-25 07:34:50,674|MF|app-20190625073428-0124|15|4|START| 22.95|B.Pairs found | 0.00| 0|1 2019-06-25 07:34:51,981|MF|app-20190625073428-0124|15|4| END| 24.25|B.Pairs found | 1.31| 72729|1 2019-06-25 07:34:51,982|MF|app-20190625073428-0124|15|4|START| 24.25|C.Centers found | 0.00| 0|1 2019-06-25 07:34:53,490|MF|app-20190625073428-0124|15|4| END| 25.76|C.Centers found | 1.51|145458|1 2019-06-25 07:34:53,490|MF|app-20190625073428-0124|15|4|START| 25.76|D.Disks found | 0.00| 0|1 2019-06-25 07:35:00,185|MF|app-20190625073428-0124|15|4| END| 32.46|D.Disks found | 6.70| 53289|1 2019-06-25 07:35:00,185|MF|app-20190625073428-0124|15|4|START| 32.46|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:35:01,695|MF|app-20190625073428-0124|15|4| END| 33.97|E.Disks partitioned | 1.51| 70836|1 2019-06-25 07:35:01,695|MF|app-20190625073428-0124|15|4|START| 33.97|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:35:01,696|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:35:01,696|Cell area: 1055533.7681000116 2019-06-25 07:35:03,832|MF|app-20190625073428-0124|15|4| END| 36.10|F.Maximal disks found | 2.14| 17245|1 2019-06-25 07:35:03,832|MAXIMALS|app-20190625073428-0124|4|15|80.0|3|1350|13.285|17245 2019-06-25 07:35:04,856|FF|app-20190625073428-0124|15|4| END| 37.13|1.Maximal disks found | 14.31| 17245|1 2019-06-25 07:35:04,856|FF|app-20190625073428-0124|15|4|START| 37.13|2.Join done | 0.00| 0|1 2019-06-25 07:35:07,374|FF|app-20190625073428-0124|15|4| END| 39.65|2.Join done | 2.52| 27004|1 2019-06-25 07:35:07,374|FF|app-20190625073428-0124|15|4|START| 39.65|3.Flocks to report | 0.00| 0|1 2019-06-25 07:35:07,867|FF|app-20190625073428-0124|15|4| END| 40.14|3.Flocks to report | 0.49| 0|1 2019-06-25 07:35:07,867|FF|app-20190625073428-0124|15|4|START| 40.14|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:35:07,940|FF|app-20190625073428-0124|15|4| END| 40.21|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 07:35:07,940|FF|app-20190625073428-0124|15|4|START| 40.21|5.Flocks reported | 0.00| 0|1 2019-06-25 07:35:07,946|FF|app-20190625073428-0124|15|4| END| 40.22|5.Flocks reported | 0.01| 0|1 2019-06-25 07:35:07,946|FF|app-20190625073428-0124|15|4|START| 40.22|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:35:09,195|FF|app-20190625073428-0124|15|4| END| 41.47|6.Candidates indexed | 1.25| 28069|1 2019-06-25 07:35:09,195|FF|app-20190625073428-0124|15|4|START| 41.47|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:35:09,196|MF|app-20190625073428-0124|15|4|START| 41.47|A.Points indexed | 0.00| 0|2 2019-06-25 07:35:09,323|MF|app-20190625073428-0124|15|4| END| 41.59|A.Points indexed | 0.13| 55182|2 2019-06-25 07:35:09,323|MF|app-20190625073428-0124|15|4|START| 41.60|B.Pairs found | 0.00| 0|2 2019-06-25 07:35:10,147|MF|app-20190625073428-0124|15|4| END| 42.42|B.Pairs found | 0.82| 73710|2 2019-06-25 07:35:10,147|MF|app-20190625073428-0124|15|4|START| 42.42|C.Centers found | 0.00| 0|2 2019-06-25 07:35:11,053|MF|app-20190625073428-0124|15|4| END| 43.33|C.Centers found | 0.91|147420|2 2019-06-25 07:35:11,053|MF|app-20190625073428-0124|15|4|START| 43.33|D.Disks found | 0.00| 0|2 2019-06-25 07:35:14,393|MF|app-20190625073428-0124|15|4| END| 46.67|D.Disks found | 3.34| 54024|2 2019-06-25 07:35:14,394|MF|app-20190625073428-0124|15|4|START| 46.67|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:35:15,251|MF|app-20190625073428-0124|15|4| END| 47.52|E.Disks partitioned | 0.86| 71877|2 2019-06-25 07:35:15,251|MF|app-20190625073428-0124|15|4|START| 47.52|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:35:15,252|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:35:15,252|Cell area: 1055533.7681000116 2019-06-25 07:35:17,313|MF|app-20190625073428-0124|15|4| END| 49.59|F.Maximal disks found | 2.06| 17462|2 2019-06-25 07:35:17,313|MAXIMALS|app-20190625073428-0124|4|15|80.0|3|1350|8.117|17462 2019-06-25 07:35:18,312|FF|app-20190625073428-0124|15|4| END| 50.58|1.Maximal disks found | 9.12| 17462|2 2019-06-25 07:35:18,312|FF|app-20190625073428-0124|15|4|START| 50.58|2.Join done | 0.00| 0|2 2019-06-25 07:35:23,019|FF|app-20190625073428-0124|15|4| END| 55.29|2.Join done | 4.71| 38332|2 2019-06-25 07:35:23,019|FF|app-20190625073428-0124|15|4|START| 55.29|3.Flocks to report | 0.00| 0|2 2019-06-25 07:35:24,017|FF|app-20190625073428-0124|15|4| END| 56.29|3.Flocks to report | 1.00| 33043|2 2019-06-25 07:35:24,017|FF|app-20190625073428-0124|15|4|START| 56.29|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:35:24,094|FF|app-20190625073428-0124|15|4|START| 56.37|4a.Making expansions | 0.00| 0|2 2019-06-25 07:35:25,105|FF|app-20190625073428-0124|15|4| END| 57.38|4a.Making expansions | 1.01| 41694|2 2019-06-25 07:35:25,105|FF|app-20190625073428-0124|15|4|START| 57.38|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:35:26,272|FF|app-20190625073428-0124|15|4| END| 58.54|4b.Finding maximals | 1.17| 12225|2 2019-06-25 07:35:26,718|FF|app-20190625073428-0124|15|4| END| 58.99|4.Flocks prunned by expansion | 2.70| 12225|2 2019-06-25 07:35:26,719|FF|app-20190625073428-0124|15|4|START| 58.99|5.Flocks reported | 0.00| 0|2 2019-06-25 07:35:27,282|FF|app-20190625073428-0124|15|4| END| 59.55|5.Flocks reported | 0.56| 12225|2 2019-06-25 07:35:27,282|FF|app-20190625073428-0124|15|4|START| 59.55|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:35:28,856|FF|app-20190625073428-0124|15|4| END| 61.13|6.Candidates indexed | 1.57| 18597|2 2019-06-25 07:35:28,857|FF|app-20190625073428-0124|15|4|START| 61.13|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:35:28,857|MF|app-20190625073428-0124|15|4|START| 61.13|A.Points indexed | 0.00| 0|3 2019-06-25 07:35:28,972|MF|app-20190625073428-0124|15|4| END| 61.24|A.Points indexed | 0.12| 55644|3 2019-06-25 07:35:28,972|MF|app-20190625073428-0124|15|4|START| 61.24|B.Pairs found | 0.00| 0|3 2019-06-25 07:35:29,803|MF|app-20190625073428-0124|15|4| END| 62.08|B.Pairs found | 0.83| 74871|3 2019-06-25 07:35:29,803|MF|app-20190625073428-0124|15|4|START| 62.08|C.Centers found | 0.00| 0|3 2019-06-25 07:35:30,659|MF|app-20190625073428-0124|15|4| END| 62.93|C.Centers found | 0.86|149742|3 2019-06-25 07:35:30,659|MF|app-20190625073428-0124|15|4|START| 62.93|D.Disks found | 0.00| 0|3 2019-06-25 07:35:35,929|MF|app-20190625073428-0124|15|4| END| 68.20|D.Disks found | 5.27| 54930|3 2019-06-25 07:35:35,929|MF|app-20190625073428-0124|15|4|START| 68.20|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:35:38,188|MF|app-20190625073428-0124|15|4| END| 70.46|E.Disks partitioned | 2.26| 73112|3 2019-06-25 07:35:38,188|MF|app-20190625073428-0124|15|4|START| 70.46|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:35:38,188|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:35:38,188|Cell area: 1055533.7681000116 2019-06-25 07:35:40,556|MF|app-20190625073428-0124|15|4| END| 72.83|F.Maximal disks found | 2.37| 17782|3 2019-06-25 07:35:40,556|MAXIMALS|app-20190625073428-0124|4|15|80.0|3|1350|11.699|17782 2019-06-25 07:35:41,616|FF|app-20190625073428-0124|15|4| END| 73.89|1.Maximal disks found | 12.76| 17782|3 2019-06-25 07:35:41,616|FF|app-20190625073428-0124|15|4|START| 73.89|2.Join done | 0.00| 0|3 2019-06-25 07:35:45,060|FF|app-20190625073428-0124|15|4| END| 77.33|2.Join done | 3.44| 37059|3 2019-06-25 07:35:45,060|FF|app-20190625073428-0124|15|4|START| 77.33|3.Flocks to report | 0.00| 0|3 2019-06-25 07:35:46,008|FF|app-20190625073428-0124|15|4| END| 78.28|3.Flocks to report | 0.95| 31049|3 2019-06-25 07:35:46,008|FF|app-20190625073428-0124|15|4|START| 78.28|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:35:46,153|FF|app-20190625073428-0124|15|4|START| 78.43|4a.Making expansions | 0.00| 0|3 2019-06-25 07:35:47,013|FF|app-20190625073428-0124|15|4| END| 79.29|4a.Making expansions | 0.86| 39846|3 2019-06-25 07:35:47,013|FF|app-20190625073428-0124|15|4|START| 79.29|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:35:47,975|FF|app-20190625073428-0124|15|4| END| 80.25|4b.Finding maximals | 0.96| 12384|3 2019-06-25 07:35:48,464|FF|app-20190625073428-0124|15|4| END| 80.74|4.Flocks prunned by expansion | 2.46| 12384|3 2019-06-25 07:35:48,464|FF|app-20190625073428-0124|15|4|START| 80.74|5.Flocks reported | 0.00| 0|3 2019-06-25 07:35:49,062|FF|app-20190625073428-0124|15|4| END| 81.33|5.Flocks reported | 0.60| 12384|3 2019-06-25 07:35:49,062|FF|app-20190625073428-0124|15|4|START| 81.33|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:35:50,682|FF|app-20190625073428-0124|15|4| END| 82.95|6.Candidates indexed | 1.62| 19484|3 2019-06-25 07:35:51,969|Number of flocks: 24609 2019-06-25 07:35:52,897|PFLOCK|app-20190625073428-0124|4|15|80.0|3|3|77.33|24609 2019-06-25 07:35:53,831|FF|app-20190625073428-0124|15|4| END| 86.10|Flock Finder run | 79.19| 24609|3 2019-06-25 07:35:53,831|FF|app-20190625073428-0124|15|4|START| 86.10|Session closed | 0.00| 0|3 2019-06-25 07:36:04,525|FF|app-20190625073428-0124|15|4| END| 96.80|Session closed | 10.69| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:36:06,667|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:36:07,788|FF|app-20190625073607-0125|10|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 07:36:07,789|FF|app-20190625073607-0125|10|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 07:36:11,815|FF|app-20190625073607-0125|10|4| END| 5.13|Data read | 4.03|220752|-1 2019-06-25 07:36:11,815|FF|app-20190625073607-0125|10|4|START| 5.13|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:36:12,017|FF|app-20190625073607-0125|10|4| END| 5.33|KDBTree partitioner | 0.20| 544|-1 2019-06-25 07:36:12,017|FF|app-20190625073607-0125|10|4|START| 5.33|MF partitioner | 0.00| 0|-1 2019-06-25 07:36:12,034|FF|app-20190625073607-0125|10|4| END| 5.35|MF partitioner | 0.02| 900|-1 2019-06-25 07:36:12,034|FF|app-20190625073607-0125|10|4|START| 5.35|Pointset done | 0.00| 0|-1 2019-06-25 07:36:13,077|FF|app-20190625073607-0125|10|4| END| 6.39|Pointset done | 1.04| 4|-1 2019-06-25 07:36:13,077|FF|app-20190625073607-0125|10|4|START| 6.39|Flock Finder run | 0.00| 0|-1 2019-06-25 07:36:13,093|FF|app-20190625073607-0125|10|4|START| 6.41|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:36:13,095|MF|app-20190625073607-0125|10|4|START| 6.41|A.Points indexed | 0.00| 0|0 2019-06-25 07:36:13,270|MF|app-20190625073607-0125|10|4| END| 6.59|A.Points indexed | 0.18| 36186|0 2019-06-25 07:36:13,270|MF|app-20190625073607-0125|10|4|START| 6.59|B.Pairs found | 0.00| 0|0 2019-06-25 07:36:15,530|MF|app-20190625073607-0125|10|4| END| 8.85|B.Pairs found | 2.26| 47786|0 2019-06-25 07:36:15,530|MF|app-20190625073607-0125|10|4|START| 8.85|C.Centers found | 0.00| 0|0 2019-06-25 07:36:17,306|MF|app-20190625073607-0125|10|4| END| 10.62|C.Centers found | 1.78| 95572|0 2019-06-25 07:36:17,306|MF|app-20190625073607-0125|10|4|START| 10.62|D.Disks found | 0.00| 0|0 2019-06-25 07:36:24,543|MF|app-20190625073607-0125|10|4| END| 17.86|D.Disks found | 7.24| 34902|0 2019-06-25 07:36:24,543|MF|app-20190625073607-0125|10|4|START| 17.86|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:36:27,539|MF|app-20190625073607-0125|10|4| END| 20.86|E.Disks partitioned | 3.00| 46456|0 2019-06-25 07:36:27,539|MF|app-20190625073607-0125|10|4|START| 20.86|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:36:27,541|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:36:27,541|Cell area: 1055533.7681000116 2019-06-25 07:36:30,709|MF|app-20190625073607-0125|10|4| END| 24.03|F.Maximal disks found | 3.17| 11354|0 2019-06-25 07:36:30,709|MAXIMALS|app-20190625073607-0125|4|10|80.0|3|900|17.614|11354 2019-06-25 07:36:32,229|FF|app-20190625073607-0125|10|4| END| 25.55|1.Maximal disks found | 19.14| 11354|0 2019-06-25 07:36:32,230|FF|app-20190625073607-0125|10|4|START| 25.55|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:36:32,230|MF|app-20190625073607-0125|10|4|START| 25.55|A.Points indexed | 0.00| 0|1 2019-06-25 07:36:32,325|MF|app-20190625073607-0125|10|4| END| 25.64|A.Points indexed | 0.10| 36490|1 2019-06-25 07:36:32,325|MF|app-20190625073607-0125|10|4|START| 25.64|B.Pairs found | 0.00| 0|1 2019-06-25 07:36:33,307|MF|app-20190625073607-0125|10|4| END| 26.62|B.Pairs found | 0.98| 48486|1 2019-06-25 07:36:33,307|MF|app-20190625073607-0125|10|4|START| 26.62|C.Centers found | 0.00| 0|1 2019-06-25 07:36:35,188|MF|app-20190625073607-0125|10|4| END| 28.50|C.Centers found | 1.88| 96972|1 2019-06-25 07:36:35,188|MF|app-20190625073607-0125|10|4|START| 28.50|D.Disks found | 0.00| 0|1 2019-06-25 07:36:39,619|MF|app-20190625073607-0125|10|4| END| 32.94|D.Disks found | 4.43| 35526|1 2019-06-25 07:36:39,619|MF|app-20190625073607-0125|10|4|START| 32.94|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:36:41,425|MF|app-20190625073607-0125|10|4| END| 34.74|E.Disks partitioned | 1.81| 47221|1 2019-06-25 07:36:41,425|MF|app-20190625073607-0125|10|4|START| 34.74|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:36:41,425|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:36:41,426|Cell area: 1055533.7681000116 2019-06-25 07:36:43,670|MF|app-20190625073607-0125|10|4| END| 36.99|F.Maximal disks found | 2.25| 11499|1 2019-06-25 07:36:43,670|MAXIMALS|app-20190625073607-0125|4|10|80.0|3|900|11.44|11499 2019-06-25 07:36:44,646|FF|app-20190625073607-0125|10|4| END| 37.96|1.Maximal disks found | 12.42| 11499|1 2019-06-25 07:36:44,646|FF|app-20190625073607-0125|10|4|START| 37.96|2.Join done | 0.00| 0|1 2019-06-25 07:36:49,000|FF|app-20190625073607-0125|10|4| END| 42.32|2.Join done | 4.35| 17993|1 2019-06-25 07:36:49,000|FF|app-20190625073607-0125|10|4|START| 42.32|3.Flocks to report | 0.00| 0|1 2019-06-25 07:36:49,674|FF|app-20190625073607-0125|10|4| END| 42.99|3.Flocks to report | 0.67| 0|1 2019-06-25 07:36:49,674|FF|app-20190625073607-0125|10|4|START| 42.99|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:36:49,735|FF|app-20190625073607-0125|10|4| END| 43.05|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 07:36:49,735|FF|app-20190625073607-0125|10|4|START| 43.05|5.Flocks reported | 0.00| 0|1 2019-06-25 07:36:49,740|FF|app-20190625073607-0125|10|4| END| 43.06|5.Flocks reported | 0.01| 0|1 2019-06-25 07:36:49,740|FF|app-20190625073607-0125|10|4|START| 43.06|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:36:51,242|FF|app-20190625073607-0125|10|4| END| 44.56|6.Candidates indexed | 1.50| 18703|1 2019-06-25 07:36:51,242|FF|app-20190625073607-0125|10|4|START| 44.56|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:36:51,242|MF|app-20190625073607-0125|10|4|START| 44.56|A.Points indexed | 0.00| 0|2 2019-06-25 07:36:51,340|MF|app-20190625073607-0125|10|4| END| 44.66|A.Points indexed | 0.10| 36788|2 2019-06-25 07:36:51,340|MF|app-20190625073607-0125|10|4|START| 44.66|B.Pairs found | 0.00| 0|2 2019-06-25 07:36:52,122|MF|app-20190625073607-0125|10|4| END| 45.44|B.Pairs found | 0.78| 49140|2 2019-06-25 07:36:52,123|MF|app-20190625073607-0125|10|4|START| 45.44|C.Centers found | 0.00| 0|2 2019-06-25 07:36:53,066|MF|app-20190625073607-0125|10|4| END| 46.38|C.Centers found | 0.94| 98280|2 2019-06-25 07:36:53,066|MF|app-20190625073607-0125|10|4|START| 46.38|D.Disks found | 0.00| 0|2 2019-06-25 07:36:56,329|MF|app-20190625073607-0125|10|4| END| 49.65|D.Disks found | 3.26| 36016|2 2019-06-25 07:36:56,329|MF|app-20190625073607-0125|10|4|START| 49.65|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:36:57,511|MF|app-20190625073607-0125|10|4| END| 50.83|E.Disks partitioned | 1.18| 47918|2 2019-06-25 07:36:57,511|MF|app-20190625073607-0125|10|4|START| 50.83|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:36:57,512|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:36:57,512|Cell area: 1055533.7681000116 2019-06-25 07:36:59,415|MF|app-20190625073607-0125|10|4| END| 52.73|F.Maximal disks found | 1.90| 11642|2 2019-06-25 07:36:59,416|MAXIMALS|app-20190625073607-0125|4|10|80.0|3|900|8.173|11642 2019-06-25 07:37:00,186|FF|app-20190625073607-0125|10|4| END| 53.50|1.Maximal disks found | 8.94| 11642|2 2019-06-25 07:37:00,186|FF|app-20190625073607-0125|10|4|START| 53.50|2.Join done | 0.00| 0|2 2019-06-25 07:37:04,625|FF|app-20190625073607-0125|10|4| END| 57.94|2.Join done | 4.44| 25538|2 2019-06-25 07:37:04,625|FF|app-20190625073607-0125|10|4|START| 57.94|3.Flocks to report | 0.00| 0|2 2019-06-25 07:37:05,279|FF|app-20190625073607-0125|10|4| END| 58.60|3.Flocks to report | 0.65| 22013|2 2019-06-25 07:37:05,280|FF|app-20190625073607-0125|10|4|START| 58.60|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:37:05,339|FF|app-20190625073607-0125|10|4|START| 58.66|4a.Making expansions | 0.00| 0|2 2019-06-25 07:37:06,095|FF|app-20190625073607-0125|10|4| END| 59.41|4a.Making expansions | 0.76| 27752|2 2019-06-25 07:37:06,095|FF|app-20190625073607-0125|10|4|START| 59.41|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:37:07,184|FF|app-20190625073607-0125|10|4| END| 60.50|4b.Finding maximals | 1.09| 8150|2 2019-06-25 07:37:07,488|FF|app-20190625073607-0125|10|4| END| 60.80|4.Flocks prunned by expansion | 2.21| 8150|2 2019-06-25 07:37:07,488|FF|app-20190625073607-0125|10|4|START| 60.80|5.Flocks reported | 0.00| 0|2 2019-06-25 07:37:07,958|FF|app-20190625073607-0125|10|4| END| 61.27|5.Flocks reported | 0.47| 8150|2 2019-06-25 07:37:07,958|FF|app-20190625073607-0125|10|4|START| 61.27|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:37:09,347|FF|app-20190625073607-0125|10|4| END| 62.66|6.Candidates indexed | 1.39| 12396|2 2019-06-25 07:37:09,348|FF|app-20190625073607-0125|10|4|START| 62.66|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:37:09,348|MF|app-20190625073607-0125|10|4|START| 62.66|A.Points indexed | 0.00| 0|3 2019-06-25 07:37:09,433|MF|app-20190625073607-0125|10|4| END| 62.75|A.Points indexed | 0.09| 37096|3 2019-06-25 07:37:09,433|MF|app-20190625073607-0125|10|4|START| 62.75|B.Pairs found | 0.00| 0|3 2019-06-25 07:37:10,054|MF|app-20190625073607-0125|10|4| END| 63.37|B.Pairs found | 0.62| 49914|3 2019-06-25 07:37:10,054|MF|app-20190625073607-0125|10|4|START| 63.37|C.Centers found | 0.00| 0|3 2019-06-25 07:37:10,876|MF|app-20190625073607-0125|10|4| END| 64.19|C.Centers found | 0.82| 99828|3 2019-06-25 07:37:10,876|MF|app-20190625073607-0125|10|4|START| 64.19|D.Disks found | 0.00| 0|3 2019-06-25 07:37:14,364|MF|app-20190625073607-0125|10|4| END| 67.68|D.Disks found | 3.49| 36620|3 2019-06-25 07:37:14,364|MF|app-20190625073607-0125|10|4|START| 67.68|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:37:15,810|MF|app-20190625073607-0125|10|4| END| 69.13|E.Disks partitioned | 1.45| 48737|3 2019-06-25 07:37:15,810|MF|app-20190625073607-0125|10|4|START| 69.13|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:37:15,811|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:37:15,811|Cell area: 1055533.7681000116 2019-06-25 07:37:18,144|MF|app-20190625073607-0125|10|4| END| 71.46|F.Maximal disks found | 2.33| 11852|3 2019-06-25 07:37:18,144|MAXIMALS|app-20190625073607-0125|4|10|80.0|3|900|8.796|11852 2019-06-25 07:37:18,875|FF|app-20190625073607-0125|10|4| END| 72.19|1.Maximal disks found | 9.53| 11852|3 2019-06-25 07:37:18,876|FF|app-20190625073607-0125|10|4|START| 72.19|2.Join done | 0.00| 0|3 2019-06-25 07:37:22,133|FF|app-20190625073607-0125|10|4| END| 75.45|2.Join done | 3.26| 24689|3 2019-06-25 07:37:22,133|FF|app-20190625073607-0125|10|4|START| 75.45|3.Flocks to report | 0.00| 0|3 2019-06-25 07:37:22,806|FF|app-20190625073607-0125|10|4| END| 76.12|3.Flocks to report | 0.67| 20688|3 2019-06-25 07:37:22,806|FF|app-20190625073607-0125|10|4|START| 76.12|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:37:22,871|FF|app-20190625073607-0125|10|4|START| 76.19|4a.Making expansions | 0.00| 0|3 2019-06-25 07:37:23,650|FF|app-20190625073607-0125|10|4| END| 76.97|4a.Making expansions | 0.78| 26571|3 2019-06-25 07:37:23,651|FF|app-20190625073607-0125|10|4|START| 76.97|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:37:24,548|FF|app-20190625073607-0125|10|4| END| 77.86|4b.Finding maximals | 0.90| 8256|3 2019-06-25 07:37:24,912|FF|app-20190625073607-0125|10|4| END| 78.23|4.Flocks prunned by expansion | 2.11| 8256|3 2019-06-25 07:37:24,912|FF|app-20190625073607-0125|10|4|START| 78.23|5.Flocks reported | 0.00| 0|3 2019-06-25 07:37:25,351|FF|app-20190625073607-0125|10|4| END| 78.67|5.Flocks reported | 0.44| 8256|3 2019-06-25 07:37:25,351|FF|app-20190625073607-0125|10|4|START| 78.67|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:37:26,779|FF|app-20190625073607-0125|10|4| END| 80.10|6.Candidates indexed | 1.43| 12984|3 2019-06-25 07:37:27,891|Number of flocks: 16406 2019-06-25 07:37:28,658|PFLOCK|app-20190625073607-0125|4|10|80.0|3|3|74.81|16406 2019-06-25 07:37:29,422|FF|app-20190625073607-0125|10|4| END| 82.74|Flock Finder run | 76.35| 16406|3 2019-06-25 07:37:29,423|FF|app-20190625073607-0125|10|4|START| 82.74|Session closed | 0.00| 0|3 2019-06-25 07:37:36,247|FF|app-20190625073607-0125|10|4| END| 89.56|Session closed | 6.82| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:37:38,233|FF|app-00000000000000-0000|5|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 07:37:39,345|FF|app-20190625073739-0126|5|4| END| 1.10|Session start | 1.11| 0|-1 2019-06-25 07:37:39,345|FF|app-20190625073739-0126|5|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 07:37:43,262|FF|app-20190625073739-0126|5|4| END| 5.01|Data read | 3.92|110376|-1 2019-06-25 07:37:43,262|FF|app-20190625073739-0126|5|4|START| 5.01|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:37:43,384|FF|app-20190625073739-0126|5|4| END| 5.14|KDBTree partitioner | 0.12| 272|-1 2019-06-25 07:37:43,385|FF|app-20190625073739-0126|5|4|START| 5.14|MF partitioner | 0.00| 0|-1 2019-06-25 07:37:43,393|FF|app-20190625073739-0126|5|4| END| 5.14|MF partitioner | 0.01| 450|-1 2019-06-25 07:37:43,393|FF|app-20190625073739-0126|5|4|START| 5.14|Pointset done | 0.00| 0|-1 2019-06-25 07:37:44,299|FF|app-20190625073739-0126|5|4| END| 6.05|Pointset done | 0.91| 4|-1 2019-06-25 07:37:44,300|FF|app-20190625073739-0126|5|4|START| 6.05|Flock Finder run | 0.00| 0|-1 2019-06-25 07:37:44,319|FF|app-20190625073739-0126|5|4|START| 6.07|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:37:44,322|MF|app-20190625073739-0126|5|4|START| 6.07|A.Points indexed | 0.00| 0|0 2019-06-25 07:37:44,490|MF|app-20190625073739-0126|5|4| END| 6.24|A.Points indexed | 0.17| 18093|0 2019-06-25 07:37:44,490|MF|app-20190625073739-0126|5|4|START| 6.24|B.Pairs found | 0.00| 0|0 2019-06-25 07:37:45,813|MF|app-20190625073739-0126|5|4| END| 7.56|B.Pairs found | 1.32| 23893|0 2019-06-25 07:37:45,813|MF|app-20190625073739-0126|5|4|START| 7.56|C.Centers found | 0.00| 0|0 2019-06-25 07:37:46,591|MF|app-20190625073739-0126|5|4| END| 8.34|C.Centers found | 0.78| 47786|0 2019-06-25 07:37:46,591|MF|app-20190625073739-0126|5|4|START| 8.34|D.Disks found | 0.00| 0|0 2019-06-25 07:37:49,188|MF|app-20190625073739-0126|5|4| END| 10.94|D.Disks found | 2.60| 17451|0 2019-06-25 07:37:49,189|MF|app-20190625073739-0126|5|4|START| 10.94|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:37:50,034|MF|app-20190625073739-0126|5|4| END| 11.79|E.Disks partitioned | 0.85| 23231|0 2019-06-25 07:37:50,034|MF|app-20190625073739-0126|5|4|START| 11.79|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:37:50,035|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:37:50,035|Cell area: 1055533.7681000116 2019-06-25 07:37:51,914|MF|app-20190625073739-0126|5|4| END| 13.66|F.Maximal disks found | 1.88| 5681|0 2019-06-25 07:37:51,914|MAXIMALS|app-20190625073739-0126|4|5|80.0|3|450|7.592|5681 2019-06-25 07:37:52,425|FF|app-20190625073739-0126|5|4| END| 14.18|1.Maximal disks found | 8.11| 5681|0 2019-06-25 07:37:52,426|FF|app-20190625073739-0126|5|4|START| 14.18|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:37:52,426|MF|app-20190625073739-0126|5|4|START| 14.18|A.Points indexed | 0.00| 0|1 2019-06-25 07:37:52,503|MF|app-20190625073739-0126|5|4| END| 14.25|A.Points indexed | 0.08| 18245|1 2019-06-25 07:37:52,503|MF|app-20190625073739-0126|5|4|START| 14.25|B.Pairs found | 0.00| 0|1 2019-06-25 07:37:52,962|MF|app-20190625073739-0126|5|4| END| 14.71|B.Pairs found | 0.46| 24243|1 2019-06-25 07:37:52,962|MF|app-20190625073739-0126|5|4|START| 14.71|C.Centers found | 0.00| 0|1 2019-06-25 07:37:53,388|MF|app-20190625073739-0126|5|4| END| 15.14|C.Centers found | 0.43| 48486|1 2019-06-25 07:37:53,388|MF|app-20190625073739-0126|5|4|START| 15.14|D.Disks found | 0.00| 0|1 2019-06-25 07:37:55,149|MF|app-20190625073739-0126|5|4| END| 16.90|D.Disks found | 1.76| 17763|1 2019-06-25 07:37:55,150|MF|app-20190625073739-0126|5|4|START| 16.90|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:37:55,783|MF|app-20190625073739-0126|5|4| END| 17.53|E.Disks partitioned | 0.63| 23611|1 2019-06-25 07:37:55,783|MF|app-20190625073739-0126|5|4|START| 17.53|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:37:55,784|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:37:55,784|Cell area: 1055533.7681000116 2019-06-25 07:37:57,520|MF|app-20190625073739-0126|5|4| END| 19.27|F.Maximal disks found | 1.74| 5752|1 2019-06-25 07:37:57,520|MAXIMALS|app-20190625073739-0126|4|5|80.0|3|450|5.094|5752 2019-06-25 07:37:57,971|FF|app-20190625073739-0126|5|4| END| 19.72|1.Maximal disks found | 5.55| 5752|1 2019-06-25 07:37:57,971|FF|app-20190625073739-0126|5|4|START| 19.72|2.Join done | 0.00| 0|1 2019-06-25 07:37:59,691|FF|app-20190625073739-0126|5|4| END| 21.44|2.Join done | 1.72| 8996|1 2019-06-25 07:37:59,691|FF|app-20190625073739-0126|5|4|START| 21.44|3.Flocks to report | 0.00| 0|1 2019-06-25 07:38:00,053|FF|app-20190625073739-0126|5|4| END| 21.80|3.Flocks to report | 0.36| 0|1 2019-06-25 07:38:00,053|FF|app-20190625073739-0126|5|4|START| 21.80|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:38:00,093|FF|app-20190625073739-0126|5|4| END| 21.84|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 07:38:00,093|FF|app-20190625073739-0126|5|4|START| 21.84|5.Flocks reported | 0.00| 0|1 2019-06-25 07:38:00,098|FF|app-20190625073739-0126|5|4| END| 21.85|5.Flocks reported | 0.01| 0|1 2019-06-25 07:38:00,098|FF|app-20190625073739-0126|5|4|START| 21.85|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:38:01,143|FF|app-20190625073739-0126|5|4| END| 22.89|6.Candidates indexed | 1.04| 9351|1 2019-06-25 07:38:01,143|FF|app-20190625073739-0126|5|4|START| 22.89|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:38:01,143|MF|app-20190625073739-0126|5|4|START| 22.89|A.Points indexed | 0.00| 0|2 2019-06-25 07:38:01,208|MF|app-20190625073739-0126|5|4| END| 22.96|A.Points indexed | 0.07| 18394|2 2019-06-25 07:38:01,209|MF|app-20190625073739-0126|5|4|START| 22.96|B.Pairs found | 0.00| 0|2 2019-06-25 07:38:01,593|MF|app-20190625073739-0126|5|4| END| 23.34|B.Pairs found | 0.38| 24570|2 2019-06-25 07:38:01,593|MF|app-20190625073739-0126|5|4|START| 23.34|C.Centers found | 0.00| 0|2 2019-06-25 07:38:01,993|MF|app-20190625073739-0126|5|4| END| 23.74|C.Centers found | 0.40| 49140|2 2019-06-25 07:38:01,993|MF|app-20190625073739-0126|5|4|START| 23.74|D.Disks found | 0.00| 0|2 2019-06-25 07:38:03,809|MF|app-20190625073739-0126|5|4| END| 25.56|D.Disks found | 1.82| 18008|2 2019-06-25 07:38:03,810|MF|app-20190625073739-0126|5|4|START| 25.56|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:38:04,643|MF|app-20190625073739-0126|5|4| END| 26.39|E.Disks partitioned | 0.83| 23955|2 2019-06-25 07:38:04,643|MF|app-20190625073739-0126|5|4|START| 26.39|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:38:04,643|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:38:04,643|Cell area: 1055533.7681000116 2019-06-25 07:38:06,427|MF|app-20190625073739-0126|5|4| END| 28.18|F.Maximal disks found | 1.78| 5821|2 2019-06-25 07:38:06,427|MAXIMALS|app-20190625073739-0126|4|5|80.0|3|450|5.284|5821 2019-06-25 07:38:06,818|FF|app-20190625073739-0126|5|4| END| 28.57|1.Maximal disks found | 5.67| 5821|2 2019-06-25 07:38:06,818|FF|app-20190625073739-0126|5|4|START| 28.57|2.Join done | 0.00| 0|2 2019-06-25 07:38:09,602|FF|app-20190625073739-0126|5|4| END| 31.35|2.Join done | 2.78| 12766|2 2019-06-25 07:38:09,603|FF|app-20190625073739-0126|5|4|START| 31.35|3.Flocks to report | 0.00| 0|2 2019-06-25 07:38:10,137|FF|app-20190625073739-0126|5|4| END| 31.89|3.Flocks to report | 0.53| 11004|2 2019-06-25 07:38:10,137|FF|app-20190625073739-0126|5|4|START| 31.89|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:38:10,177|FF|app-20190625073739-0126|5|4|START| 31.93|4a.Making expansions | 0.00| 0|2 2019-06-25 07:38:10,686|FF|app-20190625073739-0126|5|4| END| 32.44|4a.Making expansions | 0.51| 13871|2 2019-06-25 07:38:10,686|FF|app-20190625073739-0126|5|4|START| 32.44|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:38:11,564|FF|app-20190625073739-0126|5|4| END| 33.32|4b.Finding maximals | 0.88| 4075|2 2019-06-25 07:38:11,748|FF|app-20190625073739-0126|5|4| END| 33.50|4.Flocks prunned by expansion | 1.61| 4075|2 2019-06-25 07:38:11,749|FF|app-20190625073739-0126|5|4|START| 33.50|5.Flocks reported | 0.00| 0|2 2019-06-25 07:38:12,022|FF|app-20190625073739-0126|5|4| END| 33.77|5.Flocks reported | 0.27| 4075|2 2019-06-25 07:38:12,022|FF|app-20190625073739-0126|5|4|START| 33.77|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:38:13,257|FF|app-20190625073739-0126|5|4| END| 35.01|6.Candidates indexed | 1.24| 6197|2 2019-06-25 07:38:13,257|FF|app-20190625073739-0126|5|4|START| 35.01|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:38:13,257|MF|app-20190625073739-0126|5|4|START| 35.01|A.Points indexed | 0.00| 0|3 2019-06-25 07:38:13,321|MF|app-20190625073739-0126|5|4| END| 35.07|A.Points indexed | 0.06| 18548|3 2019-06-25 07:38:13,321|MF|app-20190625073739-0126|5|4|START| 35.07|B.Pairs found | 0.00| 0|3 2019-06-25 07:38:13,908|MF|app-20190625073739-0126|5|4| END| 35.66|B.Pairs found | 0.59| 24957|3 2019-06-25 07:38:13,908|MF|app-20190625073739-0126|5|4|START| 35.66|C.Centers found | 0.00| 0|3 2019-06-25 07:38:14,511|MF|app-20190625073739-0126|5|4| END| 36.26|C.Centers found | 0.60| 49914|3 2019-06-25 07:38:14,511|MF|app-20190625073739-0126|5|4|START| 36.26|D.Disks found | 0.00| 0|3 2019-06-25 07:38:17,195|MF|app-20190625073739-0126|5|4| END| 38.95|D.Disks found | 2.68| 18310|3 2019-06-25 07:38:17,195|MF|app-20190625073739-0126|5|4|START| 38.95|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:38:17,901|MF|app-20190625073739-0126|5|4| END| 39.65|E.Disks partitioned | 0.71| 24367|3 2019-06-25 07:38:17,901|MF|app-20190625073739-0126|5|4|START| 39.65|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:38:17,901|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:38:17,901|Cell area: 1055533.7681000116 2019-06-25 07:38:19,962|MF|app-20190625073739-0126|5|4| END| 41.71|F.Maximal disks found | 2.06| 5926|3 2019-06-25 07:38:19,962|MAXIMALS|app-20190625073739-0126|4|5|80.0|3|450|6.705|5926 2019-06-25 07:38:20,389|FF|app-20190625073739-0126|5|4| END| 42.14|1.Maximal disks found | 7.13| 5926|3 2019-06-25 07:38:20,389|FF|app-20190625073739-0126|5|4|START| 42.14|2.Join done | 0.00| 0|3 2019-06-25 07:38:22,558|FF|app-20190625073739-0126|5|4| END| 44.31|2.Join done | 2.17| 12337|3 2019-06-25 07:38:22,558|FF|app-20190625073739-0126|5|4|START| 44.31|3.Flocks to report | 0.00| 0|3 2019-06-25 07:38:23,039|FF|app-20190625073739-0126|5|4| END| 44.79|3.Flocks to report | 0.48| 10340|3 2019-06-25 07:38:23,039|FF|app-20190625073739-0126|5|4|START| 44.79|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:38:23,082|FF|app-20190625073739-0126|5|4|START| 44.83|4a.Making expansions | 0.00| 0|3 2019-06-25 07:38:23,582|FF|app-20190625073739-0126|5|4| END| 45.33|4a.Making expansions | 0.50| 13282|3 2019-06-25 07:38:23,582|FF|app-20190625073739-0126|5|4|START| 45.33|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:38:24,156|FF|app-20190625073739-0126|5|4| END| 45.91|4b.Finding maximals | 0.57| 4128|3 2019-06-25 07:38:24,335|FF|app-20190625073739-0126|5|4| END| 46.09|4.Flocks prunned by expansion | 1.30| 4128|3 2019-06-25 07:38:24,335|FF|app-20190625073739-0126|5|4|START| 46.09|5.Flocks reported | 0.00| 0|3 2019-06-25 07:38:24,612|FF|app-20190625073739-0126|5|4| END| 46.36|5.Flocks reported | 0.28| 4128|3 2019-06-25 07:38:24,612|FF|app-20190625073739-0126|5|4|START| 46.36|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:38:25,886|FF|app-20190625073739-0126|5|4| END| 47.64|6.Candidates indexed | 1.27| 6487|3 2019-06-25 07:38:26,520|Number of flocks: 8203 2019-06-25 07:38:26,877|PFLOCK|app-20190625073739-0126|4|5|80.0|3|3|42.22|8203 2019-06-25 07:38:27,238|FF|app-20190625073739-0126|5|4| END| 48.99|Flock Finder run | 42.94| 8203|3 2019-06-25 07:38:27,239|FF|app-20190625073739-0126|5|4|START| 48.99|Session closed | 0.00| 0|3 2019-06-25 07:38:34,167|FF|app-20190625073739-0126|5|4| END| 55.92|Session closed | 6.93| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:38:36,110|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:38:37,226|FF|app-20190625073836-0127|15|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 07:38:37,227|FF|app-20190625073836-0127|15|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 07:38:41,653|FF|app-20190625073836-0127|15|4| END| 5.53|Data read | 4.43|331128|-1 2019-06-25 07:38:41,654|FF|app-20190625073836-0127|15|4|START| 5.53|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:38:41,846|FF|app-20190625073836-0127|15|4| END| 5.72|KDBTree partitioner | 0.19| 816|-1 2019-06-25 07:38:41,847|FF|app-20190625073836-0127|15|4|START| 5.72|MF partitioner | 0.00| 0|-1 2019-06-25 07:38:41,870|FF|app-20190625073836-0127|15|4| END| 5.74|MF partitioner | 0.02| 1350|-1 2019-06-25 07:38:41,870|FF|app-20190625073836-0127|15|4|START| 5.74|Pointset done | 0.00| 0|-1 2019-06-25 07:38:42,858|FF|app-20190625073836-0127|15|4| END| 6.73|Pointset done | 0.99| 4|-1 2019-06-25 07:38:42,858|FF|app-20190625073836-0127|15|4|START| 6.73|Flock Finder run | 0.00| 0|-1 2019-06-25 07:38:42,876|FF|app-20190625073836-0127|15|4|START| 6.75|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:38:42,879|MF|app-20190625073836-0127|15|4|START| 6.75|A.Points indexed | 0.00| 0|0 2019-06-25 07:38:43,122|MF|app-20190625073836-0127|15|4| END| 7.00|A.Points indexed | 0.24| 54279|0 2019-06-25 07:38:43,122|MF|app-20190625073836-0127|15|4|START| 7.00|B.Pairs found | 0.00| 0|0 2019-06-25 07:38:45,224|MF|app-20190625073836-0127|15|4| END| 9.10|B.Pairs found | 2.10| 86157|0 2019-06-25 07:38:45,224|MF|app-20190625073836-0127|15|4|START| 9.10|C.Centers found | 0.00| 0|0 2019-06-25 07:38:47,004|MF|app-20190625073836-0127|15|4| END| 10.88|C.Centers found | 1.78|172314|0 2019-06-25 07:38:47,004|MF|app-20190625073836-0127|15|4|START| 10.88|D.Disks found | 0.00| 0|0 2019-06-25 07:38:54,424|MF|app-20190625073836-0127|15|4| END| 18.30|D.Disks found | 7.42| 67818|0 2019-06-25 07:38:54,424|MF|app-20190625073836-0127|15|4|START| 18.30|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:38:56,164|MF|app-20190625073836-0127|15|4| END| 20.04|E.Disks partitioned | 1.74| 93058|0 2019-06-25 07:38:56,165|MF|app-20190625073836-0127|15|4|START| 20.04|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:38:56,167|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:38:56,168|Cell area: 1055533.7681000116 2019-06-25 07:39:00,563|MF|app-20190625073836-0127|15|4| END| 24.44|F.Maximal disks found | 4.40| 20937|0 2019-06-25 07:39:00,564|MAXIMALS|app-20190625073836-0127|4|15|90.0|3|1350|17.685|20937 2019-06-25 07:39:01,605|FF|app-20190625073836-0127|15|4| END| 25.48|1.Maximal disks found | 18.73| 20937|0 2019-06-25 07:39:01,605|FF|app-20190625073836-0127|15|4|START| 25.48|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:39:01,605|MF|app-20190625073836-0127|15|4|START| 25.48|A.Points indexed | 0.00| 0|1 2019-06-25 07:39:01,755|MF|app-20190625073836-0127|15|4| END| 25.63|A.Points indexed | 0.15| 54735|1 2019-06-25 07:39:01,755|MF|app-20190625073836-0127|15|4|START| 25.63|B.Pairs found | 0.00| 0|1 2019-06-25 07:39:03,080|MF|app-20190625073836-0127|15|4| END| 26.95|B.Pairs found | 1.33| 87324|1 2019-06-25 07:39:03,081|MF|app-20190625073836-0127|15|4|START| 26.95|C.Centers found | 0.00| 0|1 2019-06-25 07:39:04,829|MF|app-20190625073836-0127|15|4| END| 28.70|C.Centers found | 1.75|174648|1 2019-06-25 07:39:04,829|MF|app-20190625073836-0127|15|4|START| 28.70|D.Disks found | 0.00| 0|1 2019-06-25 07:39:11,628|MF|app-20190625073836-0127|15|4| END| 35.50|D.Disks found | 6.80| 68973|1 2019-06-25 07:39:11,628|MF|app-20190625073836-0127|15|4|START| 35.50|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:39:13,235|MF|app-20190625073836-0127|15|4| END| 37.11|E.Disks partitioned | 1.61| 94410|1 2019-06-25 07:39:13,236|MF|app-20190625073836-0127|15|4|START| 37.11|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:39:13,236|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:39:13,236|Cell area: 1055533.7681000116 2019-06-25 07:39:17,461|MF|app-20190625073836-0127|15|4| END| 41.33|F.Maximal disks found | 4.23| 21134|1 2019-06-25 07:39:17,462|MAXIMALS|app-20190625073836-0127|4|15|90.0|3|1350|15.857|21134 2019-06-25 07:39:18,521|FF|app-20190625073836-0127|15|4| END| 42.39|1.Maximal disks found | 16.92| 21134|1 2019-06-25 07:39:18,521|FF|app-20190625073836-0127|15|4|START| 42.39|2.Join done | 0.00| 0|1 2019-06-25 07:39:21,203|FF|app-20190625073836-0127|15|4| END| 45.08|2.Join done | 2.68| 37959|1 2019-06-25 07:39:21,203|FF|app-20190625073836-0127|15|4|START| 45.08|3.Flocks to report | 0.00| 0|1 2019-06-25 07:39:21,737|FF|app-20190625073836-0127|15|4| END| 45.61|3.Flocks to report | 0.53| 0|1 2019-06-25 07:39:21,737|FF|app-20190625073836-0127|15|4|START| 45.61|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:39:21,811|FF|app-20190625073836-0127|15|4| END| 45.68|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 07:39:21,811|FF|app-20190625073836-0127|15|4|START| 45.68|5.Flocks reported | 0.00| 0|1 2019-06-25 07:39:21,816|FF|app-20190625073836-0127|15|4| END| 45.69|5.Flocks reported | 0.01| 0|1 2019-06-25 07:39:21,816|FF|app-20190625073836-0127|15|4|START| 45.69|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:39:23,188|FF|app-20190625073836-0127|15|4| END| 47.06|6.Candidates indexed | 1.37| 39178|1 2019-06-25 07:39:23,189|FF|app-20190625073836-0127|15|4|START| 47.06|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:39:23,189|MF|app-20190625073836-0127|15|4|START| 47.06|A.Points indexed | 0.00| 0|2 2019-06-25 07:39:23,312|MF|app-20190625073836-0127|15|4| END| 47.18|A.Points indexed | 0.12| 55182|2 2019-06-25 07:39:23,312|MF|app-20190625073836-0127|15|4|START| 47.19|B.Pairs found | 0.00| 0|2 2019-06-25 07:39:24,186|MF|app-20190625073836-0127|15|4| END| 48.06|B.Pairs found | 0.87| 88509|2 2019-06-25 07:39:24,186|MF|app-20190625073836-0127|15|4|START| 48.06|C.Centers found | 0.00| 0|2 2019-06-25 07:39:25,505|MF|app-20190625073836-0127|15|4| END| 49.38|C.Centers found | 1.32|177018|2 2019-06-25 07:39:25,506|MF|app-20190625073836-0127|15|4|START| 49.38|D.Disks found | 0.00| 0|2 2019-06-25 07:39:29,183|MF|app-20190625073836-0127|15|4| END| 53.06|D.Disks found | 3.68| 69927|2 2019-06-25 07:39:29,184|MF|app-20190625073836-0127|15|4|START| 53.06|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:39:30,027|MF|app-20190625073836-0127|15|4| END| 53.90|E.Disks partitioned | 0.84| 95823|2 2019-06-25 07:39:30,027|MF|app-20190625073836-0127|15|4|START| 53.90|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:39:30,028|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:39:30,028|Cell area: 1055533.7681000116 2019-06-25 07:39:34,221|MF|app-20190625073836-0127|15|4| END| 58.09|F.Maximal disks found | 4.19| 21483|2 2019-06-25 07:39:34,221|MAXIMALS|app-20190625073836-0127|4|15|90.0|3|1350|11.032|21483 2019-06-25 07:39:35,234|FF|app-20190625073836-0127|15|4| END| 59.11|1.Maximal disks found | 12.05| 21483|2 2019-06-25 07:39:35,234|FF|app-20190625073836-0127|15|4|START| 59.11|2.Join done | 0.00| 0|2 2019-06-25 07:39:41,539|FF|app-20190625073836-0127|15|4| END| 65.41|2.Join done | 6.30| 60752|2 2019-06-25 07:39:41,539|FF|app-20190625073836-0127|15|4|START| 65.41|3.Flocks to report | 0.00| 0|2 2019-06-25 07:39:42,914|FF|app-20190625073836-0127|15|4| END| 66.79|3.Flocks to report | 1.38| 52714|2 2019-06-25 07:39:42,914|FF|app-20190625073836-0127|15|4|START| 66.79|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:39:42,991|FF|app-20190625073836-0127|15|4|START| 66.86|4a.Making expansions | 0.00| 0|2 2019-06-25 07:39:43,922|FF|app-20190625073836-0127|15|4| END| 67.80|4a.Making expansions | 0.93| 65690|2 2019-06-25 07:39:43,922|FF|app-20190625073836-0127|15|4|START| 67.80|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:39:46,961|FF|app-20190625073836-0127|15|4| END| 70.83|4b.Finding maximals | 3.04| 14592|2 2019-06-25 07:39:47,416|FF|app-20190625073836-0127|15|4| END| 71.29|4.Flocks prunned by expansion | 4.50| 14592|2 2019-06-25 07:39:47,416|FF|app-20190625073836-0127|15|4|START| 71.29|5.Flocks reported | 0.00| 0|2 2019-06-25 07:39:48,029|FF|app-20190625073836-0127|15|4| END| 71.90|5.Flocks reported | 0.61| 14592|2 2019-06-25 07:39:48,029|FF|app-20190625073836-0127|15|4|START| 71.90|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:39:49,667|FF|app-20190625073836-0127|15|4| END| 73.54|6.Candidates indexed | 1.64| 23966|2 2019-06-25 07:39:49,667|FF|app-20190625073836-0127|15|4|START| 73.54|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:39:49,667|MF|app-20190625073836-0127|15|4|START| 73.54|A.Points indexed | 0.00| 0|3 2019-06-25 07:39:49,786|MF|app-20190625073836-0127|15|4| END| 73.66|A.Points indexed | 0.12| 55644|3 2019-06-25 07:39:49,786|MF|app-20190625073836-0127|15|4|START| 73.66|B.Pairs found | 0.00| 0|3 2019-06-25 07:39:50,566|MF|app-20190625073836-0127|15|4| END| 74.44|B.Pairs found | 0.78| 90000|3 2019-06-25 07:39:50,566|MF|app-20190625073836-0127|15|4|START| 74.44|C.Centers found | 0.00| 0|3 2019-06-25 07:39:51,515|MF|app-20190625073836-0127|15|4| END| 75.39|C.Centers found | 0.95|180000|3 2019-06-25 07:39:51,515|MF|app-20190625073836-0127|15|4|START| 75.39|D.Disks found | 0.00| 0|3 2019-06-25 07:39:58,733|MF|app-20190625073836-0127|15|4| END| 82.61|D.Disks found | 7.22| 71127|3 2019-06-25 07:39:58,733|MF|app-20190625073836-0127|15|4|START| 82.61|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:40:01,391|MF|app-20190625073836-0127|15|4| END| 85.26|E.Disks partitioned | 2.66| 97462|3 2019-06-25 07:40:01,391|MF|app-20190625073836-0127|15|4|START| 85.26|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:40:01,392|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:40:01,392|Cell area: 1055533.7681000116 2019-06-25 07:40:06,239|MF|app-20190625073836-0127|15|4| END| 90.11|F.Maximal disks found | 4.85| 21988|3 2019-06-25 07:40:06,239|MAXIMALS|app-20190625073836-0127|4|15|90.0|3|1350|16.572|21988 2019-06-25 07:40:07,273|FF|app-20190625073836-0127|15|4| END| 91.15|1.Maximal disks found | 17.61| 21988|3 2019-06-25 07:40:07,273|FF|app-20190625073836-0127|15|4|START| 91.15|2.Join done | 0.00| 0|3 2019-06-25 07:40:12,988|FF|app-20190625073836-0127|15|4| END| 96.86|2.Join done | 5.72| 56920|3 2019-06-25 07:40:12,989|FF|app-20190625073836-0127|15|4|START| 96.86|3.Flocks to report | 0.00| 0|3 2019-06-25 07:40:14,632|FF|app-20190625073836-0127|15|4| END| 98.51|3.Flocks to report | 1.64| 48322|3 2019-06-25 07:40:14,632|FF|app-20190625073836-0127|15|4|START| 98.51|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:40:14,749|FF|app-20190625073836-0127|15|4|START| 98.62|4a.Making expansions | 0.00| 0|3 2019-06-25 07:40:15,709|FF|app-20190625073836-0127|15|4| END| 99.58|4a.Making expansions | 0.96| 61602|3 2019-06-25 07:40:15,709|FF|app-20190625073836-0127|15|4|START| 99.58|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:40:17,894|FF|app-20190625073836-0127|15|4| END|101.77|4b.Finding maximals | 2.19| 14847|3 2019-06-25 07:40:18,375|FF|app-20190625073836-0127|15|4| END|102.25|4.Flocks prunned by expansion | 3.74| 14847|3 2019-06-25 07:40:18,375|FF|app-20190625073836-0127|15|4|START|102.25|5.Flocks reported | 0.00| 0|3 2019-06-25 07:40:18,966|FF|app-20190625073836-0127|15|4| END|102.84|5.Flocks reported | 0.59| 14847|3 2019-06-25 07:40:18,966|FF|app-20190625073836-0127|15|4|START|102.84|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:40:20,731|FF|app-20190625073836-0127|15|4| END|104.60|6.Candidates indexed | 1.77| 24850|3 2019-06-25 07:40:22,045|Number of flocks: 29439 2019-06-25 07:40:22,984|PFLOCK|app-20190625073836-0127|4|15|90.0|3|3|99.19|29439 2019-06-25 07:40:23,951|FF|app-20190625073836-0127|15|4| END|107.82|Flock Finder run |101.09| 29439|3 2019-06-25 07:40:23,951|FF|app-20190625073836-0127|15|4|START|107.82|Session closed | 0.00| 0|3 2019-06-25 07:40:32,844|FF|app-20190625073836-0127|15|4| END|116.72|Session closed | 8.89| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:40:34,833|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:40:35,958|FF|app-20190625074035-0128|10|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 07:40:35,958|FF|app-20190625074035-0128|10|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 07:40:40,144|FF|app-20190625074035-0128|10|4| END| 5.30|Data read | 4.19|220752|-1 2019-06-25 07:40:40,144|FF|app-20190625074035-0128|10|4|START| 5.30|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:40:40,285|FF|app-20190625074035-0128|10|4| END| 5.44|KDBTree partitioner | 0.14| 544|-1 2019-06-25 07:40:40,285|FF|app-20190625074035-0128|10|4|START| 5.44|MF partitioner | 0.00| 0|-1 2019-06-25 07:40:40,303|FF|app-20190625074035-0128|10|4| END| 5.45|MF partitioner | 0.02| 900|-1 2019-06-25 07:40:40,303|FF|app-20190625074035-0128|10|4|START| 5.45|Pointset done | 0.00| 0|-1 2019-06-25 07:40:41,232|FF|app-20190625074035-0128|10|4| END| 6.38|Pointset done | 0.93| 4|-1 2019-06-25 07:40:41,232|FF|app-20190625074035-0128|10|4|START| 6.38|Flock Finder run | 0.00| 0|-1 2019-06-25 07:40:41,249|FF|app-20190625074035-0128|10|4|START| 6.40|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:40:41,251|MF|app-20190625074035-0128|10|4|START| 6.40|A.Points indexed | 0.00| 0|0 2019-06-25 07:40:41,419|MF|app-20190625074035-0128|10|4| END| 6.57|A.Points indexed | 0.17| 36186|0 2019-06-25 07:40:41,420|MF|app-20190625074035-0128|10|4|START| 6.57|B.Pairs found | 0.00| 0|0 2019-06-25 07:40:43,593|MF|app-20190625074035-0128|10|4| END| 8.74|B.Pairs found | 2.17| 57438|0 2019-06-25 07:40:43,594|MF|app-20190625074035-0128|10|4|START| 8.75|C.Centers found | 0.00| 0|0 2019-06-25 07:40:45,594|MF|app-20190625074035-0128|10|4| END| 10.75|C.Centers found | 2.00|114876|0 2019-06-25 07:40:45,594|MF|app-20190625074035-0128|10|4|START| 10.75|D.Disks found | 0.00| 0|0 2019-06-25 07:40:53,434|MF|app-20190625074035-0128|10|4| END| 18.59|D.Disks found | 7.84| 45212|0 2019-06-25 07:40:53,434|MF|app-20190625074035-0128|10|4|START| 18.59|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:40:57,090|MF|app-20190625074035-0128|10|4| END| 22.24|E.Disks partitioned | 3.66| 62040|0 2019-06-25 07:40:57,090|MF|app-20190625074035-0128|10|4|START| 22.24|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:40:57,093|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:40:57,093|Cell area: 1055533.7681000116 2019-06-25 07:41:03,091|MF|app-20190625074035-0128|10|4| END| 28.24|F.Maximal disks found | 6.00| 13955|0 2019-06-25 07:41:03,092|MAXIMALS|app-20190625074035-0128|4|10|90.0|3|900|21.841|13955 2019-06-25 07:41:04,693|FF|app-20190625074035-0128|10|4| END| 29.84|1.Maximal disks found | 23.44| 13955|0 2019-06-25 07:41:04,693|FF|app-20190625074035-0128|10|4|START| 29.84|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:41:04,693|MF|app-20190625074035-0128|10|4|START| 29.84|A.Points indexed | 0.00| 0|1 2019-06-25 07:41:04,791|MF|app-20190625074035-0128|10|4| END| 29.94|A.Points indexed | 0.10| 36490|1 2019-06-25 07:41:04,792|MF|app-20190625074035-0128|10|4|START| 29.94|B.Pairs found | 0.00| 0|1 2019-06-25 07:41:05,734|MF|app-20190625074035-0128|10|4| END| 30.89|B.Pairs found | 0.94| 58216|1 2019-06-25 07:41:05,734|MF|app-20190625074035-0128|10|4|START| 30.89|C.Centers found | 0.00| 0|1 2019-06-25 07:41:07,321|MF|app-20190625074035-0128|10|4| END| 32.47|C.Centers found | 1.59|116432|1 2019-06-25 07:41:07,321|MF|app-20190625074035-0128|10|4|START| 32.47|D.Disks found | 0.00| 0|1 2019-06-25 07:41:11,836|MF|app-20190625074035-0128|10|4| END| 36.99|D.Disks found | 4.52| 45982|1 2019-06-25 07:41:11,836|MF|app-20190625074035-0128|10|4|START| 36.99|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:41:13,916|MF|app-20190625074035-0128|10|4| END| 39.07|E.Disks partitioned | 2.08| 62923|1 2019-06-25 07:41:13,916|MF|app-20190625074035-0128|10|4|START| 39.07|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:41:13,917|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:41:13,917|Cell area: 1055533.7681000116 2019-06-25 07:41:18,500|MF|app-20190625074035-0128|10|4| END| 43.65|F.Maximal disks found | 4.58| 14084|1 2019-06-25 07:41:18,500|MAXIMALS|app-20190625074035-0128|4|10|90.0|3|900|13.807|14084 2019-06-25 07:41:19,419|FF|app-20190625074035-0128|10|4| END| 44.57|1.Maximal disks found | 14.73| 14084|1 2019-06-25 07:41:19,419|FF|app-20190625074035-0128|10|4|START| 44.57|2.Join done | 0.00| 0|1 2019-06-25 07:41:24,476|FF|app-20190625074035-0128|10|4| END| 49.63|2.Join done | 5.06| 25295|1 2019-06-25 07:41:24,476|FF|app-20190625074035-0128|10|4|START| 49.63|3.Flocks to report | 0.00| 0|1 2019-06-25 07:41:25,291|FF|app-20190625074035-0128|10|4| END| 50.44|3.Flocks to report | 0.82| 0|1 2019-06-25 07:41:25,292|FF|app-20190625074035-0128|10|4|START| 50.44|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:41:25,353|FF|app-20190625074035-0128|10|4| END| 50.50|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 07:41:25,354|FF|app-20190625074035-0128|10|4|START| 50.51|5.Flocks reported | 0.00| 0|1 2019-06-25 07:41:25,358|FF|app-20190625074035-0128|10|4| END| 50.51|5.Flocks reported | 0.00| 0|1 2019-06-25 07:41:25,358|FF|app-20190625074035-0128|10|4|START| 50.51|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:41:27,210|FF|app-20190625074035-0128|10|4| END| 52.36|6.Candidates indexed | 1.85| 26108|1 2019-06-25 07:41:27,210|FF|app-20190625074035-0128|10|4|START| 52.36|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:41:27,210|MF|app-20190625074035-0128|10|4|START| 52.36|A.Points indexed | 0.00| 0|2 2019-06-25 07:41:27,301|MF|app-20190625074035-0128|10|4| END| 52.45|A.Points indexed | 0.09| 36788|2 2019-06-25 07:41:27,302|MF|app-20190625074035-0128|10|4|START| 52.45|B.Pairs found | 0.00| 0|2 2019-06-25 07:41:28,033|MF|app-20190625074035-0128|10|4| END| 53.18|B.Pairs found | 0.73| 59006|2 2019-06-25 07:41:28,033|MF|app-20190625074035-0128|10|4|START| 53.18|C.Centers found | 0.00| 0|2 2019-06-25 07:41:29,074|MF|app-20190625074035-0128|10|4| END| 54.23|C.Centers found | 1.04|118012|2 2019-06-25 07:41:29,075|MF|app-20190625074035-0128|10|4|START| 54.23|D.Disks found | 0.00| 0|2 2019-06-25 07:41:32,942|MF|app-20190625074035-0128|10|4| END| 58.09|D.Disks found | 3.87| 46618|2 2019-06-25 07:41:32,943|MF|app-20190625074035-0128|10|4|START| 58.09|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:41:34,418|MF|app-20190625074035-0128|10|4| END| 59.57|E.Disks partitioned | 1.48| 63871|2 2019-06-25 07:41:34,418|MF|app-20190625074035-0128|10|4|START| 59.57|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:41:34,419|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:41:34,419|Cell area: 1055533.7681000116 2019-06-25 07:41:39,000|MF|app-20190625074035-0128|10|4| END| 64.15|F.Maximal disks found | 4.58| 14320|2 2019-06-25 07:41:39,000|MAXIMALS|app-20190625074035-0128|4|10|90.0|3|900|11.79|14320 2019-06-25 07:41:39,744|FF|app-20190625074035-0128|10|4| END| 64.90|1.Maximal disks found | 12.53| 14320|2 2019-06-25 07:41:39,744|FF|app-20190625074035-0128|10|4|START| 64.90|2.Join done | 0.00| 0|2 2019-06-25 07:41:45,459|FF|app-20190625074035-0128|10|4| END| 70.61|2.Join done | 5.72| 40482|2 2019-06-25 07:41:45,459|FF|app-20190625074035-0128|10|4|START| 70.61|3.Flocks to report | 0.00| 0|2 2019-06-25 07:41:46,390|FF|app-20190625074035-0128|10|4| END| 71.54|3.Flocks to report | 0.93| 35128|2 2019-06-25 07:41:46,390|FF|app-20190625074035-0128|10|4|START| 71.54|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:41:46,444|FF|app-20190625074035-0128|10|4|START| 71.60|4a.Making expansions | 0.00| 0|2 2019-06-25 07:41:47,249|FF|app-20190625074035-0128|10|4| END| 72.40|4a.Making expansions | 0.81| 43822|2 2019-06-25 07:41:47,249|FF|app-20190625074035-0128|10|4|START| 72.40|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:41:50,365|FF|app-20190625074035-0128|10|4| END| 75.52|4b.Finding maximals | 3.12| 9728|2 2019-06-25 07:41:50,677|FF|app-20190625074035-0128|10|4| END| 75.83|4.Flocks prunned by expansion | 4.29| 9728|2 2019-06-25 07:41:50,677|FF|app-20190625074035-0128|10|4|START| 75.83|5.Flocks reported | 0.00| 0|2 2019-06-25 07:41:51,105|FF|app-20190625074035-0128|10|4| END| 76.26|5.Flocks reported | 0.43| 9728|2 2019-06-25 07:41:51,105|FF|app-20190625074035-0128|10|4|START| 76.26|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:41:52,619|FF|app-20190625074035-0128|10|4| END| 77.77|6.Candidates indexed | 1.51| 15972|2 2019-06-25 07:41:52,619|FF|app-20190625074035-0128|10|4|START| 77.77|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:41:52,619|MF|app-20190625074035-0128|10|4|START| 77.77|A.Points indexed | 0.00| 0|3 2019-06-25 07:41:52,710|MF|app-20190625074035-0128|10|4| END| 77.86|A.Points indexed | 0.09| 37096|3 2019-06-25 07:41:52,710|MF|app-20190625074035-0128|10|4|START| 77.86|B.Pairs found | 0.00| 0|3 2019-06-25 07:41:53,295|MF|app-20190625074035-0128|10|4| END| 78.45|B.Pairs found | 0.59| 60000|3 2019-06-25 07:41:53,295|MF|app-20190625074035-0128|10|4|START| 78.45|C.Centers found | 0.00| 0|3 2019-06-25 07:41:54,041|MF|app-20190625074035-0128|10|4| END| 79.19|C.Centers found | 0.75|120000|3 2019-06-25 07:41:54,041|MF|app-20190625074035-0128|10|4|START| 79.19|D.Disks found | 0.00| 0|3 2019-06-25 07:41:57,789|MF|app-20190625074035-0128|10|4| END| 82.94|D.Disks found | 3.75| 47418|3 2019-06-25 07:41:57,790|MF|app-20190625074035-0128|10|4|START| 82.94|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:41:59,664|MF|app-20190625074035-0128|10|4| END| 84.82|E.Disks partitioned | 1.87| 64956|3 2019-06-25 07:41:59,664|MF|app-20190625074035-0128|10|4|START| 84.82|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:41:59,664|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:41:59,664|Cell area: 1055533.7681000116 2019-06-25 07:42:04,851|MF|app-20190625074035-0128|10|4| END| 90.00|F.Maximal disks found | 5.19| 14656|3 2019-06-25 07:42:04,851|MAXIMALS|app-20190625074035-0128|4|10|90.0|3|900|12.232|14656 2019-06-25 07:42:05,722|FF|app-20190625074035-0128|10|4| END| 90.87|1.Maximal disks found | 13.10| 14656|3 2019-06-25 07:42:05,722|FF|app-20190625074035-0128|10|4|START| 90.87|2.Join done | 0.00| 0|3 2019-06-25 07:42:11,011|FF|app-20190625074035-0128|10|4| END| 96.16|2.Join done | 5.29| 37923|3 2019-06-25 07:42:11,012|FF|app-20190625074035-0128|10|4|START| 96.16|3.Flocks to report | 0.00| 0|3 2019-06-25 07:42:12,146|FF|app-20190625074035-0128|10|4| END| 97.30|3.Flocks to report | 1.13| 32203|3 2019-06-25 07:42:12,146|FF|app-20190625074035-0128|10|4|START| 97.30|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:42:12,209|FF|app-20190625074035-0128|10|4|START| 97.36|4a.Making expansions | 0.00| 0|3 2019-06-25 07:42:13,348|FF|app-20190625074035-0128|10|4| END| 98.50|4a.Making expansions | 1.14| 41028|3 2019-06-25 07:42:13,349|FF|app-20190625074035-0128|10|4|START| 98.50|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:42:15,866|FF|app-20190625074035-0128|10|4| END|101.02|4b.Finding maximals | 2.52| 9898|3 2019-06-25 07:42:16,283|FF|app-20190625074035-0128|10|4| END|101.43|4.Flocks prunned by expansion | 4.14| 9898|3 2019-06-25 07:42:16,283|FF|app-20190625074035-0128|10|4|START|101.43|5.Flocks reported | 0.00| 0|3 2019-06-25 07:42:16,869|FF|app-20190625074035-0128|10|4| END|102.02|5.Flocks reported | 0.59| 9898|3 2019-06-25 07:42:16,869|FF|app-20190625074035-0128|10|4|START|102.02|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:42:18,863|FF|app-20190625074035-0128|10|4| END|104.01|6.Candidates indexed | 1.99| 16555|3 2019-06-25 07:42:20,090|Number of flocks: 19626 2019-06-25 07:42:20,859|PFLOCK|app-20190625074035-0128|4|10|90.0|3|3|98.86|19626 2019-06-25 07:42:21,617|FF|app-20190625074035-0128|10|4| END|106.77|Flock Finder run |100.39| 19626|3 2019-06-25 07:42:21,617|FF|app-20190625074035-0128|10|4|START|106.77|Session closed | 0.00| 0|3 2019-06-25 07:42:28,289|FF|app-20190625074035-0128|10|4| END|113.44|Session closed | 6.67| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:42:30,244|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:42:31,398|FF|app-20190625074231-0129|5|4| END| 1.14|Session start | 1.16| 0|-1 2019-06-25 07:42:31,398|FF|app-20190625074231-0129|5|4|START| 1.14|Data read | 0.00| 0|-1 2019-06-25 07:42:35,380|FF|app-20190625074231-0129|5|4| END| 5.12|Data read | 3.98|110376|-1 2019-06-25 07:42:35,381|FF|app-20190625074231-0129|5|4|START| 5.12|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:42:35,505|FF|app-20190625074231-0129|5|4| END| 5.24|KDBTree partitioner | 0.12| 272|-1 2019-06-25 07:42:35,505|FF|app-20190625074231-0129|5|4|START| 5.24|MF partitioner | 0.00| 0|-1 2019-06-25 07:42:35,518|FF|app-20190625074231-0129|5|4| END| 5.26|MF partitioner | 0.01| 450|-1 2019-06-25 07:42:35,518|FF|app-20190625074231-0129|5|4|START| 5.26|Pointset done | 0.00| 0|-1 2019-06-25 07:42:36,325|FF|app-20190625074231-0129|5|4| END| 6.06|Pointset done | 0.81| 4|-1 2019-06-25 07:42:36,325|FF|app-20190625074231-0129|5|4|START| 6.06|Flock Finder run | 0.00| 0|-1 2019-06-25 07:42:36,475|FF|app-20190625074231-0129|5|4|START| 6.21|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:42:36,479|MF|app-20190625074231-0129|5|4|START| 6.22|A.Points indexed | 0.00| 0|0 2019-06-25 07:42:36,664|MF|app-20190625074231-0129|5|4| END| 6.40|A.Points indexed | 0.19| 18093|0 2019-06-25 07:42:36,664|MF|app-20190625074231-0129|5|4|START| 6.40|B.Pairs found | 0.00| 0|0 2019-06-25 07:42:38,055|MF|app-20190625074231-0129|5|4| END| 7.79|B.Pairs found | 1.39| 28719|0 2019-06-25 07:42:38,055|MF|app-20190625074231-0129|5|4|START| 7.79|C.Centers found | 0.00| 0|0 2019-06-25 07:42:38,790|MF|app-20190625074231-0129|5|4| END| 8.53|C.Centers found | 0.74| 57438|0 2019-06-25 07:42:38,791|MF|app-20190625074231-0129|5|4|START| 8.53|D.Disks found | 0.00| 0|0 2019-06-25 07:42:41,611|MF|app-20190625074231-0129|5|4| END| 11.35|D.Disks found | 2.82| 22606|0 2019-06-25 07:42:41,611|MF|app-20190625074231-0129|5|4|START| 11.35|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:42:42,515|MF|app-20190625074231-0129|5|4| END| 12.25|E.Disks partitioned | 0.90| 31017|0 2019-06-25 07:42:42,515|MF|app-20190625074231-0129|5|4|START| 12.25|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:42:42,517|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:42:42,517|Cell area: 1055533.7681000116 2019-06-25 07:42:46,888|MF|app-20190625074231-0129|5|4| END| 16.63|F.Maximal disks found | 4.37| 6974|0 2019-06-25 07:42:46,888|MAXIMALS|app-20190625074231-0129|4|5|90.0|3|450|10.409|6974 2019-06-25 07:42:47,393|FF|app-20190625074231-0129|5|4| END| 17.13|1.Maximal disks found | 10.92| 6974|0 2019-06-25 07:42:47,393|FF|app-20190625074231-0129|5|4|START| 17.13|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:42:47,393|MF|app-20190625074231-0129|5|4|START| 17.13|A.Points indexed | 0.00| 0|1 2019-06-25 07:42:47,478|MF|app-20190625074231-0129|5|4| END| 17.22|A.Points indexed | 0.09| 18245|1 2019-06-25 07:42:47,478|MF|app-20190625074231-0129|5|4|START| 17.22|B.Pairs found | 0.00| 0|1 2019-06-25 07:42:48,099|MF|app-20190625074231-0129|5|4| END| 17.84|B.Pairs found | 0.62| 29108|1 2019-06-25 07:42:48,099|MF|app-20190625074231-0129|5|4|START| 17.84|C.Centers found | 0.00| 0|1 2019-06-25 07:42:48,520|MF|app-20190625074231-0129|5|4| END| 18.26|C.Centers found | 0.42| 58216|1 2019-06-25 07:42:48,520|MF|app-20190625074231-0129|5|4|START| 18.26|D.Disks found | 0.00| 0|1 2019-06-25 07:42:50,442|MF|app-20190625074231-0129|5|4| END| 20.18|D.Disks found | 1.92| 22991|1 2019-06-25 07:42:50,442|MF|app-20190625074231-0129|5|4|START| 20.18|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:42:51,245|MF|app-20190625074231-0129|5|4| END| 20.98|E.Disks partitioned | 0.80| 31459|1 2019-06-25 07:42:51,246|MF|app-20190625074231-0129|5|4|START| 20.99|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:42:51,246|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:42:51,246|Cell area: 1055533.7681000116 2019-06-25 07:42:55,178|MF|app-20190625074231-0129|5|4| END| 24.92|F.Maximal disks found | 3.93| 7040|1 2019-06-25 07:42:55,178|MAXIMALS|app-20190625074231-0129|4|5|90.0|3|450|7.785|7040 2019-06-25 07:42:55,638|FF|app-20190625074231-0129|5|4| END| 25.38|1.Maximal disks found | 8.25| 7040|1 2019-06-25 07:42:55,638|FF|app-20190625074231-0129|5|4|START| 25.38|2.Join done | 0.00| 0|1 2019-06-25 07:42:57,600|FF|app-20190625074231-0129|5|4| END| 27.34|2.Join done | 1.96| 12653|1 2019-06-25 07:42:57,600|FF|app-20190625074231-0129|5|4|START| 27.34|3.Flocks to report | 0.00| 0|1 2019-06-25 07:42:58,021|FF|app-20190625074231-0129|5|4| END| 27.76|3.Flocks to report | 0.42| 0|1 2019-06-25 07:42:58,021|FF|app-20190625074231-0129|5|4|START| 27.76|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:42:58,060|FF|app-20190625074231-0129|5|4| END| 27.80|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 07:42:58,060|FF|app-20190625074231-0129|5|4|START| 27.80|5.Flocks reported | 0.00| 0|1 2019-06-25 07:42:58,064|FF|app-20190625074231-0129|5|4| END| 27.80|5.Flocks reported | 0.00| 0|1 2019-06-25 07:42:58,064|FF|app-20190625074231-0129|5|4|START| 27.80|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:42:59,419|FF|app-20190625074231-0129|5|4| END| 29.16|6.Candidates indexed | 1.35| 13060|1 2019-06-25 07:42:59,419|FF|app-20190625074231-0129|5|4|START| 29.16|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:42:59,419|MF|app-20190625074231-0129|5|4|START| 29.16|A.Points indexed | 0.00| 0|2 2019-06-25 07:42:59,481|MF|app-20190625074231-0129|5|4| END| 29.22|A.Points indexed | 0.06| 18394|2 2019-06-25 07:42:59,481|MF|app-20190625074231-0129|5|4|START| 29.22|B.Pairs found | 0.00| 0|2 2019-06-25 07:42:59,912|MF|app-20190625074231-0129|5|4| END| 29.65|B.Pairs found | 0.43| 29503|2 2019-06-25 07:42:59,913|MF|app-20190625074231-0129|5|4|START| 29.65|C.Centers found | 0.00| 0|2 2019-06-25 07:43:00,351|MF|app-20190625074231-0129|5|4| END| 30.09|C.Centers found | 0.44| 59006|2 2019-06-25 07:43:00,351|MF|app-20190625074231-0129|5|4|START| 30.09|D.Disks found | 0.00| 0|2 2019-06-25 07:43:02,412|MF|app-20190625074231-0129|5|4| END| 32.15|D.Disks found | 2.06| 23309|2 2019-06-25 07:43:02,412|MF|app-20190625074231-0129|5|4|START| 32.15|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:43:03,092|MF|app-20190625074231-0129|5|4| END| 32.83|E.Disks partitioned | 0.68| 31937|2 2019-06-25 07:43:03,092|MF|app-20190625074231-0129|5|4|START| 32.83|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:43:03,092|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:43:03,092|Cell area: 1055533.7681000116 2019-06-25 07:43:07,151|MF|app-20190625074231-0129|5|4| END| 36.89|F.Maximal disks found | 4.06| 7158|2 2019-06-25 07:43:07,151|MAXIMALS|app-20190625074231-0129|4|5|90.0|3|450|7.732|7158 2019-06-25 07:43:07,546|FF|app-20190625074231-0129|5|4| END| 37.29|1.Maximal disks found | 8.13| 7158|2 2019-06-25 07:43:07,547|FF|app-20190625074231-0129|5|4|START| 37.29|2.Join done | 0.00| 0|2 2019-06-25 07:43:11,525|FF|app-20190625074231-0129|5|4| END| 41.26|2.Join done | 3.98| 20250|2 2019-06-25 07:43:11,525|FF|app-20190625074231-0129|5|4|START| 41.26|3.Flocks to report | 0.00| 0|2 2019-06-25 07:43:12,252|FF|app-20190625074231-0129|5|4| END| 41.99|3.Flocks to report | 0.73| 17572|2 2019-06-25 07:43:12,252|FF|app-20190625074231-0129|5|4|START| 41.99|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:43:12,296|FF|app-20190625074231-0129|5|4|START| 42.04|4a.Making expansions | 0.00| 0|2 2019-06-25 07:43:12,861|FF|app-20190625074231-0129|5|4| END| 42.60|4a.Making expansions | 0.57| 21929|2 2019-06-25 07:43:12,861|FF|app-20190625074231-0129|5|4|START| 42.60|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:43:15,816|FF|app-20190625074231-0129|5|4| END| 45.56|4b.Finding maximals | 2.96| 4864|2 2019-06-25 07:43:16,008|FF|app-20190625074231-0129|5|4| END| 45.75|4.Flocks prunned by expansion | 3.76| 4864|2 2019-06-25 07:43:16,008|FF|app-20190625074231-0129|5|4|START| 45.75|5.Flocks reported | 0.00| 0|2 2019-06-25 07:43:16,285|FF|app-20190625074231-0129|5|4| END| 46.02|5.Flocks reported | 0.28| 4864|2 2019-06-25 07:43:16,285|FF|app-20190625074231-0129|5|4|START| 46.02|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:43:17,800|FF|app-20190625074231-0129|5|4| END| 47.54|6.Candidates indexed | 1.52| 7987|2 2019-06-25 07:43:17,800|FF|app-20190625074231-0129|5|4|START| 47.54|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:43:17,801|MF|app-20190625074231-0129|5|4|START| 47.54|A.Points indexed | 0.00| 0|3 2019-06-25 07:43:17,857|MF|app-20190625074231-0129|5|4| END| 47.60|A.Points indexed | 0.06| 18548|3 2019-06-25 07:43:17,857|MF|app-20190625074231-0129|5|4|START| 47.60|B.Pairs found | 0.00| 0|3 2019-06-25 07:43:18,428|MF|app-20190625074231-0129|5|4| END| 48.17|B.Pairs found | 0.57| 30000|3 2019-06-25 07:43:18,429|MF|app-20190625074231-0129|5|4|START| 48.17|C.Centers found | 0.00| 0|3 2019-06-25 07:43:19,100|MF|app-20190625074231-0129|5|4| END| 48.84|C.Centers found | 0.67| 60000|3 2019-06-25 07:43:19,100|MF|app-20190625074231-0129|5|4|START| 48.84|D.Disks found | 0.00| 0|3 2019-06-25 07:43:22,046|MF|app-20190625074231-0129|5|4| END| 51.79|D.Disks found | 2.95| 23709|3 2019-06-25 07:43:22,046|MF|app-20190625074231-0129|5|4|START| 51.79|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:43:22,868|MF|app-20190625074231-0129|5|4| END| 52.61|E.Disks partitioned | 0.82| 32468|3 2019-06-25 07:43:22,869|MF|app-20190625074231-0129|5|4|START| 52.61|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:43:22,869|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:43:22,869|Cell area: 1055533.7681000116 2019-06-25 07:43:27,428|MF|app-20190625074231-0129|5|4| END| 57.17|F.Maximal disks found | 4.56| 7325|3 2019-06-25 07:43:27,428|MAXIMALS|app-20190625074231-0129|4|5|90.0|3|450|9.627|7325 2019-06-25 07:43:27,865|FF|app-20190625074231-0129|5|4| END| 57.60|1.Maximal disks found | 10.07| 7325|3 2019-06-25 07:43:27,865|FF|app-20190625074231-0129|5|4|START| 57.60|2.Join done | 0.00| 0|3 2019-06-25 07:43:30,832|FF|app-20190625074231-0129|5|4| END| 60.57|2.Join done | 2.97| 18963|3 2019-06-25 07:43:30,832|FF|app-20190625074231-0129|5|4|START| 60.57|3.Flocks to report | 0.00| 0|3 2019-06-25 07:43:31,531|FF|app-20190625074231-0129|5|4| END| 61.27|3.Flocks to report | 0.70| 16098|3 2019-06-25 07:43:31,531|FF|app-20190625074231-0129|5|4|START| 61.27|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:43:31,573|FF|app-20190625074231-0129|5|4|START| 61.31|4a.Making expansions | 0.00| 0|3 2019-06-25 07:43:32,106|FF|app-20190625074231-0129|5|4| END| 61.85|4a.Making expansions | 0.53| 20537|3 2019-06-25 07:43:32,106|FF|app-20190625074231-0129|5|4|START| 61.85|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:43:34,037|FF|app-20190625074231-0129|5|4| END| 63.78|4b.Finding maximals | 1.93| 4949|3 2019-06-25 07:43:34,240|FF|app-20190625074231-0129|5|4| END| 63.98|4.Flocks prunned by expansion | 2.71| 4949|3 2019-06-25 07:43:34,241|FF|app-20190625074231-0129|5|4|START| 63.98|5.Flocks reported | 0.00| 0|3 2019-06-25 07:43:34,536|FF|app-20190625074231-0129|5|4| END| 64.28|5.Flocks reported | 0.30| 4949|3 2019-06-25 07:43:34,536|FF|app-20190625074231-0129|5|4|START| 64.28|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:43:36,109|FF|app-20190625074231-0129|5|4| END| 65.85|6.Candidates indexed | 1.57| 8283|3 2019-06-25 07:43:36,597|Number of flocks: 9813 2019-06-25 07:43:36,944|PFLOCK|app-20190625074231-0129|4|5|90.0|3|3|60.27|9813 2019-06-25 07:43:37,250|FF|app-20190625074231-0129|5|4| END| 66.99|Flock Finder run | 60.93| 9813|3 2019-06-25 07:43:37,250|FF|app-20190625074231-0129|5|4|START| 66.99|Session closed | 0.00| 0|3 2019-06-25 07:43:44,040|FF|app-20190625074231-0129|5|4| END| 73.78|Session closed | 6.79| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:43:45,953|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:43:47,065|FF|app-20190625074346-0130|15|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 07:43:47,066|FF|app-20190625074346-0130|15|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 07:43:51,474|FF|app-20190625074346-0130|15|4| END| 5.51|Data read | 4.41|331128|-1 2019-06-25 07:43:51,474|FF|app-20190625074346-0130|15|4|START| 5.51|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:43:51,640|FF|app-20190625074346-0130|15|4| END| 5.67|KDBTree partitioner | 0.17| 816|-1 2019-06-25 07:43:51,640|FF|app-20190625074346-0130|15|4|START| 5.67|MF partitioner | 0.00| 0|-1 2019-06-25 07:43:51,657|FF|app-20190625074346-0130|15|4| END| 5.69|MF partitioner | 0.02| 1350|-1 2019-06-25 07:43:51,657|FF|app-20190625074346-0130|15|4|START| 5.69|Pointset done | 0.00| 0|-1 2019-06-25 07:43:52,872|FF|app-20190625074346-0130|15|4| END| 6.90|Pointset done | 1.22| 4|-1 2019-06-25 07:43:52,872|FF|app-20190625074346-0130|15|4|START| 6.90|Flock Finder run | 0.00| 0|-1 2019-06-25 07:43:52,889|FF|app-20190625074346-0130|15|4|START| 6.92|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:43:52,891|MF|app-20190625074346-0130|15|4|START| 6.92|A.Points indexed | 0.00| 0|0 2019-06-25 07:43:53,120|MF|app-20190625074346-0130|15|4| END| 7.15|A.Points indexed | 0.23| 54279|0 2019-06-25 07:43:53,120|MF|app-20190625074346-0130|15|4|START| 7.15|B.Pairs found | 0.00| 0|0 2019-06-25 07:43:55,123|MF|app-20190625074346-0130|15|4| END| 9.15|B.Pairs found | 2.00|101871|0 2019-06-25 07:43:55,123|MF|app-20190625074346-0130|15|4|START| 9.15|C.Centers found | 0.00| 0|0 2019-06-25 07:43:56,897|MF|app-20190625074346-0130|15|4| END| 10.93|C.Centers found | 1.77|203742|0 2019-06-25 07:43:56,898|MF|app-20190625074346-0130|15|4|START| 10.93|D.Disks found | 0.00| 0|0 2019-06-25 07:44:06,005|MF|app-20190625074346-0130|15|4| END| 20.04|D.Disks found | 9.11| 85998|0 2019-06-25 07:44:06,006|MF|app-20190625074346-0130|15|4|START| 20.04|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:44:08,898|MF|app-20190625074346-0130|15|4| END| 22.93|E.Disks partitioned | 2.89|121693|0 2019-06-25 07:44:08,898|MF|app-20190625074346-0130|15|4|START| 22.93|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:44:08,901|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:44:08,901|Cell area: 1055533.7681000116 2019-06-25 07:44:20,114|MF|app-20190625074346-0130|15|4| END| 34.15|F.Maximal disks found | 11.22| 25114|0 2019-06-25 07:44:20,115|MAXIMALS|app-20190625074346-0130|4|15|100.0|3|1350|27.223|25114 2019-06-25 07:44:21,156|FF|app-20190625074346-0130|15|4| END| 35.19|1.Maximal disks found | 28.27| 25114|0 2019-06-25 07:44:21,157|FF|app-20190625074346-0130|15|4|START| 35.19|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:44:21,157|MF|app-20190625074346-0130|15|4|START| 35.19|A.Points indexed | 0.00| 0|1 2019-06-25 07:44:21,323|MF|app-20190625074346-0130|15|4| END| 35.35|A.Points indexed | 0.17| 54735|1 2019-06-25 07:44:21,323|MF|app-20190625074346-0130|15|4|START| 35.35|B.Pairs found | 0.00| 0|1 2019-06-25 07:44:22,514|MF|app-20190625074346-0130|15|4| END| 36.55|B.Pairs found | 1.19|103386|1 2019-06-25 07:44:22,515|MF|app-20190625074346-0130|15|4|START| 36.55|C.Centers found | 0.00| 0|1 2019-06-25 07:44:24,708|MF|app-20190625074346-0130|15|4| END| 38.74|C.Centers found | 2.19|206772|1 2019-06-25 07:44:24,708|MF|app-20190625074346-0130|15|4|START| 38.74|D.Disks found | 0.00| 0|1 2019-06-25 07:44:31,929|MF|app-20190625074346-0130|15|4| END| 45.96|D.Disks found | 7.22| 87348|1 2019-06-25 07:44:31,929|MF|app-20190625074346-0130|15|4|START| 45.96|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:44:33,943|MF|app-20190625074346-0130|15|4| END| 47.97|E.Disks partitioned | 2.01|123553|1 2019-06-25 07:44:33,944|MF|app-20190625074346-0130|15|4|START| 47.98|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:44:33,944|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:44:33,944|Cell area: 1055533.7681000116 2019-06-25 07:44:43,669|MF|app-20190625074346-0130|15|4| END| 57.70|F.Maximal disks found | 9.73| 25640|1 2019-06-25 07:44:43,669|MAXIMALS|app-20190625074346-0130|4|15|100.0|3|1350|22.512|25640 2019-06-25 07:44:44,680|FF|app-20190625074346-0130|15|4| END| 58.71|1.Maximal disks found | 23.52| 25640|1 2019-06-25 07:44:44,681|FF|app-20190625074346-0130|15|4|START| 58.71|2.Join done | 0.00| 0|1 2019-06-25 07:44:47,560|FF|app-20190625074346-0130|15|4| END| 61.59|2.Join done | 2.88| 51443|1 2019-06-25 07:44:47,560|FF|app-20190625074346-0130|15|4|START| 61.59|3.Flocks to report | 0.00| 0|1 2019-06-25 07:44:48,146|FF|app-20190625074346-0130|15|4| END| 62.18|3.Flocks to report | 0.59| 0|1 2019-06-25 07:44:48,146|FF|app-20190625074346-0130|15|4|START| 62.18|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:44:48,216|FF|app-20190625074346-0130|15|4| END| 62.25|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 07:44:48,216|FF|app-20190625074346-0130|15|4|START| 62.25|5.Flocks reported | 0.00| 0|1 2019-06-25 07:44:48,220|FF|app-20190625074346-0130|15|4| END| 62.25|5.Flocks reported | 0.00| 0|1 2019-06-25 07:44:48,220|FF|app-20190625074346-0130|15|4|START| 62.25|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:44:49,781|FF|app-20190625074346-0130|15|4| END| 63.81|6.Candidates indexed | 1.56| 52931|1 2019-06-25 07:44:49,781|FF|app-20190625074346-0130|15|4|START| 63.81|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:44:49,781|MF|app-20190625074346-0130|15|4|START| 63.81|A.Points indexed | 0.00| 0|2 2019-06-25 07:44:49,902|MF|app-20190625074346-0130|15|4| END| 63.93|A.Points indexed | 0.12| 55182|2 2019-06-25 07:44:49,902|MF|app-20190625074346-0130|15|4|START| 63.93|B.Pairs found | 0.00| 0|2 2019-06-25 07:44:50,825|MF|app-20190625074346-0130|15|4| END| 64.86|B.Pairs found | 0.92|104754|2 2019-06-25 07:44:50,825|MF|app-20190625074346-0130|15|4|START| 64.86|C.Centers found | 0.00| 0|2 2019-06-25 07:44:52,327|MF|app-20190625074346-0130|15|4| END| 66.36|C.Centers found | 1.50|209508|2 2019-06-25 07:44:52,327|MF|app-20190625074346-0130|15|4|START| 66.36|D.Disks found | 0.00| 0|2 2019-06-25 07:44:55,921|MF|app-20190625074346-0130|15|4| END| 69.95|D.Disks found | 3.59| 88647|2 2019-06-25 07:44:55,921|MF|app-20190625074346-0130|15|4|START| 69.95|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:44:56,962|MF|app-20190625074346-0130|15|4| END| 70.99|E.Disks partitioned | 1.04|125639|2 2019-06-25 07:44:56,962|MF|app-20190625074346-0130|15|4|START| 70.99|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:44:56,963|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:44:56,963|Cell area: 1055533.7681000116 2019-06-25 07:45:07,288|MF|app-20190625074346-0130|15|4| END| 81.32|F.Maximal disks found | 10.33| 26055|2 2019-06-25 07:45:07,288|MAXIMALS|app-20190625074346-0130|4|15|100.0|3|1350|17.507|26055 2019-06-25 07:45:08,306|FF|app-20190625074346-0130|15|4| END| 82.34|1.Maximal disks found | 18.53| 26055|2 2019-06-25 07:45:08,306|FF|app-20190625074346-0130|15|4|START| 82.34|2.Join done | 0.00| 0|2 2019-06-25 07:45:20,180|FF|app-20190625074346-0130|15|4| END| 94.21|2.Join done | 11.87| 98050|2 2019-06-25 07:45:20,180|FF|app-20190625074346-0130|15|4|START| 94.21|3.Flocks to report | 0.00| 0|2 2019-06-25 07:45:22,088|FF|app-20190625074346-0130|15|4| END| 96.12|3.Flocks to report | 1.91| 83669|2 2019-06-25 07:45:22,088|FF|app-20190625074346-0130|15|4|START| 96.12|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:45:22,165|FF|app-20190625074346-0130|15|4|START| 96.20|4a.Making expansions | 0.00| 0|2 2019-06-25 07:45:23,029|FF|app-20190625074346-0130|15|4| END| 97.06|4a.Making expansions | 0.86|103856|2 2019-06-25 07:45:23,029|FF|app-20190625074346-0130|15|4|START| 97.06|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:45:36,388|FF|app-20190625074346-0130|15|4| END|110.42|4b.Finding maximals | 13.36| 17091|2 2019-06-25 07:45:36,832|FF|app-20190625074346-0130|15|4| END|110.86|4.Flocks prunned by expansion | 14.74| 17091|2 2019-06-25 07:45:36,832|FF|app-20190625074346-0130|15|4|START|110.86|5.Flocks reported | 0.00| 0|2 2019-06-25 07:45:37,406|FF|app-20190625074346-0130|15|4| END|111.44|5.Flocks reported | 0.57| 17091|2 2019-06-25 07:45:37,406|FF|app-20190625074346-0130|15|4|START|111.44|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:45:39,255|FF|app-20190625074346-0130|15|4| END|113.29|6.Candidates indexed | 1.85| 33209|2 2019-06-25 07:45:39,255|FF|app-20190625074346-0130|15|4|START|113.29|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:45:39,255|MF|app-20190625074346-0130|15|4|START|113.29|A.Points indexed | 0.00| 0|3 2019-06-25 07:45:39,379|MF|app-20190625074346-0130|15|4| END|113.41|A.Points indexed | 0.12| 55644|3 2019-06-25 07:45:39,379|MF|app-20190625074346-0130|15|4|START|113.41|B.Pairs found | 0.00| 0|3 2019-06-25 07:45:40,231|MF|app-20190625074346-0130|15|4| END|114.26|B.Pairs found | 0.85|106545|3 2019-06-25 07:45:40,231|MF|app-20190625074346-0130|15|4|START|114.26|C.Centers found | 0.00| 0|3 2019-06-25 07:45:41,401|MF|app-20190625074346-0130|15|4| END|115.43|C.Centers found | 1.17|213090|3 2019-06-25 07:45:41,401|MF|app-20190625074346-0130|15|4|START|115.43|D.Disks found | 0.00| 0|3 2019-06-25 07:45:45,274|MF|app-20190625074346-0130|15|4| END|119.31|D.Disks found | 3.87| 90426|3 2019-06-25 07:45:45,274|MF|app-20190625074346-0130|15|4|START|119.31|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:45:46,111|MF|app-20190625074346-0130|15|4| END|120.14|E.Disks partitioned | 0.84|128174|3 2019-06-25 07:45:46,111|MF|app-20190625074346-0130|15|4|START|120.14|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:45:46,111|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:45:46,111|Cell area: 1055533.7681000116 2019-06-25 07:45:58,182|MF|app-20190625074346-0130|15|4| END|132.21|F.Maximal disks found | 12.07| 26538|3 2019-06-25 07:45:58,182|MAXIMALS|app-20190625074346-0130|4|15|100.0|3|1350|18.927|26538 2019-06-25 07:45:59,217|FF|app-20190625074346-0130|15|4| END|133.25|1.Maximal disks found | 19.96| 26538|3 2019-06-25 07:45:59,217|FF|app-20190625074346-0130|15|4|START|133.25|2.Join done | 0.00| 0|3 2019-06-25 07:46:09,079|FF|app-20190625074346-0130|15|4| END|143.11|2.Join done | 9.86| 90379|3 2019-06-25 07:46:09,079|FF|app-20190625074346-0130|15|4|START|143.11|3.Flocks to report | 0.00| 0|3 2019-06-25 07:46:11,633|FF|app-20190625074346-0130|15|4| END|145.66|3.Flocks to report | 2.55| 75867|3 2019-06-25 07:46:11,633|FF|app-20190625074346-0130|15|4|START|145.66|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:46:11,716|FF|app-20190625074346-0130|15|4|START|145.75|4a.Making expansions | 0.00| 0|3 2019-06-25 07:46:12,749|FF|app-20190625074346-0130|15|4| END|146.78|4a.Making expansions | 1.03| 96586|3 2019-06-25 07:46:12,749|FF|app-20190625074346-0130|15|4|START|146.78|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:46:25,155|FF|app-20190625074346-0130|15|4| END|159.19|4b.Finding maximals | 12.41| 17301|3 2019-06-25 07:46:25,618|FF|app-20190625074346-0130|15|4| END|159.65|4.Flocks prunned by expansion | 13.99| 17301|3 2019-06-25 07:46:25,618|FF|app-20190625074346-0130|15|4|START|159.65|5.Flocks reported | 0.00| 0|3 2019-06-25 07:46:26,259|FF|app-20190625074346-0130|15|4| END|160.29|5.Flocks reported | 0.64| 17301|3 2019-06-25 07:46:26,260|FF|app-20190625074346-0130|15|4|START|160.29|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:46:28,514|FF|app-20190625074346-0130|15|4| END|162.55|6.Candidates indexed | 2.25| 33436|3 2019-06-25 07:46:29,862|Number of flocks: 34392 2019-06-25 07:46:30,832|PFLOCK|app-20190625074346-0130|4|15|100.0|3|3|156.99|34392 2019-06-25 07:46:31,775|FF|app-20190625074346-0130|15|4| END|165.81|Flock Finder run |158.90| 34392|3 2019-06-25 07:46:31,775|FF|app-20190625074346-0130|15|4|START|165.81|Session closed | 0.00| 0|3 2019-06-25 07:46:39,030|FF|app-20190625074346-0130|15|4| END|173.06|Session closed | 7.26| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:46:41,027|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:46:42,132|FF|app-20190625074641-0131|10|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 07:46:42,133|FF|app-20190625074641-0131|10|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 07:46:46,192|FF|app-20190625074641-0131|10|4| END| 5.15|Data read | 4.06|220752|-1 2019-06-25 07:46:46,193|FF|app-20190625074641-0131|10|4|START| 5.15|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:46:46,357|FF|app-20190625074641-0131|10|4| END| 5.31|KDBTree partitioner | 0.16| 544|-1 2019-06-25 07:46:46,357|FF|app-20190625074641-0131|10|4|START| 5.31|MF partitioner | 0.00| 0|-1 2019-06-25 07:46:46,376|FF|app-20190625074641-0131|10|4| END| 5.33|MF partitioner | 0.02| 900|-1 2019-06-25 07:46:46,376|FF|app-20190625074641-0131|10|4|START| 5.33|Pointset done | 0.00| 0|-1 2019-06-25 07:46:47,400|FF|app-20190625074641-0131|10|4| END| 6.36|Pointset done | 1.02| 4|-1 2019-06-25 07:46:47,400|FF|app-20190625074641-0131|10|4|START| 6.36|Flock Finder run | 0.00| 0|-1 2019-06-25 07:46:47,416|FF|app-20190625074641-0131|10|4|START| 6.37|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:46:47,418|MF|app-20190625074641-0131|10|4|START| 6.37|A.Points indexed | 0.00| 0|0 2019-06-25 07:46:47,587|MF|app-20190625074641-0131|10|4| END| 6.54|A.Points indexed | 0.17| 36186|0 2019-06-25 07:46:47,587|MF|app-20190625074641-0131|10|4|START| 6.54|B.Pairs found | 0.00| 0|0 2019-06-25 07:46:49,317|MF|app-20190625074641-0131|10|4| END| 8.27|B.Pairs found | 1.73| 67914|0 2019-06-25 07:46:49,317|MF|app-20190625074641-0131|10|4|START| 8.27|C.Centers found | 0.00| 0|0 2019-06-25 07:46:50,653|MF|app-20190625074641-0131|10|4| END| 9.61|C.Centers found | 1.34|135828|0 2019-06-25 07:46:50,653|MF|app-20190625074641-0131|10|4|START| 9.61|D.Disks found | 0.00| 0|0 2019-06-25 07:46:56,573|MF|app-20190625074641-0131|10|4| END| 15.53|D.Disks found | 5.92| 57332|0 2019-06-25 07:46:56,573|MF|app-20190625074641-0131|10|4|START| 15.53|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:46:58,857|MF|app-20190625074641-0131|10|4| END| 17.81|E.Disks partitioned | 2.28| 81114|0 2019-06-25 07:46:58,857|MF|app-20190625074641-0131|10|4|START| 17.81|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:46:58,859|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:46:58,859|Cell area: 1055533.7681000116 2019-06-25 07:47:10,009|MF|app-20190625074641-0131|10|4| END| 28.97|F.Maximal disks found | 11.15| 16742|0 2019-06-25 07:47:10,009|MAXIMALS|app-20190625074641-0131|4|10|100.0|3|900|22.591|16742 2019-06-25 07:47:11,055|FF|app-20190625074641-0131|10|4| END| 30.01|1.Maximal disks found | 23.64| 16742|0 2019-06-25 07:47:11,056|FF|app-20190625074641-0131|10|4|START| 30.01|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:47:11,056|MF|app-20190625074641-0131|10|4|START| 30.01|A.Points indexed | 0.00| 0|1 2019-06-25 07:47:11,166|MF|app-20190625074641-0131|10|4| END| 30.12|A.Points indexed | 0.11| 36490|1 2019-06-25 07:47:11,166|MF|app-20190625074641-0131|10|4|START| 30.12|B.Pairs found | 0.00| 0|1 2019-06-25 07:47:11,878|MF|app-20190625074641-0131|10|4| END| 30.83|B.Pairs found | 0.71| 68924|1 2019-06-25 07:47:11,878|MF|app-20190625074641-0131|10|4|START| 30.83|C.Centers found | 0.00| 0|1 2019-06-25 07:47:13,055|MF|app-20190625074641-0131|10|4| END| 32.01|C.Centers found | 1.18|137848|1 2019-06-25 07:47:13,056|MF|app-20190625074641-0131|10|4|START| 32.01|D.Disks found | 0.00| 0|1 2019-06-25 07:47:17,738|MF|app-20190625074641-0131|10|4| END| 36.69|D.Disks found | 4.68| 58232|1 2019-06-25 07:47:17,738|MF|app-20190625074641-0131|10|4|START| 36.69|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:47:19,817|MF|app-20190625074641-0131|10|4| END| 38.77|E.Disks partitioned | 2.08| 82341|1 2019-06-25 07:47:19,818|MF|app-20190625074641-0131|10|4|START| 38.77|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:47:19,818|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:47:19,818|Cell area: 1055533.7681000116 2019-06-25 07:47:29,840|MF|app-20190625074641-0131|10|4| END| 48.80|F.Maximal disks found | 10.02| 17096|1 2019-06-25 07:47:29,840|MAXIMALS|app-20190625074641-0131|4|10|100.0|3|900|18.784|17096 2019-06-25 07:47:30,768|FF|app-20190625074641-0131|10|4| END| 49.72|1.Maximal disks found | 19.71| 17096|1 2019-06-25 07:47:30,768|FF|app-20190625074641-0131|10|4|START| 49.72|2.Join done | 0.00| 0|1 2019-06-25 07:47:36,051|FF|app-20190625074641-0131|10|4| END| 55.01|2.Join done | 5.28| 34283|1 2019-06-25 07:47:36,052|FF|app-20190625074641-0131|10|4|START| 55.01|3.Flocks to report | 0.00| 0|1 2019-06-25 07:47:37,126|FF|app-20190625074641-0131|10|4| END| 56.08|3.Flocks to report | 1.08| 0|1 2019-06-25 07:47:37,126|FF|app-20190625074641-0131|10|4|START| 56.08|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:47:37,185|FF|app-20190625074641-0131|10|4| END| 56.14|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 07:47:37,185|FF|app-20190625074641-0131|10|4|START| 56.14|5.Flocks reported | 0.00| 0|1 2019-06-25 07:47:37,190|FF|app-20190625074641-0131|10|4| END| 56.15|5.Flocks reported | 0.01| 0|1 2019-06-25 07:47:37,190|FF|app-20190625074641-0131|10|4|START| 56.15|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:47:39,502|FF|app-20190625074641-0131|10|4| END| 58.46|6.Candidates indexed | 2.31| 35275|1 2019-06-25 07:47:39,502|FF|app-20190625074641-0131|10|4|START| 58.46|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:47:39,502|MF|app-20190625074641-0131|10|4|START| 58.46|A.Points indexed | 0.00| 0|2 2019-06-25 07:47:39,601|MF|app-20190625074641-0131|10|4| END| 58.56|A.Points indexed | 0.10| 36788|2 2019-06-25 07:47:39,601|MF|app-20190625074641-0131|10|4|START| 58.56|B.Pairs found | 0.00| 0|2 2019-06-25 07:47:40,506|MF|app-20190625074641-0131|10|4| END| 59.46|B.Pairs found | 0.91| 69836|2 2019-06-25 07:47:40,507|MF|app-20190625074641-0131|10|4|START| 59.46|C.Centers found | 0.00| 0|2 2019-06-25 07:47:41,339|MF|app-20190625074641-0131|10|4| END| 60.30|C.Centers found | 0.83|139672|2 2019-06-25 07:47:41,339|MF|app-20190625074641-0131|10|4|START| 60.30|D.Disks found | 0.00| 0|2 2019-06-25 07:47:45,806|MF|app-20190625074641-0131|10|4| END| 64.76|D.Disks found | 4.47| 59098|2 2019-06-25 07:47:45,806|MF|app-20190625074641-0131|10|4|START| 64.76|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:47:47,545|MF|app-20190625074641-0131|10|4| END| 66.50|E.Disks partitioned | 1.74| 83724|2 2019-06-25 07:47:47,545|MF|app-20190625074641-0131|10|4|START| 66.50|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:47:47,546|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:47:47,546|Cell area: 1055533.7681000116 2019-06-25 07:47:58,561|MF|app-20190625074641-0131|10|4| END| 77.52|F.Maximal disks found | 11.02| 17376|2 2019-06-25 07:47:58,561|MAXIMALS|app-20190625074641-0131|4|10|100.0|3|900|19.059|17376 2019-06-25 07:47:59,324|FF|app-20190625074641-0131|10|4| END| 78.28|1.Maximal disks found | 19.82| 17376|2 2019-06-25 07:47:59,324|FF|app-20190625074641-0131|10|4|START| 78.28|2.Join done | 0.00| 0|2 2019-06-25 07:48:11,548|FF|app-20190625074641-0131|10|4| END| 90.50|2.Join done | 12.22| 65349|2 2019-06-25 07:48:11,549|FF|app-20190625074641-0131|10|4|START| 90.51|3.Flocks to report | 0.00| 0|2 2019-06-25 07:48:13,351|FF|app-20190625074641-0131|10|4| END| 92.31|3.Flocks to report | 1.80| 55752|2 2019-06-25 07:48:13,351|FF|app-20190625074641-0131|10|4|START| 92.31|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:48:13,415|FF|app-20190625074641-0131|10|4|START| 92.37|4a.Making expansions | 0.00| 0|2 2019-06-25 07:48:14,739|FF|app-20190625074641-0131|10|4| END| 93.70|4a.Making expansions | 1.32| 69146|2 2019-06-25 07:48:14,740|FF|app-20190625074641-0131|10|4|START| 93.70|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:48:29,156|FF|app-20190625074641-0131|10|4| END|108.11|4b.Finding maximals | 14.42| 11394|2 2019-06-25 07:48:29,593|FF|app-20190625074641-0131|10|4| END|108.55|4.Flocks prunned by expansion | 16.24| 11394|2 2019-06-25 07:48:29,593|FF|app-20190625074641-0131|10|4|START|108.55|5.Flocks reported | 0.00| 0|2 2019-06-25 07:48:30,230|FF|app-20190625074641-0131|10|4| END|109.19|5.Flocks reported | 0.64| 11394|2 2019-06-25 07:48:30,231|FF|app-20190625074641-0131|10|4|START|109.19|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:48:32,238|FF|app-20190625074641-0131|10|4| END|111.19|6.Candidates indexed | 2.01| 22156|2 2019-06-25 07:48:32,238|FF|app-20190625074641-0131|10|4|START|111.19|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:48:32,238|MF|app-20190625074641-0131|10|4|START|111.19|A.Points indexed | 0.00| 0|3 2019-06-25 07:48:32,322|MF|app-20190625074641-0131|10|4| END|111.28|A.Points indexed | 0.08| 37096|3 2019-06-25 07:48:32,322|MF|app-20190625074641-0131|10|4|START|111.28|B.Pairs found | 0.00| 0|3 2019-06-25 07:48:32,929|MF|app-20190625074641-0131|10|4| END|111.89|B.Pairs found | 0.61| 71030|3 2019-06-25 07:48:32,929|MF|app-20190625074641-0131|10|4|START|111.89|C.Centers found | 0.00| 0|3 2019-06-25 07:48:34,209|MF|app-20190625074641-0131|10|4| END|113.17|C.Centers found | 1.28|142060|3 2019-06-25 07:48:34,209|MF|app-20190625074641-0131|10|4|START|113.17|D.Disks found | 0.00| 0|3 2019-06-25 07:48:38,027|MF|app-20190625074641-0131|10|4| END|116.98|D.Disks found | 3.82| 60284|3 2019-06-25 07:48:38,027|MF|app-20190625074641-0131|10|4|START|116.98|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:48:39,588|MF|app-20190625074641-0131|10|4| END|118.54|E.Disks partitioned | 1.56| 85409|3 2019-06-25 07:48:39,588|MF|app-20190625074641-0131|10|4|START|118.54|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:48:39,589|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:48:39,589|Cell area: 1055533.7681000116 2019-06-25 07:48:51,494|MF|app-20190625074641-0131|10|4| END|130.45|F.Maximal disks found | 11.91| 17693|3 2019-06-25 07:48:51,494|MAXIMALS|app-20190625074641-0131|4|10|100.0|3|900|19.256|17693 2019-06-25 07:48:52,278|FF|app-20190625074641-0131|10|4| END|131.23|1.Maximal disks found | 20.04| 17693|3 2019-06-25 07:48:52,278|FF|app-20190625074641-0131|10|4|START|131.23|2.Join done | 0.00| 0|3 2019-06-25 07:48:58,323|FF|app-20190625074641-0131|10|4| END|137.28|2.Join done | 6.05| 60350|3 2019-06-25 07:48:58,323|FF|app-20190625074641-0131|10|4|START|137.28|3.Flocks to report | 0.00| 0|3 2019-06-25 07:48:59,528|FF|app-20190625074641-0131|10|4| END|138.48|3.Flocks to report | 1.21| 50614|3 2019-06-25 07:48:59,528|FF|app-20190625074641-0131|10|4|START|138.48|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:48:59,619|FF|app-20190625074641-0131|10|4|START|138.58|4a.Making expansions | 0.00| 0|3 2019-06-25 07:49:00,571|FF|app-20190625074641-0131|10|4| END|139.53|4a.Making expansions | 0.95| 64354|3 2019-06-25 07:49:00,571|FF|app-20190625074641-0131|10|4|START|139.53|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:49:10,948|FF|app-20190625074641-0131|10|4| END|149.90|4b.Finding maximals | 10.38| 11534|3 2019-06-25 07:49:11,257|FF|app-20190625074641-0131|10|4| END|150.21|4.Flocks prunned by expansion | 11.73| 11534|3 2019-06-25 07:49:11,257|FF|app-20190625074641-0131|10|4|START|150.21|5.Flocks reported | 0.00| 0|3 2019-06-25 07:49:11,720|FF|app-20190625074641-0131|10|4| END|150.68|5.Flocks reported | 0.46| 11534|3 2019-06-25 07:49:11,720|FF|app-20190625074641-0131|10|4|START|150.68|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:49:13,563|FF|app-20190625074641-0131|10|4| END|152.52|6.Candidates indexed | 1.84| 22352|3 2019-06-25 07:49:14,790|Number of flocks: 22928 2019-06-25 07:49:15,602|PFLOCK|app-20190625074641-0131|4|10|100.0|3|3|147.39|22928 2019-06-25 07:49:16,332|FF|app-20190625074641-0131|10|4| END|155.29|Flock Finder run |148.93| 22928|3 2019-06-25 07:49:16,332|FF|app-20190625074641-0131|10|4|START|155.29|Session closed | 0.00| 0|3 2019-06-25 07:49:23,055|FF|app-20190625074641-0131|10|4| END|162.01|Session closed | 6.72| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:49:25,069|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:49:26,181|FF|app-20190625074925-0132|5|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 07:49:26,182|FF|app-20190625074925-0132|5|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 07:49:29,927|FF|app-20190625074925-0132|5|4| END| 4.84|Data read | 3.75|110376|-1 2019-06-25 07:49:29,927|FF|app-20190625074925-0132|5|4|START| 4.84|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:49:30,050|FF|app-20190625074925-0132|5|4| END| 4.97|KDBTree partitioner | 0.12| 272|-1 2019-06-25 07:49:30,051|FF|app-20190625074925-0132|5|4|START| 4.97|MF partitioner | 0.00| 0|-1 2019-06-25 07:49:30,066|FF|app-20190625074925-0132|5|4| END| 4.98|MF partitioner | 0.02| 450|-1 2019-06-25 07:49:30,067|FF|app-20190625074925-0132|5|4|START| 4.98|Pointset done | 0.00| 0|-1 2019-06-25 07:49:30,916|FF|app-20190625074925-0132|5|4| END| 5.83|Pointset done | 0.85| 4|-1 2019-06-25 07:49:30,916|FF|app-20190625074925-0132|5|4|START| 5.83|Flock Finder run | 0.00| 0|-1 2019-06-25 07:49:31,069|FF|app-20190625074925-0132|5|4|START| 5.98|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:49:31,072|MF|app-20190625074925-0132|5|4|START| 5.99|A.Points indexed | 0.00| 0|0 2019-06-25 07:49:31,242|MF|app-20190625074925-0132|5|4| END| 6.16|A.Points indexed | 0.17| 18093|0 2019-06-25 07:49:31,242|MF|app-20190625074925-0132|5|4|START| 6.16|B.Pairs found | 0.00| 0|0 2019-06-25 07:49:32,491|MF|app-20190625074925-0132|5|4| END| 7.41|B.Pairs found | 1.25| 33957|0 2019-06-25 07:49:32,491|MF|app-20190625074925-0132|5|4|START| 7.41|C.Centers found | 0.00| 0|0 2019-06-25 07:49:33,260|MF|app-20190625074925-0132|5|4| END| 8.18|C.Centers found | 0.77| 67914|0 2019-06-25 07:49:33,260|MF|app-20190625074925-0132|5|4|START| 8.18|D.Disks found | 0.00| 0|0 2019-06-25 07:49:36,524|MF|app-20190625074925-0132|5|4| END| 11.44|D.Disks found | 3.26| 28666|0 2019-06-25 07:49:36,525|MF|app-20190625074925-0132|5|4|START| 11.44|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:49:37,834|MF|app-20190625074925-0132|5|4| END| 12.75|E.Disks partitioned | 1.31| 40550|0 2019-06-25 07:49:37,834|MF|app-20190625074925-0132|5|4|START| 12.75|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:49:37,835|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:49:37,835|Cell area: 1055533.7681000116 2019-06-25 07:49:47,815|MF|app-20190625074925-0132|5|4| END| 22.73|F.Maximal disks found | 9.98| 8371|0 2019-06-25 07:49:47,815|MAXIMALS|app-20190625074925-0132|4|5|100.0|3|450|16.743|8371 2019-06-25 07:49:48,396|FF|app-20190625074925-0132|5|4| END| 23.31|1.Maximal disks found | 17.33| 8371|0 2019-06-25 07:49:48,396|FF|app-20190625074925-0132|5|4|START| 23.31|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:49:48,396|MF|app-20190625074925-0132|5|4|START| 23.31|A.Points indexed | 0.00| 0|1 2019-06-25 07:49:48,485|MF|app-20190625074925-0132|5|4| END| 23.40|A.Points indexed | 0.09| 18245|1 2019-06-25 07:49:48,485|MF|app-20190625074925-0132|5|4|START| 23.40|B.Pairs found | 0.00| 0|1 2019-06-25 07:49:49,075|MF|app-20190625074925-0132|5|4| END| 23.99|B.Pairs found | 0.59| 34462|1 2019-06-25 07:49:49,076|MF|app-20190625074925-0132|5|4|START| 23.99|C.Centers found | 0.00| 0|1 2019-06-25 07:49:49,482|MF|app-20190625074925-0132|5|4| END| 24.40|C.Centers found | 0.41| 68924|1 2019-06-25 07:49:49,483|MF|app-20190625074925-0132|5|4|START| 24.40|D.Disks found | 0.00| 0|1 2019-06-25 07:49:51,466|MF|app-20190625074925-0132|5|4| END| 26.38|D.Disks found | 1.98| 29116|1 2019-06-25 07:49:51,466|MF|app-20190625074925-0132|5|4|START| 26.38|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:49:52,255|MF|app-20190625074925-0132|5|4| END| 27.17|E.Disks partitioned | 0.79| 41162|1 2019-06-25 07:49:52,255|MF|app-20190625074925-0132|5|4|START| 27.17|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:49:52,255|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:49:52,255|Cell area: 1055533.7681000116 2019-06-25 07:50:01,883|MF|app-20190625074925-0132|5|4| END| 36.80|F.Maximal disks found | 9.63| 8547|1 2019-06-25 07:50:01,883|MAXIMALS|app-20190625074925-0132|4|5|100.0|3|450|13.487|8547 2019-06-25 07:50:02,318|FF|app-20190625074925-0132|5|4| END| 37.23|1.Maximal disks found | 13.92| 8547|1 2019-06-25 07:50:02,318|FF|app-20190625074925-0132|5|4|START| 37.23|2.Join done | 0.00| 0|1 2019-06-25 07:50:04,513|FF|app-20190625074925-0132|5|4| END| 39.43|2.Join done | 2.20| 17137|1 2019-06-25 07:50:04,513|FF|app-20190625074925-0132|5|4|START| 39.43|3.Flocks to report | 0.00| 0|1 2019-06-25 07:50:04,952|FF|app-20190625074925-0132|5|4| END| 39.87|3.Flocks to report | 0.44| 0|1 2019-06-25 07:50:04,952|FF|app-20190625074925-0132|5|4|START| 39.87|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:50:04,987|FF|app-20190625074925-0132|5|4| END| 39.90|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 07:50:04,987|FF|app-20190625074925-0132|5|4|START| 39.90|5.Flocks reported | 0.00| 0|1 2019-06-25 07:50:04,992|FF|app-20190625074925-0132|5|4| END| 39.91|5.Flocks reported | 0.01| 0|1 2019-06-25 07:50:04,992|FF|app-20190625074925-0132|5|4|START| 39.91|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:50:06,525|FF|app-20190625074925-0132|5|4| END| 41.44|6.Candidates indexed | 1.53| 17633|1 2019-06-25 07:50:06,525|FF|app-20190625074925-0132|5|4|START| 41.44|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:50:06,525|MF|app-20190625074925-0132|5|4|START| 41.44|A.Points indexed | 0.00| 0|2 2019-06-25 07:50:06,592|MF|app-20190625074925-0132|5|4| END| 41.51|A.Points indexed | 0.07| 18394|2 2019-06-25 07:50:06,593|MF|app-20190625074925-0132|5|4|START| 41.51|B.Pairs found | 0.00| 0|2 2019-06-25 07:50:07,055|MF|app-20190625074925-0132|5|4| END| 41.97|B.Pairs found | 0.46| 34918|2 2019-06-25 07:50:07,055|MF|app-20190625074925-0132|5|4|START| 41.97|C.Centers found | 0.00| 0|2 2019-06-25 07:50:07,478|MF|app-20190625074925-0132|5|4| END| 42.39|C.Centers found | 0.42| 69836|2 2019-06-25 07:50:07,478|MF|app-20190625074925-0132|5|4|START| 42.39|D.Disks found | 0.00| 0|2 2019-06-25 07:50:09,690|MF|app-20190625074925-0132|5|4| END| 44.61|D.Disks found | 2.21| 29549|2 2019-06-25 07:50:09,690|MF|app-20190625074925-0132|5|4|START| 44.61|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:50:10,629|MF|app-20190625074925-0132|5|4| END| 45.54|E.Disks partitioned | 0.94| 41840|2 2019-06-25 07:50:10,629|MF|app-20190625074925-0132|5|4|START| 45.54|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:50:10,629|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:50:10,629|Cell area: 1055533.7681000116 2019-06-25 07:50:19,860|MF|app-20190625074925-0132|5|4| END| 54.78|F.Maximal disks found | 9.23| 8685|2 2019-06-25 07:50:19,860|MAXIMALS|app-20190625074925-0132|4|5|100.0|3|450|13.335|8685 2019-06-25 07:50:20,271|FF|app-20190625074925-0132|5|4| END| 55.19|1.Maximal disks found | 13.75| 8685|2 2019-06-25 07:50:20,271|FF|app-20190625074925-0132|5|4|START| 55.19|2.Join done | 0.00| 0|2 2019-06-25 07:50:28,696|FF|app-20190625074925-0132|5|4| END| 63.61|2.Join done | 8.43| 32675|2 2019-06-25 07:50:28,696|FF|app-20190625074925-0132|5|4|START| 63.61|3.Flocks to report | 0.00| 0|2 2019-06-25 07:50:29,622|FF|app-20190625074925-0132|5|4| END| 64.54|3.Flocks to report | 0.93| 27876|2 2019-06-25 07:50:29,622|FF|app-20190625074925-0132|5|4|START| 64.54|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:50:29,665|FF|app-20190625074925-0132|5|4|START| 64.58|4a.Making expansions | 0.00| 0|2 2019-06-25 07:50:30,492|FF|app-20190625074925-0132|5|4| END| 65.41|4a.Making expansions | 0.83| 34666|2 2019-06-25 07:50:30,492|FF|app-20190625074925-0132|5|4|START| 65.41|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:50:44,287|FF|app-20190625074925-0132|5|4| END| 79.20|4b.Finding maximals | 13.80| 5697|2 2019-06-25 07:50:44,490|FF|app-20190625074925-0132|5|4| END| 79.41|4.Flocks prunned by expansion | 14.87| 5697|2 2019-06-25 07:50:44,490|FF|app-20190625074925-0132|5|4|START| 79.41|5.Flocks reported | 0.00| 0|2 2019-06-25 07:50:44,772|FF|app-20190625074925-0132|5|4| END| 79.69|5.Flocks reported | 0.28| 5697|2 2019-06-25 07:50:44,772|FF|app-20190625074925-0132|5|4|START| 79.69|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:50:46,556|FF|app-20190625074925-0132|5|4| END| 81.47|6.Candidates indexed | 1.78| 11079|2 2019-06-25 07:50:46,556|FF|app-20190625074925-0132|5|4|START| 81.47|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:50:46,556|MF|app-20190625074925-0132|5|4|START| 81.47|A.Points indexed | 0.00| 0|3 2019-06-25 07:50:46,632|MF|app-20190625074925-0132|5|4| END| 81.55|A.Points indexed | 0.08| 18548|3 2019-06-25 07:50:46,632|MF|app-20190625074925-0132|5|4|START| 81.55|B.Pairs found | 0.00| 0|3 2019-06-25 07:50:47,214|MF|app-20190625074925-0132|5|4| END| 82.13|B.Pairs found | 0.58| 35515|3 2019-06-25 07:50:47,214|MF|app-20190625074925-0132|5|4|START| 82.13|C.Centers found | 0.00| 0|3 2019-06-25 07:50:47,808|MF|app-20190625074925-0132|5|4| END| 82.72|C.Centers found | 0.59| 71030|3 2019-06-25 07:50:47,808|MF|app-20190625074925-0132|5|4|START| 82.72|D.Disks found | 0.00| 0|3 2019-06-25 07:50:50,890|MF|app-20190625074925-0132|5|4| END| 85.81|D.Disks found | 3.08| 30142|3 2019-06-25 07:50:50,890|MF|app-20190625074925-0132|5|4|START| 85.81|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:50:51,894|MF|app-20190625074925-0132|5|4| END| 86.81|E.Disks partitioned | 1.00| 42665|3 2019-06-25 07:50:51,894|MF|app-20190625074925-0132|5|4|START| 86.81|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:50:51,895|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:50:51,895|Cell area: 1055533.7681000116 2019-06-25 07:51:03,208|MF|app-20190625074925-0132|5|4| END| 98.12|F.Maximal disks found | 11.31| 8846|3 2019-06-25 07:51:03,208|MAXIMALS|app-20190625074925-0132|4|5|100.0|3|450|16.652|8846 2019-06-25 07:51:03,650|FF|app-20190625074925-0132|5|4| END| 98.57|1.Maximal disks found | 17.09| 8846|3 2019-06-25 07:51:03,650|FF|app-20190625074925-0132|5|4|START| 98.57|2.Join done | 0.00| 0|3 2019-06-25 07:51:08,237|FF|app-20190625074925-0132|5|4| END|103.15|2.Join done | 4.59| 30191|3 2019-06-25 07:51:08,237|FF|app-20190625074925-0132|5|4|START|103.15|3.Flocks to report | 0.00| 0|3 2019-06-25 07:51:09,123|FF|app-20190625074925-0132|5|4| END|104.04|3.Flocks to report | 0.89| 25329|3 2019-06-25 07:51:09,123|FF|app-20190625074925-0132|5|4|START|104.04|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:51:09,165|FF|app-20190625074925-0132|5|4|START|104.08|4a.Making expansions | 0.00| 0|3 2019-06-25 07:51:09,854|FF|app-20190625074925-0132|5|4| END|104.77|4a.Making expansions | 0.69| 32268|3 2019-06-25 07:51:09,854|FF|app-20190625074925-0132|5|4|START|104.77|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:51:20,330|FF|app-20190625074925-0132|5|4| END|115.25|4b.Finding maximals | 10.48| 5767|3 2019-06-25 07:51:20,545|FF|app-20190625074925-0132|5|4| END|115.46|4.Flocks prunned by expansion | 11.42| 5767|3 2019-06-25 07:51:20,545|FF|app-20190625074925-0132|5|4|START|115.46|5.Flocks reported | 0.00| 0|3 2019-06-25 07:51:20,839|FF|app-20190625074925-0132|5|4| END|115.75|5.Flocks reported | 0.29| 5767|3 2019-06-25 07:51:20,839|FF|app-20190625074925-0132|5|4|START|115.75|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:51:22,713|FF|app-20190625074925-0132|5|4| END|117.63|6.Candidates indexed | 1.87| 11171|3 2019-06-25 07:51:23,357|Number of flocks: 11464 2019-06-25 07:51:23,720|PFLOCK|app-20190625074925-0132|4|5|100.0|3|3|112.44|11464 2019-06-25 07:51:24,080|FF|app-20190625074925-0132|5|4| END|119.00|Flock Finder run |113.16| 11464|3 2019-06-25 07:51:24,080|FF|app-20190625074925-0132|5|4|START|119.00|Session closed | 0.00| 0|3 2019-06-25 07:51:30,596|FF|app-20190625074925-0132|5|4| END|125.51|Session closed | 6.52| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:51:32,625|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:51:33,772|FF|app-20190625075133-0133|15|4| END| 1.13|Session start | 1.15| 0|-1 2019-06-25 07:51:33,773|FF|app-20190625075133-0133|15|4|START| 1.13|Data read | 0.00| 0|-1 2019-06-25 07:51:37,905|FF|app-20190625075133-0133|15|4| END| 5.26|Data read | 4.13|331128|-1 2019-06-25 07:51:37,905|FF|app-20190625075133-0133|15|4|START| 5.26|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:51:38,237|FF|app-20190625075133-0133|15|4| END| 5.60|KDBTree partitioner | 0.33| 816|-1 2019-06-25 07:51:38,237|FF|app-20190625075133-0133|15|4|START| 5.60|MF partitioner | 0.00| 0|-1 2019-06-25 07:51:38,269|FF|app-20190625075133-0133|15|4| END| 5.63|MF partitioner | 0.03| 1350|-1 2019-06-25 07:51:38,269|FF|app-20190625075133-0133|15|4|START| 5.63|Pointset done | 0.00| 0|-1 2019-06-25 07:51:39,411|FF|app-20190625075133-0133|15|4| END| 6.77|Pointset done | 1.14| 4|-1 2019-06-25 07:51:39,411|FF|app-20190625075133-0133|15|4|START| 6.77|Flock Finder run | 0.00| 0|-1 2019-06-25 07:51:39,432|FF|app-20190625075133-0133|15|4|START| 6.79|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:51:39,436|MF|app-20190625075133-0133|15|4|START| 6.80|A.Points indexed | 0.00| 0|0 2019-06-25 07:51:39,658|MF|app-20190625075133-0133|15|4| END| 7.02|A.Points indexed | 0.22| 54279|0 2019-06-25 07:51:39,658|MF|app-20190625075133-0133|15|4|START| 7.02|B.Pairs found | 0.00| 0|0 2019-06-25 07:51:41,704|MF|app-20190625075133-0133|15|4| END| 9.06|B.Pairs found | 2.05|118212|0 2019-06-25 07:51:41,705|MF|app-20190625075133-0133|15|4|START| 9.06|C.Centers found | 0.00| 0|0 2019-06-25 07:51:43,609|MF|app-20190625075133-0133|15|4| END| 10.97|C.Centers found | 1.90|236424|0 2019-06-25 07:51:43,609|MF|app-20190625075133-0133|15|4|START| 10.97|D.Disks found | 0.00| 0|0 2019-06-25 07:51:53,351|MF|app-20190625075133-0133|15|4| END| 20.71|D.Disks found | 9.74|105687|0 2019-06-25 07:51:53,352|MF|app-20190625075133-0133|15|4|START| 20.71|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:51:56,470|MF|app-20190625075133-0133|15|4| END| 23.83|E.Disks partitioned | 3.12|154597|0 2019-06-25 07:51:56,470|MF|app-20190625075133-0133|15|4|START| 23.83|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:51:56,472|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:51:56,472|Cell area: 1055533.7681000116 2019-06-25 07:52:23,860|MF|app-20190625075133-0133|15|4| END| 51.22|F.Maximal disks found | 27.39| 30002|0 2019-06-25 07:52:23,861|MAXIMALS|app-20190625075133-0133|4|15|110.0|3|1350|44.425|30002 2019-06-25 07:52:24,931|FF|app-20190625075133-0133|15|4| END| 52.29|1.Maximal disks found | 45.50| 30002|0 2019-06-25 07:52:24,931|FF|app-20190625075133-0133|15|4|START| 52.29|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:52:24,931|MF|app-20190625075133-0133|15|4|START| 52.29|A.Points indexed | 0.00| 0|1 2019-06-25 07:52:25,058|MF|app-20190625075133-0133|15|4| END| 52.42|A.Points indexed | 0.13| 54735|1 2019-06-25 07:52:25,058|MF|app-20190625075133-0133|15|4|START| 52.42|B.Pairs found | 0.00| 0|1 2019-06-25 07:52:26,163|MF|app-20190625075133-0133|15|4| END| 53.52|B.Pairs found | 1.11|119997|1 2019-06-25 07:52:26,163|MF|app-20190625075133-0133|15|4|START| 53.52|C.Centers found | 0.00| 0|1 2019-06-25 07:52:27,357|MF|app-20190625075133-0133|15|4| END| 54.72|C.Centers found | 1.19|239994|1 2019-06-25 07:52:27,357|MF|app-20190625075133-0133|15|4|START| 54.72|D.Disks found | 0.00| 0|1 2019-06-25 07:52:34,701|MF|app-20190625075133-0133|15|4| END| 62.06|D.Disks found | 7.34|107547|1 2019-06-25 07:52:34,701|MF|app-20190625075133-0133|15|4|START| 62.06|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:52:36,516|MF|app-20190625075133-0133|15|4| END| 63.88|E.Disks partitioned | 1.82|157199|1 2019-06-25 07:52:36,517|MF|app-20190625075133-0133|15|4|START| 63.88|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:52:36,518|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:52:36,518|Cell area: 1055533.7681000116 2019-06-25 07:53:04,967|MF|app-20190625075133-0133|15|4| END| 92.33|F.Maximal disks found | 28.45| 30329|1 2019-06-25 07:53:04,967|MAXIMALS|app-20190625075133-0133|4|15|110.0|3|1350|40.036|30329 2019-06-25 07:53:05,986|FF|app-20190625075133-0133|15|4| END| 93.35|1.Maximal disks found | 41.06| 30329|1 2019-06-25 07:53:05,986|FF|app-20190625075133-0133|15|4|START| 93.35|2.Join done | 0.00| 0|1 2019-06-25 07:53:09,535|FF|app-20190625075133-0133|15|4| END| 96.89|2.Join done | 3.55| 65661|1 2019-06-25 07:53:09,536|FF|app-20190625075133-0133|15|4|START| 96.90|3.Flocks to report | 0.00| 0|1 2019-06-25 07:53:10,155|FF|app-20190625075133-0133|15|4| END| 97.51|3.Flocks to report | 0.62| 0|1 2019-06-25 07:53:10,155|FF|app-20190625075133-0133|15|4|START| 97.51|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:53:10,224|FF|app-20190625075133-0133|15|4| END| 97.58|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 07:53:10,224|FF|app-20190625075133-0133|15|4|START| 97.58|5.Flocks reported | 0.00| 0|1 2019-06-25 07:53:10,229|FF|app-20190625075133-0133|15|4| END| 97.59|5.Flocks reported | 0.01| 0|1 2019-06-25 07:53:10,229|FF|app-20190625075133-0133|15|4|START| 97.59|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:53:11,987|FF|app-20190625075133-0133|15|4| END| 99.35|6.Candidates indexed | 1.76| 67476|1 2019-06-25 07:53:11,987|FF|app-20190625075133-0133|15|4|START| 99.35|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:53:11,988|MF|app-20190625075133-0133|15|4|START| 99.35|A.Points indexed | 0.00| 0|2 2019-06-25 07:53:12,153|MF|app-20190625075133-0133|15|4| END| 99.51|A.Points indexed | 0.17| 55182|2 2019-06-25 07:53:12,153|MF|app-20190625075133-0133|15|4|START| 99.51|B.Pairs found | 0.00| 0|2 2019-06-25 07:53:13,089|MF|app-20190625075133-0133|15|4| END|100.45|B.Pairs found | 0.94|121698|2 2019-06-25 07:53:13,089|MF|app-20190625075133-0133|15|4|START|100.45|C.Centers found | 0.00| 0|2 2019-06-25 07:53:14,022|MF|app-20190625075133-0133|15|4| END|101.38|C.Centers found | 0.93|243396|2 2019-06-25 07:53:14,022|MF|app-20190625075133-0133|15|4|START|101.38|D.Disks found | 0.00| 0|2 2019-06-25 07:53:17,886|MF|app-20190625075133-0133|15|4| END|105.25|D.Disks found | 3.86|109059|2 2019-06-25 07:53:17,886|MF|app-20190625075133-0133|15|4|START|105.25|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:53:19,039|MF|app-20190625075133-0133|15|4| END|106.40|E.Disks partitioned | 1.15|159559|2 2019-06-25 07:53:19,039|MF|app-20190625075133-0133|15|4|START|106.40|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:53:19,040|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:53:19,040|Cell area: 1055533.7681000116 2019-06-25 07:53:47,755|MF|app-20190625075133-0133|15|4| END|135.11|F.Maximal disks found | 28.72| 31016|2 2019-06-25 07:53:47,755|MAXIMALS|app-20190625075133-0133|4|15|110.0|3|1350|35.767|31016 2019-06-25 07:53:48,804|FF|app-20190625075133-0133|15|4| END|136.16|1.Maximal disks found | 36.82| 31016|2 2019-06-25 07:53:48,804|FF|app-20190625075133-0133|15|4|START|136.16|2.Join done | 0.00| 0|2 2019-06-25 07:54:05,180|FF|app-20190625075133-0133|15|4| END|152.54|2.Join done | 16.38|134462|2 2019-06-25 07:54:05,180|FF|app-20190625075133-0133|15|4|START|152.54|3.Flocks to report | 0.00| 0|2 2019-06-25 07:54:07,723|FF|app-20190625075133-0133|15|4| END|155.08|3.Flocks to report | 2.54|114833|2 2019-06-25 07:54:07,723|FF|app-20190625075133-0133|15|4|START|155.08|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 07:54:07,802|FF|app-20190625075133-0133|15|4|START|155.16|4a.Making expansions | 0.00| 0|2 2019-06-25 07:54:09,003|FF|app-20190625075133-0133|15|4| END|156.36|4a.Making expansions | 1.20|143130|2 2019-06-25 07:54:09,003|FF|app-20190625075133-0133|15|4|START|156.36|4b.Finding maximals | 0.00| 0|2 2019-06-25 07:54:58,144|FF|app-20190625075133-0133|15|4| END|205.50|4b.Finding maximals | 49.14| 19803|2 2019-06-25 07:54:58,597|FF|app-20190625075133-0133|15|4| END|205.96|4.Flocks prunned by expansion | 50.87| 19803|2 2019-06-25 07:54:58,597|FF|app-20190625075133-0133|15|4|START|205.96|5.Flocks reported | 0.00| 0|2 2019-06-25 07:54:59,203|FF|app-20190625075133-0133|15|4| END|206.56|5.Flocks reported | 0.61| 19803|2 2019-06-25 07:54:59,203|FF|app-20190625075133-0133|15|4|START|206.56|6.Candidates indexed | 0.00| 0|2 2019-06-25 07:55:01,268|FF|app-20190625075133-0133|15|4| END|208.63|6.Candidates indexed | 2.07| 41368|2 2019-06-25 07:55:01,268|FF|app-20190625075133-0133|15|4|START|208.63|1.Maximal disks found | 0.00| 0|3 2019-06-25 07:55:01,268|MF|app-20190625075133-0133|15|4|START|208.63|A.Points indexed | 0.00| 0|3 2019-06-25 07:55:01,390|MF|app-20190625075133-0133|15|4| END|208.75|A.Points indexed | 0.12| 55644|3 2019-06-25 07:55:01,390|MF|app-20190625075133-0133|15|4|START|208.75|B.Pairs found | 0.00| 0|3 2019-06-25 07:55:02,256|MF|app-20190625075133-0133|15|4| END|209.62|B.Pairs found | 0.87|123771|3 2019-06-25 07:55:02,256|MF|app-20190625075133-0133|15|4|START|209.62|C.Centers found | 0.00| 0|3 2019-06-25 07:55:03,050|MF|app-20190625075133-0133|15|4| END|210.41|C.Centers found | 0.79|247542|3 2019-06-25 07:55:03,050|MF|app-20190625075133-0133|15|4|START|210.41|D.Disks found | 0.00| 0|3 2019-06-25 07:55:09,828|MF|app-20190625075133-0133|15|4| END|217.19|D.Disks found | 6.78|111261|3 2019-06-25 07:55:09,828|MF|app-20190625075133-0133|15|4|START|217.19|E.Disks partitioned | 0.00| 0|3 2019-06-25 07:55:12,775|MF|app-20190625075133-0133|15|4| END|220.13|E.Disks partitioned | 2.95|162756|3 2019-06-25 07:55:12,775|MF|app-20190625075133-0133|15|4|START|220.13|F.Maximal disks found | 0.00| 0|3 2019-06-25 07:55:12,776|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:55:12,776|Cell area: 1055533.7681000116 2019-06-25 07:55:46,716|MF|app-20190625075133-0133|15|4| END|254.08|F.Maximal disks found | 33.94| 31512|3 2019-06-25 07:55:46,716|MAXIMALS|app-20190625075133-0133|4|15|110.0|3|1350|45.448|31512 2019-06-25 07:55:47,752|FF|app-20190625075133-0133|15|4| END|255.11|1.Maximal disks found | 46.48| 31512|3 2019-06-25 07:55:47,752|FF|app-20190625075133-0133|15|4|START|255.11|2.Join done | 0.00| 0|3 2019-06-25 07:56:02,797|FF|app-20190625075133-0133|15|4| END|270.16|2.Join done | 15.05|134798|3 2019-06-25 07:56:02,797|FF|app-20190625075133-0133|15|4|START|270.16|3.Flocks to report | 0.00| 0|3 2019-06-25 07:56:06,499|FF|app-20190625075133-0133|15|4| END|273.86|3.Flocks to report | 3.70|115131|3 2019-06-25 07:56:06,499|FF|app-20190625075133-0133|15|4|START|273.86|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 07:56:06,593|FF|app-20190625075133-0133|15|4|START|273.95|4a.Making expansions | 0.00| 0|3 2019-06-25 07:56:08,043|FF|app-20190625075133-0133|15|4| END|275.40|4a.Making expansions | 1.45|143307|3 2019-06-25 07:56:08,043|FF|app-20190625075133-0133|15|4|START|275.40|4b.Finding maximals | 0.00| 0|3 2019-06-25 07:57:17,372|FF|app-20190625075133-0133|15|4| END|344.73|4b.Finding maximals | 69.33| 20007|3 2019-06-25 07:57:17,855|FF|app-20190625075133-0133|15|4| END|345.21|4.Flocks prunned by expansion | 71.36| 20007|3 2019-06-25 07:57:17,856|FF|app-20190625075133-0133|15|4|START|345.22|5.Flocks reported | 0.00| 0|3 2019-06-25 07:57:18,444|FF|app-20190625075133-0133|15|4| END|345.80|5.Flocks reported | 0.59| 20007|3 2019-06-25 07:57:18,444|FF|app-20190625075133-0133|15|4|START|345.80|6.Candidates indexed | 0.00| 0|3 2019-06-25 07:57:20,679|FF|app-20190625075133-0133|15|4| END|348.04|6.Candidates indexed | 2.24| 41642|3 2019-06-25 07:57:22,077|Number of flocks: 39810 2019-06-25 07:57:23,028|PFLOCK|app-20190625075133-0133|4|15|110.0|3|3|342.67|39810 2019-06-25 07:57:23,981|FF|app-20190625075133-0133|15|4| END|351.34|Flock Finder run |344.57| 39810|3 2019-06-25 07:57:23,981|FF|app-20190625075133-0133|15|4|START|351.34|Session closed | 0.00| 0|3 2019-06-25 07:57:31,440|FF|app-20190625075133-0133|15|4| END|358.80|Session closed | 7.46| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 07:57:33,407|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 07:57:34,518|FF|app-20190625075734-0134|10|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 07:57:34,519|FF|app-20190625075734-0134|10|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 07:57:38,735|FF|app-20190625075734-0134|10|4| END| 5.31|Data read | 4.22|220752|-1 2019-06-25 07:57:38,736|FF|app-20190625075734-0134|10|4|START| 5.31|KDBTree partitioner | 0.00| 0|-1 2019-06-25 07:57:38,955|FF|app-20190625075734-0134|10|4| END| 5.53|KDBTree partitioner | 0.22| 544|-1 2019-06-25 07:57:38,956|FF|app-20190625075734-0134|10|4|START| 5.53|MF partitioner | 0.00| 0|-1 2019-06-25 07:57:38,976|FF|app-20190625075734-0134|10|4| END| 5.55|MF partitioner | 0.02| 900|-1 2019-06-25 07:57:38,976|FF|app-20190625075734-0134|10|4|START| 5.55|Pointset done | 0.00| 0|-1 2019-06-25 07:57:39,909|FF|app-20190625075734-0134|10|4| END| 6.49|Pointset done | 0.93| 4|-1 2019-06-25 07:57:39,909|FF|app-20190625075734-0134|10|4|START| 6.49|Flock Finder run | 0.00| 0|-1 2019-06-25 07:57:39,930|FF|app-20190625075734-0134|10|4|START| 6.51|1.Maximal disks found | 0.00| 0|0 2019-06-25 07:57:39,934|MF|app-20190625075734-0134|10|4|START| 6.51|A.Points indexed | 0.00| 0|0 2019-06-25 07:57:40,110|MF|app-20190625075734-0134|10|4| END| 6.69|A.Points indexed | 0.18| 36186|0 2019-06-25 07:57:40,110|MF|app-20190625075734-0134|10|4|START| 6.69|B.Pairs found | 0.00| 0|0 2019-06-25 07:57:42,410|MF|app-20190625075734-0134|10|4| END| 8.99|B.Pairs found | 2.30| 78808|0 2019-06-25 07:57:42,410|MF|app-20190625075734-0134|10|4|START| 8.99|C.Centers found | 0.00| 0|0 2019-06-25 07:57:44,098|MF|app-20190625075734-0134|10|4| END| 10.67|C.Centers found | 1.69|157616|0 2019-06-25 07:57:44,098|MF|app-20190625075734-0134|10|4|START| 10.67|D.Disks found | 0.00| 0|0 2019-06-25 07:57:52,510|MF|app-20190625075734-0134|10|4| END| 19.09|D.Disks found | 8.41| 70458|0 2019-06-25 07:57:52,510|MF|app-20190625075734-0134|10|4|START| 19.09|E.Disks partitioned | 0.00| 0|0 2019-06-25 07:57:56,976|MF|app-20190625075734-0134|10|4| END| 23.55|E.Disks partitioned | 4.47|103004|0 2019-06-25 07:57:56,976|MF|app-20190625075734-0134|10|4|START| 23.55|F.Maximal disks found | 0.00| 0|0 2019-06-25 07:57:56,978|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:57:56,978|Cell area: 1055533.7681000116 2019-06-25 07:58:25,793|MF|app-20190625075734-0134|10|4| END| 52.37|F.Maximal disks found | 28.82| 20001|0 2019-06-25 07:58:25,793|MAXIMALS|app-20190625075734-0134|4|10|110.0|3|900|45.86|20001 2019-06-25 07:58:27,380|FF|app-20190625075734-0134|10|4| END| 53.96|1.Maximal disks found | 47.45| 20001|0 2019-06-25 07:58:27,381|FF|app-20190625075734-0134|10|4|START| 53.96|1.Maximal disks found | 0.00| 0|1 2019-06-25 07:58:27,381|MF|app-20190625075734-0134|10|4|START| 53.96|A.Points indexed | 0.00| 0|1 2019-06-25 07:58:27,473|MF|app-20190625075734-0134|10|4| END| 54.05|A.Points indexed | 0.09| 36490|1 2019-06-25 07:58:27,473|MF|app-20190625075734-0134|10|4|START| 54.05|B.Pairs found | 0.00| 0|1 2019-06-25 07:58:28,594|MF|app-20190625075734-0134|10|4| END| 55.17|B.Pairs found | 1.12| 79998|1 2019-06-25 07:58:28,594|MF|app-20190625075734-0134|10|4|START| 55.17|C.Centers found | 0.00| 0|1 2019-06-25 07:58:29,978|MF|app-20190625075734-0134|10|4| END| 56.55|C.Centers found | 1.38|159996|1 2019-06-25 07:58:29,978|MF|app-20190625075734-0134|10|4|START| 56.55|D.Disks found | 0.00| 0|1 2019-06-25 07:58:35,285|MF|app-20190625075734-0134|10|4| END| 61.86|D.Disks found | 5.31| 71698|1 2019-06-25 07:58:35,285|MF|app-20190625075734-0134|10|4|START| 61.86|E.Disks partitioned | 0.00| 0|1 2019-06-25 07:58:37,946|MF|app-20190625075734-0134|10|4| END| 64.52|E.Disks partitioned | 2.66|104758|1 2019-06-25 07:58:37,947|MF|app-20190625075734-0134|10|4|START| 64.52|F.Maximal disks found | 0.00| 0|1 2019-06-25 07:58:37,947|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:58:37,947|Cell area: 1055533.7681000116 2019-06-25 07:59:04,115|MF|app-20190625075734-0134|10|4| END| 90.69|F.Maximal disks found | 26.17| 20222|1 2019-06-25 07:59:04,116|MAXIMALS|app-20190625075734-0134|4|10|110.0|3|900|36.735|20222 2019-06-25 07:59:05,136|FF|app-20190625075734-0134|10|4| END| 91.71|1.Maximal disks found | 37.76| 20222|1 2019-06-25 07:59:05,136|FF|app-20190625075734-0134|10|4|START| 91.71|2.Join done | 0.00| 0|1 2019-06-25 07:59:11,717|FF|app-20190625075734-0134|10|4| END| 98.29|2.Join done | 6.58| 43837|1 2019-06-25 07:59:11,718|FF|app-20190625075734-0134|10|4|START| 98.29|3.Flocks to report | 0.00| 0|1 2019-06-25 07:59:13,083|FF|app-20190625075734-0134|10|4| END| 99.66|3.Flocks to report | 1.37| 0|1 2019-06-25 07:59:13,083|FF|app-20190625075734-0134|10|4|START| 99.66|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 07:59:13,150|FF|app-20190625075734-0134|10|4| END| 99.73|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 07:59:13,150|FF|app-20190625075734-0134|10|4|START| 99.73|5.Flocks reported | 0.00| 0|1 2019-06-25 07:59:13,155|FF|app-20190625075734-0134|10|4| END| 99.73|5.Flocks reported | 0.01| 0|1 2019-06-25 07:59:13,155|FF|app-20190625075734-0134|10|4|START| 99.73|6.Candidates indexed | 0.00| 0|1 2019-06-25 07:59:15,881|FF|app-20190625075734-0134|10|4| END|102.46|6.Candidates indexed | 2.73| 45047|1 2019-06-25 07:59:15,881|FF|app-20190625075734-0134|10|4|START|102.46|1.Maximal disks found | 0.00| 0|2 2019-06-25 07:59:15,881|MF|app-20190625075734-0134|10|4|START|102.46|A.Points indexed | 0.00| 0|2 2019-06-25 07:59:15,973|MF|app-20190625075734-0134|10|4| END|102.55|A.Points indexed | 0.09| 36788|2 2019-06-25 07:59:15,973|MF|app-20190625075734-0134|10|4|START|102.55|B.Pairs found | 0.00| 0|2 2019-06-25 07:59:16,748|MF|app-20190625075734-0134|10|4| END|103.32|B.Pairs found | 0.78| 81132|2 2019-06-25 07:59:16,748|MF|app-20190625075734-0134|10|4|START|103.32|C.Centers found | 0.00| 0|2 2019-06-25 07:59:17,618|MF|app-20190625075734-0134|10|4| END|104.19|C.Centers found | 0.87|162264|2 2019-06-25 07:59:17,618|MF|app-20190625075734-0134|10|4|START|104.19|D.Disks found | 0.00| 0|2 2019-06-25 07:59:23,151|MF|app-20190625075734-0134|10|4| END|109.73|D.Disks found | 5.53| 72706|2 2019-06-25 07:59:23,151|MF|app-20190625075734-0134|10|4|START|109.73|E.Disks partitioned | 0.00| 0|2 2019-06-25 07:59:27,846|MF|app-20190625075734-0134|10|4| END|114.42|E.Disks partitioned | 4.70|106347|2 2019-06-25 07:59:27,846|MF|app-20190625075734-0134|10|4|START|114.42|F.Maximal disks found | 0.00| 0|2 2019-06-25 07:59:27,846|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 07:59:27,846|Cell area: 1055533.7681000116 2019-06-25 07:59:57,923|MF|app-20190625075734-0134|10|4| END|144.50|F.Maximal disks found | 30.08| 20682|2 2019-06-25 07:59:57,923|MAXIMALS|app-20190625075734-0134|4|10|110.0|3|900|42.042|20682 2019-06-25 07:59:59,496|FF|app-20190625075734-0134|10|4| END|146.07|1.Maximal disks found | 43.61| 20682|2 2019-06-25 07:59:59,496|FF|app-20190625075734-0134|10|4|START|146.07|2.Join done | 0.00| 0|2 2019-06-25 08:00:29,550|FF|app-20190625075734-0134|10|4| END|176.13|2.Join done | 30.05| 89740|2 2019-06-25 08:00:29,550|FF|app-20190625075734-0134|10|4|START|176.13|3.Flocks to report | 0.00| 0|2 2019-06-25 08:00:34,215|FF|app-20190625075734-0134|10|4| END|180.79|3.Flocks to report | 4.67| 76643|2 2019-06-25 08:00:34,215|FF|app-20190625075734-0134|10|4|START|180.79|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:00:34,305|FF|app-20190625075734-0134|10|4|START|180.88|4a.Making expansions | 0.00| 0|2 2019-06-25 08:00:36,716|FF|app-20190625075734-0134|10|4| END|183.29|4a.Making expansions | 2.41| 95701|2 2019-06-25 08:00:36,716|FF|app-20190625075734-0134|10|4|START|183.29|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:01:21,205|FF|app-20190625075734-0134|10|4| END|227.78|4b.Finding maximals | 44.49| 13202|2 2019-06-25 08:01:21,856|FF|app-20190625075734-0134|10|4| END|228.43|4.Flocks prunned by expansion | 47.64| 13202|2 2019-06-25 08:01:21,857|FF|app-20190625075734-0134|10|4|START|228.43|5.Flocks reported | 0.00| 0|2 2019-06-25 08:01:22,848|FF|app-20190625075734-0134|10|4| END|229.42|5.Flocks reported | 0.99| 13202|2 2019-06-25 08:01:22,848|FF|app-20190625075734-0134|10|4|START|229.42|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:01:26,975|FF|app-20190625075734-0134|10|4| END|233.55|6.Candidates indexed | 4.13| 27595|2 2019-06-25 08:01:26,975|FF|app-20190625075734-0134|10|4|START|233.55|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:01:26,975|MF|app-20190625075734-0134|10|4|START|233.55|A.Points indexed | 0.00| 0|3 2019-06-25 08:01:27,061|MF|app-20190625075734-0134|10|4| END|233.64|A.Points indexed | 0.09| 37096|3 2019-06-25 08:01:27,061|MF|app-20190625075734-0134|10|4|START|233.64|B.Pairs found | 0.00| 0|3 2019-06-25 08:01:27,717|MF|app-20190625075734-0134|10|4| END|234.29|B.Pairs found | 0.66| 82514|3 2019-06-25 08:01:27,717|MF|app-20190625075734-0134|10|4|START|234.29|C.Centers found | 0.00| 0|3 2019-06-25 08:01:28,528|MF|app-20190625075734-0134|10|4| END|235.10|C.Centers found | 0.81|165028|3 2019-06-25 08:01:28,528|MF|app-20190625075734-0134|10|4|START|235.10|D.Disks found | 0.00| 0|3 2019-06-25 08:01:32,850|MF|app-20190625075734-0134|10|4| END|239.43|D.Disks found | 4.32| 74174|3 2019-06-25 08:01:32,850|MF|app-20190625075734-0134|10|4|START|239.43|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:01:34,925|MF|app-20190625075734-0134|10|4| END|241.50|E.Disks partitioned | 2.08|108468|3 2019-06-25 08:01:34,926|MF|app-20190625075734-0134|10|4|START|241.50|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:01:34,926|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:01:34,926|Cell area: 1055533.7681000116 2019-06-25 08:02:07,916|MF|app-20190625075734-0134|10|4| END|274.49|F.Maximal disks found | 32.99| 21009|3 2019-06-25 08:02:07,916|MAXIMALS|app-20190625075734-0134|4|10|110.0|3|900|40.941|21009 2019-06-25 08:02:08,633|FF|app-20190625075734-0134|10|4| END|275.21|1.Maximal disks found | 41.66| 21009|3 2019-06-25 08:02:08,633|FF|app-20190625075734-0134|10|4|START|275.21|2.Join done | 0.00| 0|3 2019-06-25 08:02:19,690|FF|app-20190625075734-0134|10|4| END|286.27|2.Join done | 11.06| 90003|3 2019-06-25 08:02:19,690|FF|app-20190625075734-0134|10|4|START|286.27|3.Flocks to report | 0.00| 0|3 2019-06-25 08:02:21,974|FF|app-20190625075734-0134|10|4| END|288.55|3.Flocks to report | 2.28| 76861|3 2019-06-25 08:02:21,974|FF|app-20190625075734-0134|10|4|START|288.55|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:02:22,044|FF|app-20190625075734-0134|10|4|START|288.62|4a.Making expansions | 0.00| 0|3 2019-06-25 08:02:23,600|FF|app-20190625075734-0134|10|4| END|290.18|4a.Making expansions | 1.56| 95896|3 2019-06-25 08:02:23,600|FF|app-20190625075734-0134|10|4|START|290.18|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:03:28,499|FF|app-20190625075734-0134|10|4| END|355.08|4b.Finding maximals | 64.90| 13338|3 2019-06-25 08:03:28,945|FF|app-20190625075734-0134|10|4| END|355.52|4.Flocks prunned by expansion | 66.97| 13338|3 2019-06-25 08:03:28,945|FF|app-20190625075734-0134|10|4|START|355.52|5.Flocks reported | 0.00| 0|3 2019-06-25 08:03:29,664|FF|app-20190625075734-0134|10|4| END|356.24|5.Flocks reported | 0.72| 13338|3 2019-06-25 08:03:29,664|FF|app-20190625075734-0134|10|4|START|356.24|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:03:32,097|FF|app-20190625075734-0134|10|4| END|358.67|6.Candidates indexed | 2.43| 27789|3 2019-06-25 08:03:33,686|Number of flocks: 26540 2019-06-25 08:03:35,054|PFLOCK|app-20190625075734-0134|4|10|110.0|3|3|353.78|26540 2019-06-25 08:03:35,864|FF|app-20190625075734-0134|10|4| END|362.44|Flock Finder run |355.96| 26540|3 2019-06-25 08:03:35,864|FF|app-20190625075734-0134|10|4|START|362.44|Session closed | 0.00| 0|3 2019-06-25 08:03:42,764|FF|app-20190625075734-0134|10|4| END|369.34|Session closed | 6.90| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:03:44,680|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:03:45,763|FF|app-20190625080345-0135|5|4| END| 1.07|Session start | 1.09| 0|-1 2019-06-25 08:03:45,763|FF|app-20190625080345-0135|5|4|START| 1.07|Data read | 0.00| 0|-1 2019-06-25 08:03:49,618|FF|app-20190625080345-0135|5|4| END| 4.92|Data read | 3.86|110376|-1 2019-06-25 08:03:49,619|FF|app-20190625080345-0135|5|4|START| 4.92|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:03:49,731|FF|app-20190625080345-0135|5|4| END| 5.04|KDBTree partitioner | 0.11| 272|-1 2019-06-25 08:03:49,731|FF|app-20190625080345-0135|5|4|START| 5.04|MF partitioner | 0.00| 0|-1 2019-06-25 08:03:49,740|FF|app-20190625080345-0135|5|4| END| 5.04|MF partitioner | 0.01| 450|-1 2019-06-25 08:03:49,740|FF|app-20190625080345-0135|5|4|START| 5.04|Pointset done | 0.00| 0|-1 2019-06-25 08:03:50,753|FF|app-20190625080345-0135|5|4| END| 6.06|Pointset done | 1.01| 4|-1 2019-06-25 08:03:50,753|FF|app-20190625080345-0135|5|4|START| 6.06|Flock Finder run | 0.00| 0|-1 2019-06-25 08:03:50,770|FF|app-20190625080345-0135|5|4|START| 6.07|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:03:50,772|MF|app-20190625080345-0135|5|4|START| 6.08|A.Points indexed | 0.00| 0|0 2019-06-25 08:03:50,919|MF|app-20190625080345-0135|5|4| END| 6.22|A.Points indexed | 0.15| 18093|0 2019-06-25 08:03:50,919|MF|app-20190625080345-0135|5|4|START| 6.22|B.Pairs found | 0.00| 0|0 2019-06-25 08:03:52,202|MF|app-20190625080345-0135|5|4| END| 7.51|B.Pairs found | 1.28| 39404|0 2019-06-25 08:03:52,202|MF|app-20190625080345-0135|5|4|START| 7.51|C.Centers found | 0.00| 0|0 2019-06-25 08:03:52,992|MF|app-20190625080345-0135|5|4| END| 8.30|C.Centers found | 0.79| 78808|0 2019-06-25 08:03:52,992|MF|app-20190625080345-0135|5|4|START| 8.30|D.Disks found | 0.00| 0|0 2019-06-25 08:03:56,113|MF|app-20190625080345-0135|5|4| END| 11.42|D.Disks found | 3.12| 35229|0 2019-06-25 08:03:56,113|MF|app-20190625080345-0135|5|4|START| 11.42|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:03:57,390|MF|app-20190625080345-0135|5|4| END| 12.69|E.Disks partitioned | 1.28| 51442|0 2019-06-25 08:03:57,390|MF|app-20190625080345-0135|5|4|START| 12.69|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:03:57,391|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:03:57,391|Cell area: 1055533.7681000116 2019-06-25 08:04:23,401|MF|app-20190625080345-0135|5|4| END| 38.71|F.Maximal disks found | 26.01| 10001|0 2019-06-25 08:04:23,401|MAXIMALS|app-20190625080345-0135|4|5|110.0|3|450|32.629|10001 2019-06-25 08:04:23,900|FF|app-20190625080345-0135|5|4| END| 39.20|1.Maximal disks found | 33.13| 10001|0 2019-06-25 08:04:23,900|FF|app-20190625080345-0135|5|4|START| 39.20|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:04:23,900|MF|app-20190625080345-0135|5|4|START| 39.20|A.Points indexed | 0.00| 0|1 2019-06-25 08:04:23,984|MF|app-20190625080345-0135|5|4| END| 39.29|A.Points indexed | 0.08| 18245|1 2019-06-25 08:04:23,984|MF|app-20190625080345-0135|5|4|START| 39.29|B.Pairs found | 0.00| 0|1 2019-06-25 08:04:24,432|MF|app-20190625080345-0135|5|4| END| 39.74|B.Pairs found | 0.45| 39999|1 2019-06-25 08:04:24,432|MF|app-20190625080345-0135|5|4|START| 39.74|C.Centers found | 0.00| 0|1 2019-06-25 08:04:24,831|MF|app-20190625080345-0135|5|4| END| 40.14|C.Centers found | 0.40| 79998|1 2019-06-25 08:04:24,831|MF|app-20190625080345-0135|5|4|START| 40.14|D.Disks found | 0.00| 0|1 2019-06-25 08:04:27,125|MF|app-20190625080345-0135|5|4| END| 42.43|D.Disks found | 2.29| 35849|1 2019-06-25 08:04:27,125|MF|app-20190625080345-0135|5|4|START| 42.43|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:04:28,136|MF|app-20190625080345-0135|5|4| END| 43.44|E.Disks partitioned | 1.01| 52317|1 2019-06-25 08:04:28,137|MF|app-20190625080345-0135|5|4|START| 43.44|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:04:28,137|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:04:28,137|Cell area: 1055533.7681000116 2019-06-25 08:04:53,595|MF|app-20190625080345-0135|5|4| END| 68.90|F.Maximal disks found | 25.46| 10110|1 2019-06-25 08:04:53,595|MAXIMALS|app-20190625080345-0135|4|5|110.0|3|450|29.695|10110 2019-06-25 08:04:54,036|FF|app-20190625080345-0135|5|4| END| 69.34|1.Maximal disks found | 30.14| 10110|1 2019-06-25 08:04:54,036|FF|app-20190625080345-0135|5|4|START| 69.34|2.Join done | 0.00| 0|1 2019-06-25 08:04:56,527|FF|app-20190625080345-0135|5|4| END| 71.83|2.Join done | 2.49| 21993|1 2019-06-25 08:04:56,528|FF|app-20190625080345-0135|5|4|START| 71.83|3.Flocks to report | 0.00| 0|1 2019-06-25 08:04:57,050|FF|app-20190625080345-0135|5|4| END| 72.35|3.Flocks to report | 0.52| 0|1 2019-06-25 08:04:57,051|FF|app-20190625080345-0135|5|4|START| 72.36|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:04:57,090|FF|app-20190625080345-0135|5|4| END| 72.39|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 08:04:57,090|FF|app-20190625080345-0135|5|4|START| 72.39|5.Flocks reported | 0.00| 0|1 2019-06-25 08:04:57,094|FF|app-20190625080345-0135|5|4| END| 72.40|5.Flocks reported | 0.00| 0|1 2019-06-25 08:04:57,094|FF|app-20190625080345-0135|5|4|START| 72.40|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:04:58,906|FF|app-20190625080345-0135|5|4| END| 74.21|6.Candidates indexed | 1.81| 22599|1 2019-06-25 08:04:58,906|FF|app-20190625080345-0135|5|4|START| 74.21|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:04:58,906|MF|app-20190625080345-0135|5|4|START| 74.21|A.Points indexed | 0.00| 0|2 2019-06-25 08:04:58,978|MF|app-20190625080345-0135|5|4| END| 74.28|A.Points indexed | 0.07| 18394|2 2019-06-25 08:04:58,978|MF|app-20190625080345-0135|5|4|START| 74.28|B.Pairs found | 0.00| 0|2 2019-06-25 08:04:59,440|MF|app-20190625080345-0135|5|4| END| 74.74|B.Pairs found | 0.46| 40566|2 2019-06-25 08:04:59,441|MF|app-20190625080345-0135|5|4|START| 74.75|C.Centers found | 0.00| 0|2 2019-06-25 08:04:59,850|MF|app-20190625080345-0135|5|4| END| 75.15|C.Centers found | 0.41| 81132|2 2019-06-25 08:04:59,850|MF|app-20190625080345-0135|5|4|START| 75.15|D.Disks found | 0.00| 0|2 2019-06-25 08:05:01,793|MF|app-20190625080345-0135|5|4| END| 77.10|D.Disks found | 1.94| 36353|2 2019-06-25 08:05:01,793|MF|app-20190625080345-0135|5|4|START| 77.10|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:05:02,501|MF|app-20190625080345-0135|5|4| END| 77.81|E.Disks partitioned | 0.71| 53134|2 2019-06-25 08:05:02,501|MF|app-20190625080345-0135|5|4|START| 77.81|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:05:02,501|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:05:02,501|Cell area: 1055533.7681000116 2019-06-25 08:05:28,439|MF|app-20190625080345-0135|5|4| END|103.74|F.Maximal disks found | 25.94| 10342|2 2019-06-25 08:05:28,439|MAXIMALS|app-20190625080345-0135|4|5|110.0|3|450|29.533|10342 2019-06-25 08:05:28,811|FF|app-20190625080345-0135|5|4| END|104.12|1.Maximal disks found | 29.91| 10342|2 2019-06-25 08:05:28,811|FF|app-20190625080345-0135|5|4|START|104.12|2.Join done | 0.00| 0|2 2019-06-25 08:05:44,273|FF|app-20190625080345-0135|5|4| END|119.58|2.Join done | 15.46| 45000|2 2019-06-25 08:05:44,273|FF|app-20190625080345-0135|5|4|START|119.58|3.Flocks to report | 0.00| 0|2 2019-06-25 08:05:46,702|FF|app-20190625080345-0135|5|4| END|122.01|3.Flocks to report | 2.43| 38432|2 2019-06-25 08:05:46,702|FF|app-20190625080345-0135|5|4|START|122.01|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:05:46,760|FF|app-20190625080345-0135|5|4|START|122.06|4a.Making expansions | 0.00| 0|2 2019-06-25 08:05:48,118|FF|app-20190625080345-0135|5|4| END|123.42|4a.Making expansions | 1.36| 47766|2 2019-06-25 08:05:48,118|FF|app-20190625080345-0135|5|4|START|123.42|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:06:33,953|FF|app-20190625080345-0135|5|4| END|169.26|4b.Finding maximals | 45.84| 6601|2 2019-06-25 08:06:34,255|FF|app-20190625080345-0135|5|4| END|169.56|4.Flocks prunned by expansion | 47.55| 6601|2 2019-06-25 08:06:34,255|FF|app-20190625080345-0135|5|4|START|169.56|5.Flocks reported | 0.00| 0|2 2019-06-25 08:06:34,766|FF|app-20190625080345-0135|5|4| END|170.07|5.Flocks reported | 0.51| 6601|2 2019-06-25 08:06:34,766|FF|app-20190625080345-0135|5|4|START|170.07|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:06:38,639|FF|app-20190625080345-0135|5|4| END|173.94|6.Candidates indexed | 3.87| 13819|2 2019-06-25 08:06:38,639|FF|app-20190625080345-0135|5|4|START|173.94|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:06:38,639|MF|app-20190625080345-0135|5|4|START|173.94|A.Points indexed | 0.00| 0|3 2019-06-25 08:06:38,704|MF|app-20190625080345-0135|5|4| END|174.01|A.Points indexed | 0.07| 18548|3 2019-06-25 08:06:38,705|MF|app-20190625080345-0135|5|4|START|174.01|B.Pairs found | 0.00| 0|3 2019-06-25 08:06:39,233|MF|app-20190625080345-0135|5|4| END|174.54|B.Pairs found | 0.53| 41257|3 2019-06-25 08:06:39,233|MF|app-20190625080345-0135|5|4|START|174.54|C.Centers found | 0.00| 0|3 2019-06-25 08:06:39,853|MF|app-20190625080345-0135|5|4| END|175.16|C.Centers found | 0.62| 82514|3 2019-06-25 08:06:39,853|MF|app-20190625080345-0135|5|4|START|175.16|D.Disks found | 0.00| 0|3 2019-06-25 08:06:43,051|MF|app-20190625080345-0135|5|4| END|178.36|D.Disks found | 3.20| 37087|3 2019-06-25 08:06:43,051|MF|app-20190625080345-0135|5|4|START|178.36|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:06:44,161|MF|app-20190625080345-0135|5|4| END|179.47|E.Disks partitioned | 1.11| 54196|3 2019-06-25 08:06:44,161|MF|app-20190625080345-0135|5|4|START|179.47|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:06:44,161|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:06:44,161|Cell area: 1055533.7681000116 2019-06-25 08:07:16,433|MF|app-20190625080345-0135|5|4| END|211.74|F.Maximal disks found | 32.27| 10503|3 2019-06-25 08:07:16,433|MAXIMALS|app-20190625080345-0135|4|5|110.0|3|450|37.794|10503 2019-06-25 08:07:16,886|FF|app-20190625080345-0135|5|4| END|212.19|1.Maximal disks found | 38.25| 10503|3 2019-06-25 08:07:16,886|FF|app-20190625080345-0135|5|4|START|212.19|2.Join done | 0.00| 0|3 2019-06-25 08:07:24,331|FF|app-20190625080345-0135|5|4| END|219.64|2.Join done | 7.45| 45190|3 2019-06-25 08:07:24,331|FF|app-20190625080345-0135|5|4|START|219.64|3.Flocks to report | 0.00| 0|3 2019-06-25 08:07:25,599|FF|app-20190625080345-0135|5|4| END|220.90|3.Flocks to report | 1.27| 38589|3 2019-06-25 08:07:25,599|FF|app-20190625080345-0135|5|4|START|220.90|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:07:25,643|FF|app-20190625080345-0135|5|4|START|220.95|4a.Making expansions | 0.00| 0|3 2019-06-25 08:07:26,459|FF|app-20190625080345-0135|5|4| END|221.76|4a.Making expansions | 0.82| 47862|3 2019-06-25 08:07:26,459|FF|app-20190625080345-0135|5|4|START|221.76|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:08:26,582|FF|app-20190625080345-0135|5|4| END|281.89|4b.Finding maximals | 60.12| 6669|3 2019-06-25 08:08:26,773|FF|app-20190625080345-0135|5|4| END|282.08|4.Flocks prunned by expansion | 61.17| 6669|3 2019-06-25 08:08:26,773|FF|app-20190625080345-0135|5|4|START|282.08|5.Flocks reported | 0.00| 0|3 2019-06-25 08:08:27,097|FF|app-20190625080345-0135|5|4| END|282.40|5.Flocks reported | 0.32| 6669|3 2019-06-25 08:08:27,097|FF|app-20190625080345-0135|5|4|START|282.40|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:08:29,309|FF|app-20190625080345-0135|5|4| END|284.61|6.Candidates indexed | 2.21| 13927|3 2019-06-25 08:08:30,142|Number of flocks: 13270 2019-06-25 08:08:30,536|PFLOCK|app-20190625080345-0135|4|5|110.0|3|3|279.39|13270 2019-06-25 08:08:30,920|FF|app-20190625080345-0135|5|4| END|286.22|Flock Finder run |280.17| 13270|3 2019-06-25 08:08:30,920|FF|app-20190625080345-0135|5|4|START|286.22|Session closed | 0.00| 0|3 2019-06-25 08:08:37,931|FF|app-20190625080345-0135|5|4| END|293.24|Session closed | 7.01| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:08:39,937|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:08:41,048|FF|app-20190625080840-0136|15|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 08:08:41,048|FF|app-20190625080840-0136|15|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 08:08:45,112|FF|app-20190625080840-0136|15|4| END| 5.16|Data read | 4.06|331128|-1 2019-06-25 08:08:45,112|FF|app-20190625080840-0136|15|4|START| 5.16|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:08:45,297|FF|app-20190625080840-0136|15|4| END| 5.34|KDBTree partitioner | 0.19| 816|-1 2019-06-25 08:08:45,298|FF|app-20190625080840-0136|15|4|START| 5.34|MF partitioner | 0.00| 0|-1 2019-06-25 08:08:45,324|FF|app-20190625080840-0136|15|4| END| 5.37|MF partitioner | 0.03| 1350|-1 2019-06-25 08:08:45,324|FF|app-20190625080840-0136|15|4|START| 5.37|Pointset done | 0.00| 0|-1 2019-06-25 08:08:46,536|FF|app-20190625080840-0136|15|4| END| 6.58|Pointset done | 1.21| 4|-1 2019-06-25 08:08:46,536|FF|app-20190625080840-0136|15|4|START| 6.58|Flock Finder run | 0.00| 0|-1 2019-06-25 08:08:46,559|FF|app-20190625080840-0136|15|4|START| 6.61|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:08:46,562|MF|app-20190625080840-0136|15|4|START| 6.61|A.Points indexed | 0.00| 0|0 2019-06-25 08:08:46,774|MF|app-20190625080840-0136|15|4| END| 6.82|A.Points indexed | 0.21| 54279|0 2019-06-25 08:08:46,774|MF|app-20190625080840-0136|15|4|START| 6.82|B.Pairs found | 0.00| 0|0 2019-06-25 08:08:49,021|MF|app-20190625080840-0136|15|4| END| 9.07|B.Pairs found | 2.25| 71679|0 2019-06-25 08:08:49,021|MF|app-20190625080840-0136|15|4|START| 9.07|C.Centers found | 0.00| 0|0 2019-06-25 08:08:50,948|MF|app-20190625080840-0136|15|4| END| 10.99|C.Centers found | 1.93|143358|0 2019-06-25 08:08:50,948|MF|app-20190625080840-0136|15|4|START| 10.99|D.Disks found | 0.00| 0|0 2019-06-25 08:08:57,582|MF|app-20190625080840-0136|15|4| END| 17.63|D.Disks found | 6.63| 52353|0 2019-06-25 08:08:57,583|MF|app-20190625080840-0136|15|4|START| 17.63|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:08:59,161|MF|app-20190625080840-0136|15|4| END| 19.21|E.Disks partitioned | 1.58| 69681|0 2019-06-25 08:08:59,161|MF|app-20190625080840-0136|15|4|START| 19.21|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:08:59,163|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:08:59,163|Cell area: 1055533.7681000116 2019-06-25 08:09:01,317|MF|app-20190625080840-0136|15|4| END| 21.36|F.Maximal disks found | 2.16| 17026|0 2019-06-25 08:09:01,318|MAXIMALS|app-20190625080840-0136|4|15|80.0|3|1350|14.755|17026 2019-06-25 08:09:02,362|FF|app-20190625080840-0136|15|4| END| 22.41|1.Maximal disks found | 15.80| 17026|0 2019-06-25 08:09:02,362|FF|app-20190625080840-0136|15|4|START| 22.41|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:09:02,362|MF|app-20190625080840-0136|15|4|START| 22.41|A.Points indexed | 0.00| 0|1 2019-06-25 08:09:02,481|MF|app-20190625080840-0136|15|4| END| 22.53|A.Points indexed | 0.12| 54735|1 2019-06-25 08:09:02,481|MF|app-20190625080840-0136|15|4|START| 22.53|B.Pairs found | 0.00| 0|1 2019-06-25 08:09:03,556|MF|app-20190625080840-0136|15|4| END| 23.60|B.Pairs found | 1.08| 72729|1 2019-06-25 08:09:03,556|MF|app-20190625080840-0136|15|4|START| 23.60|C.Centers found | 0.00| 0|1 2019-06-25 08:09:05,608|MF|app-20190625080840-0136|15|4| END| 25.65|C.Centers found | 2.05|145458|1 2019-06-25 08:09:05,609|MF|app-20190625080840-0136|15|4|START| 25.66|D.Disks found | 0.00| 0|1 2019-06-25 08:09:12,226|MF|app-20190625080840-0136|15|4| END| 32.27|D.Disks found | 6.62| 53289|1 2019-06-25 08:09:12,226|MF|app-20190625080840-0136|15|4|START| 32.27|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:09:14,528|MF|app-20190625080840-0136|15|4| END| 34.57|E.Disks partitioned | 2.30| 70836|1 2019-06-25 08:09:14,528|MF|app-20190625080840-0136|15|4|START| 34.57|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:09:14,529|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:09:14,529|Cell area: 1055533.7681000116 2019-06-25 08:09:16,448|MF|app-20190625080840-0136|15|4| END| 36.49|F.Maximal disks found | 1.92| 17245|1 2019-06-25 08:09:16,448|MAXIMALS|app-20190625080840-0136|4|15|80.0|3|1350|14.086|17245 2019-06-25 08:09:17,482|FF|app-20190625080840-0136|15|4| END| 37.53|1.Maximal disks found | 15.12| 17245|1 2019-06-25 08:09:17,482|FF|app-20190625080840-0136|15|4|START| 37.53|2.Join done | 0.00| 0|1 2019-06-25 08:09:19,953|FF|app-20190625080840-0136|15|4| END| 40.00|2.Join done | 2.47| 27004|1 2019-06-25 08:09:19,953|FF|app-20190625080840-0136|15|4|START| 40.00|3.Flocks to report | 0.00| 0|1 2019-06-25 08:09:20,399|FF|app-20190625080840-0136|15|4| END| 40.45|3.Flocks to report | 0.45| 0|1 2019-06-25 08:09:20,399|FF|app-20190625080840-0136|15|4|START| 40.45|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:09:20,470|FF|app-20190625080840-0136|15|4| END| 40.52|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 08:09:20,470|FF|app-20190625080840-0136|15|4|START| 40.52|5.Flocks reported | 0.00| 0|1 2019-06-25 08:09:20,474|FF|app-20190625080840-0136|15|4| END| 40.52|5.Flocks reported | 0.00| 0|1 2019-06-25 08:09:20,475|FF|app-20190625080840-0136|15|4|START| 40.52|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:09:21,742|FF|app-20190625080840-0136|15|4| END| 41.79|6.Candidates indexed | 1.27| 28069|1 2019-06-25 08:09:21,742|FF|app-20190625080840-0136|15|4|START| 41.79|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:09:21,742|MF|app-20190625080840-0136|15|4|START| 41.79|A.Points indexed | 0.00| 0|2 2019-06-25 08:09:21,864|MF|app-20190625080840-0136|15|4| END| 41.91|A.Points indexed | 0.12| 55182|2 2019-06-25 08:09:21,864|MF|app-20190625080840-0136|15|4|START| 41.91|B.Pairs found | 0.00| 0|2 2019-06-25 08:09:22,632|MF|app-20190625080840-0136|15|4| END| 42.68|B.Pairs found | 0.77| 73710|2 2019-06-25 08:09:22,632|MF|app-20190625080840-0136|15|4|START| 42.68|C.Centers found | 0.00| 0|2 2019-06-25 08:09:24,329|MF|app-20190625080840-0136|15|4| END| 44.38|C.Centers found | 1.70|147420|2 2019-06-25 08:09:24,329|MF|app-20190625080840-0136|15|4|START| 44.38|D.Disks found | 0.00| 0|2 2019-06-25 08:09:27,444|MF|app-20190625080840-0136|15|4| END| 47.49|D.Disks found | 3.12| 54024|2 2019-06-25 08:09:27,444|MF|app-20190625080840-0136|15|4|START| 47.49|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:09:28,261|MF|app-20190625080840-0136|15|4| END| 48.31|E.Disks partitioned | 0.82| 71877|2 2019-06-25 08:09:28,261|MF|app-20190625080840-0136|15|4|START| 48.31|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:09:28,262|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:09:28,262|Cell area: 1055533.7681000116 2019-06-25 08:09:30,246|MF|app-20190625080840-0136|15|4| END| 50.29|F.Maximal disks found | 1.99| 17462|2 2019-06-25 08:09:30,246|MAXIMALS|app-20190625080840-0136|4|15|80.0|3|1350|8.504|17462 2019-06-25 08:09:31,283|FF|app-20190625080840-0136|15|4| END| 51.33|1.Maximal disks found | 9.54| 17462|2 2019-06-25 08:09:31,283|FF|app-20190625080840-0136|15|4|START| 51.33|2.Join done | 0.00| 0|2 2019-06-25 08:09:37,536|FF|app-20190625080840-0136|15|4| END| 57.58|2.Join done | 6.25| 38332|2 2019-06-25 08:09:37,536|FF|app-20190625080840-0136|15|4|START| 57.58|3.Flocks to report | 0.00| 0|2 2019-06-25 08:09:38,847|FF|app-20190625080840-0136|15|4| END| 58.89|3.Flocks to report | 1.31| 33043|2 2019-06-25 08:09:38,847|FF|app-20190625080840-0136|15|4|START| 58.89|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:09:38,930|FF|app-20190625080840-0136|15|4|START| 58.98|4a.Making expansions | 0.00| 0|2 2019-06-25 08:09:39,778|FF|app-20190625080840-0136|15|4| END| 59.82|4a.Making expansions | 0.85| 41678|2 2019-06-25 08:09:39,778|FF|app-20190625080840-0136|15|4|START| 59.82|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:09:40,932|FF|app-20190625080840-0136|15|4| END| 60.98|4b.Finding maximals | 1.15| 12225|2 2019-06-25 08:09:41,386|FF|app-20190625080840-0136|15|4| END| 61.43|4.Flocks prunned by expansion | 2.54| 12225|2 2019-06-25 08:09:41,386|FF|app-20190625080840-0136|15|4|START| 61.43|5.Flocks reported | 0.00| 0|2 2019-06-25 08:09:41,947|FF|app-20190625080840-0136|15|4| END| 61.99|5.Flocks reported | 0.56| 12225|2 2019-06-25 08:09:41,947|FF|app-20190625080840-0136|15|4|START| 61.99|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:09:43,523|FF|app-20190625080840-0136|15|4| END| 63.57|6.Candidates indexed | 1.58| 18597|2 2019-06-25 08:09:43,523|FF|app-20190625080840-0136|15|4|START| 63.57|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:09:43,523|MF|app-20190625080840-0136|15|4|START| 63.57|A.Points indexed | 0.00| 0|3 2019-06-25 08:09:43,637|MF|app-20190625080840-0136|15|4| END| 63.68|A.Points indexed | 0.11| 55644|3 2019-06-25 08:09:43,637|MF|app-20190625080840-0136|15|4|START| 63.68|B.Pairs found | 0.00| 0|3 2019-06-25 08:09:44,337|MF|app-20190625080840-0136|15|4| END| 64.38|B.Pairs found | 0.70| 74871|3 2019-06-25 08:09:44,337|MF|app-20190625080840-0136|15|4|START| 64.38|C.Centers found | 0.00| 0|3 2019-06-25 08:09:45,242|MF|app-20190625080840-0136|15|4| END| 65.29|C.Centers found | 0.91|149742|3 2019-06-25 08:09:45,242|MF|app-20190625080840-0136|15|4|START| 65.29|D.Disks found | 0.00| 0|3 2019-06-25 08:09:48,312|MF|app-20190625080840-0136|15|4| END| 68.36|D.Disks found | 3.07| 54930|3 2019-06-25 08:09:48,312|MF|app-20190625080840-0136|15|4|START| 68.36|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:09:49,162|MF|app-20190625080840-0136|15|4| END| 69.21|E.Disks partitioned | 0.85| 73112|3 2019-06-25 08:09:49,162|MF|app-20190625080840-0136|15|4|START| 69.21|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:09:49,163|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:09:49,163|Cell area: 1055533.7681000116 2019-06-25 08:09:51,407|MF|app-20190625080840-0136|15|4| END| 71.45|F.Maximal disks found | 2.25| 17782|3 2019-06-25 08:09:51,408|MAXIMALS|app-20190625080840-0136|4|15|80.0|3|1350|7.884|17782 2019-06-25 08:09:52,406|FF|app-20190625080840-0136|15|4| END| 72.45|1.Maximal disks found | 8.88| 17782|3 2019-06-25 08:09:52,406|FF|app-20190625080840-0136|15|4|START| 72.45|2.Join done | 0.00| 0|3 2019-06-25 08:09:55,905|FF|app-20190625080840-0136|15|4| END| 75.95|2.Join done | 3.50| 37059|3 2019-06-25 08:09:55,905|FF|app-20190625080840-0136|15|4|START| 75.95|3.Flocks to report | 0.00| 0|3 2019-06-25 08:09:56,805|FF|app-20190625080840-0136|15|4| END| 76.85|3.Flocks to report | 0.90| 31049|3 2019-06-25 08:09:56,805|FF|app-20190625080840-0136|15|4|START| 76.85|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:09:56,897|FF|app-20190625080840-0136|15|4|START| 76.94|4a.Making expansions | 0.00| 0|3 2019-06-25 08:09:57,783|FF|app-20190625080840-0136|15|4| END| 77.83|4a.Making expansions | 0.89| 39875|3 2019-06-25 08:09:57,783|FF|app-20190625080840-0136|15|4|START| 77.83|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:09:58,752|FF|app-20190625080840-0136|15|4| END| 78.80|4b.Finding maximals | 0.97| 12384|3 2019-06-25 08:09:59,211|FF|app-20190625080840-0136|15|4| END| 79.26|4.Flocks prunned by expansion | 2.41| 12384|3 2019-06-25 08:09:59,212|FF|app-20190625080840-0136|15|4|START| 79.26|5.Flocks reported | 0.00| 0|3 2019-06-25 08:09:59,843|FF|app-20190625080840-0136|15|4| END| 79.89|5.Flocks reported | 0.63| 12384|3 2019-06-25 08:09:59,844|FF|app-20190625080840-0136|15|4|START| 79.89|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:10:01,386|FF|app-20190625080840-0136|15|4| END| 81.43|6.Candidates indexed | 1.54| 19484|3 2019-06-25 08:10:02,745|Number of flocks: 24609 2019-06-25 08:10:03,704|PFLOCK|app-20190625080840-0136|4|15|80.0|3|3|76.21|24609 2019-06-25 08:10:04,630|FF|app-20190625080840-0136|15|4| END| 84.68|Flock Finder run | 78.09| 24609|3 2019-06-25 08:10:04,630|FF|app-20190625080840-0136|15|4|START| 84.68|Session closed | 0.00| 0|3 2019-06-25 08:10:15,041|FF|app-20190625080840-0136|15|4| END| 95.09|Session closed | 10.41| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:10:17,512|FF|app-00000000000000-0000|10|4|START| 0.13|Session start | 0.00| 0|-1 2019-06-25 08:10:18,624|FF|app-20190625081018-0137|10|4| END| 1.10|Session start | 1.11| 0|-1 2019-06-25 08:10:18,625|FF|app-20190625081018-0137|10|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 08:10:22,792|FF|app-20190625081018-0137|10|4| END| 5.26|Data read | 4.17|220752|-1 2019-06-25 08:10:22,792|FF|app-20190625081018-0137|10|4|START| 5.26|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:10:22,940|FF|app-20190625081018-0137|10|4| END| 5.41|KDBTree partitioner | 0.15| 544|-1 2019-06-25 08:10:22,940|FF|app-20190625081018-0137|10|4|START| 5.41|MF partitioner | 0.00| 0|-1 2019-06-25 08:10:22,960|FF|app-20190625081018-0137|10|4| END| 5.43|MF partitioner | 0.02| 900|-1 2019-06-25 08:10:22,960|FF|app-20190625081018-0137|10|4|START| 5.43|Pointset done | 0.00| 0|-1 2019-06-25 08:10:24,130|FF|app-20190625081018-0137|10|4| END| 6.60|Pointset done | 1.17| 4|-1 2019-06-25 08:10:24,130|FF|app-20190625081018-0137|10|4|START| 6.60|Flock Finder run | 0.00| 0|-1 2019-06-25 08:10:24,146|FF|app-20190625081018-0137|10|4|START| 6.62|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:10:24,149|MF|app-20190625081018-0137|10|4|START| 6.62|A.Points indexed | 0.00| 0|0 2019-06-25 08:10:24,334|MF|app-20190625081018-0137|10|4| END| 6.81|A.Points indexed | 0.19| 36186|0 2019-06-25 08:10:24,335|MF|app-20190625081018-0137|10|4|START| 6.81|B.Pairs found | 0.00| 0|0 2019-06-25 08:10:26,623|MF|app-20190625081018-0137|10|4| END| 9.09|B.Pairs found | 2.29| 47786|0 2019-06-25 08:10:26,624|MF|app-20190625081018-0137|10|4|START| 9.10|C.Centers found | 0.00| 0|0 2019-06-25 08:10:28,006|MF|app-20190625081018-0137|10|4| END| 10.48|C.Centers found | 1.38| 95572|0 2019-06-25 08:10:28,007|MF|app-20190625081018-0137|10|4|START| 10.48|D.Disks found | 0.00| 0|0 2019-06-25 08:10:35,068|MF|app-20190625081018-0137|10|4| END| 17.54|D.Disks found | 7.06| 34902|0 2019-06-25 08:10:35,068|MF|app-20190625081018-0137|10|4|START| 17.54|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:10:38,123|MF|app-20190625081018-0137|10|4| END| 20.59|E.Disks partitioned | 3.06| 46456|0 2019-06-25 08:10:38,123|MF|app-20190625081018-0137|10|4|START| 20.59|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:10:38,125|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:10:38,125|Cell area: 1055533.7681000116 2019-06-25 08:10:41,372|MF|app-20190625081018-0137|10|4| END| 23.84|F.Maximal disks found | 3.25| 11354|0 2019-06-25 08:10:41,372|MAXIMALS|app-20190625081018-0137|4|10|80.0|3|900|17.223|11354 2019-06-25 08:10:42,881|FF|app-20190625081018-0137|10|4| END| 25.35|1.Maximal disks found | 18.74| 11354|0 2019-06-25 08:10:42,881|FF|app-20190625081018-0137|10|4|START| 25.35|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:10:42,882|MF|app-20190625081018-0137|10|4|START| 25.35|A.Points indexed | 0.00| 0|1 2019-06-25 08:10:42,978|MF|app-20190625081018-0137|10|4| END| 25.45|A.Points indexed | 0.10| 36490|1 2019-06-25 08:10:42,979|MF|app-20190625081018-0137|10|4|START| 25.45|B.Pairs found | 0.00| 0|1 2019-06-25 08:10:44,034|MF|app-20190625081018-0137|10|4| END| 26.51|B.Pairs found | 1.06| 48486|1 2019-06-25 08:10:44,034|MF|app-20190625081018-0137|10|4|START| 26.51|C.Centers found | 0.00| 0|1 2019-06-25 08:10:45,036|MF|app-20190625081018-0137|10|4| END| 27.51|C.Centers found | 1.00| 96972|1 2019-06-25 08:10:45,036|MF|app-20190625081018-0137|10|4|START| 27.51|D.Disks found | 0.00| 0|1 2019-06-25 08:10:49,455|MF|app-20190625081018-0137|10|4| END| 31.93|D.Disks found | 4.42| 35526|1 2019-06-25 08:10:49,456|MF|app-20190625081018-0137|10|4|START| 31.93|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:10:51,386|MF|app-20190625081018-0137|10|4| END| 33.86|E.Disks partitioned | 1.93| 47221|1 2019-06-25 08:10:51,386|MF|app-20190625081018-0137|10|4|START| 33.86|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:10:51,386|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:10:51,386|Cell area: 1055533.7681000116 2019-06-25 08:10:53,626|MF|app-20190625081018-0137|10|4| END| 36.10|F.Maximal disks found | 2.24| 11499|1 2019-06-25 08:10:53,626|MAXIMALS|app-20190625081018-0137|4|10|80.0|3|900|10.745|11499 2019-06-25 08:10:54,637|FF|app-20190625081018-0137|10|4| END| 37.11|1.Maximal disks found | 11.76| 11499|1 2019-06-25 08:10:54,637|FF|app-20190625081018-0137|10|4|START| 37.11|2.Join done | 0.00| 0|1 2019-06-25 08:10:59,018|FF|app-20190625081018-0137|10|4| END| 41.49|2.Join done | 4.38| 17993|1 2019-06-25 08:10:59,018|FF|app-20190625081018-0137|10|4|START| 41.49|3.Flocks to report | 0.00| 0|1 2019-06-25 08:10:59,663|FF|app-20190625081018-0137|10|4| END| 42.13|3.Flocks to report | 0.65| 0|1 2019-06-25 08:10:59,664|FF|app-20190625081018-0137|10|4|START| 42.13|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:10:59,726|FF|app-20190625081018-0137|10|4| END| 42.20|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 08:10:59,726|FF|app-20190625081018-0137|10|4|START| 42.20|5.Flocks reported | 0.00| 0|1 2019-06-25 08:10:59,731|FF|app-20190625081018-0137|10|4| END| 42.20|5.Flocks reported | 0.01| 0|1 2019-06-25 08:10:59,731|FF|app-20190625081018-0137|10|4|START| 42.20|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:11:01,370|FF|app-20190625081018-0137|10|4| END| 43.84|6.Candidates indexed | 1.64| 18703|1 2019-06-25 08:11:01,370|FF|app-20190625081018-0137|10|4|START| 43.84|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:11:01,371|MF|app-20190625081018-0137|10|4|START| 43.84|A.Points indexed | 0.00| 0|2 2019-06-25 08:11:01,493|MF|app-20190625081018-0137|10|4| END| 43.96|A.Points indexed | 0.12| 36788|2 2019-06-25 08:11:01,493|MF|app-20190625081018-0137|10|4|START| 43.96|B.Pairs found | 0.00| 0|2 2019-06-25 08:11:02,481|MF|app-20190625081018-0137|10|4| END| 44.95|B.Pairs found | 0.99| 49140|2 2019-06-25 08:11:02,481|MF|app-20190625081018-0137|10|4|START| 44.95|C.Centers found | 0.00| 0|2 2019-06-25 08:11:03,569|MF|app-20190625081018-0137|10|4| END| 46.04|C.Centers found | 1.09| 98280|2 2019-06-25 08:11:03,569|MF|app-20190625081018-0137|10|4|START| 46.04|D.Disks found | 0.00| 0|2 2019-06-25 08:11:07,588|MF|app-20190625081018-0137|10|4| END| 50.06|D.Disks found | 4.02| 36016|2 2019-06-25 08:11:07,588|MF|app-20190625081018-0137|10|4|START| 50.06|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:11:08,847|MF|app-20190625081018-0137|10|4| END| 51.32|E.Disks partitioned | 1.26| 47918|2 2019-06-25 08:11:08,847|MF|app-20190625081018-0137|10|4|START| 51.32|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:11:08,847|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:11:08,848|Cell area: 1055533.7681000116 2019-06-25 08:11:10,738|MF|app-20190625081018-0137|10|4| END| 53.21|F.Maximal disks found | 1.89| 11642|2 2019-06-25 08:11:10,738|MAXIMALS|app-20190625081018-0137|4|10|80.0|3|900|9.367|11642 2019-06-25 08:11:11,488|FF|app-20190625081018-0137|10|4| END| 53.96|1.Maximal disks found | 10.12| 11642|2 2019-06-25 08:11:11,488|FF|app-20190625081018-0137|10|4|START| 53.96|2.Join done | 0.00| 0|2 2019-06-25 08:11:16,206|FF|app-20190625081018-0137|10|4| END| 58.68|2.Join done | 4.72| 25538|2 2019-06-25 08:11:16,206|FF|app-20190625081018-0137|10|4|START| 58.68|3.Flocks to report | 0.00| 0|2 2019-06-25 08:11:16,901|FF|app-20190625081018-0137|10|4| END| 59.37|3.Flocks to report | 0.70| 22013|2 2019-06-25 08:11:16,901|FF|app-20190625081018-0137|10|4|START| 59.37|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:11:16,964|FF|app-20190625081018-0137|10|4|START| 59.44|4a.Making expansions | 0.00| 0|2 2019-06-25 08:11:17,727|FF|app-20190625081018-0137|10|4| END| 60.20|4a.Making expansions | 0.76| 27770|2 2019-06-25 08:11:17,727|FF|app-20190625081018-0137|10|4|START| 60.20|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:11:18,807|FF|app-20190625081018-0137|10|4| END| 61.28|4b.Finding maximals | 1.08| 8150|2 2019-06-25 08:11:19,127|FF|app-20190625081018-0137|10|4| END| 61.60|4.Flocks prunned by expansion | 2.23| 8150|2 2019-06-25 08:11:19,127|FF|app-20190625081018-0137|10|4|START| 61.60|5.Flocks reported | 0.00| 0|2 2019-06-25 08:11:19,547|FF|app-20190625081018-0137|10|4| END| 62.02|5.Flocks reported | 0.42| 8150|2 2019-06-25 08:11:19,547|FF|app-20190625081018-0137|10|4|START| 62.02|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:11:20,948|FF|app-20190625081018-0137|10|4| END| 63.42|6.Candidates indexed | 1.40| 12396|2 2019-06-25 08:11:20,948|FF|app-20190625081018-0137|10|4|START| 63.42|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:11:20,948|MF|app-20190625081018-0137|10|4|START| 63.42|A.Points indexed | 0.00| 0|3 2019-06-25 08:11:21,040|MF|app-20190625081018-0137|10|4| END| 63.51|A.Points indexed | 0.09| 37096|3 2019-06-25 08:11:21,040|MF|app-20190625081018-0137|10|4|START| 63.51|B.Pairs found | 0.00| 0|3 2019-06-25 08:11:21,720|MF|app-20190625081018-0137|10|4| END| 64.19|B.Pairs found | 0.68| 49914|3 2019-06-25 08:11:21,720|MF|app-20190625081018-0137|10|4|START| 64.19|C.Centers found | 0.00| 0|3 2019-06-25 08:11:22,589|MF|app-20190625081018-0137|10|4| END| 65.06|C.Centers found | 0.87| 99828|3 2019-06-25 08:11:22,589|MF|app-20190625081018-0137|10|4|START| 65.06|D.Disks found | 0.00| 0|3 2019-06-25 08:11:26,145|MF|app-20190625081018-0137|10|4| END| 68.62|D.Disks found | 3.56| 36620|3 2019-06-25 08:11:26,145|MF|app-20190625081018-0137|10|4|START| 68.62|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:11:27,358|MF|app-20190625081018-0137|10|4| END| 69.83|E.Disks partitioned | 1.21| 48737|3 2019-06-25 08:11:27,358|MF|app-20190625081018-0137|10|4|START| 69.83|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:11:27,358|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:11:27,359|Cell area: 1055533.7681000116 2019-06-25 08:11:29,683|MF|app-20190625081018-0137|10|4| END| 72.15|F.Maximal disks found | 2.33| 11852|3 2019-06-25 08:11:29,683|MAXIMALS|app-20190625081018-0137|4|10|80.0|3|900|8.735|11852 2019-06-25 08:11:30,398|FF|app-20190625081018-0137|10|4| END| 72.87|1.Maximal disks found | 9.45| 11852|3 2019-06-25 08:11:30,398|FF|app-20190625081018-0137|10|4|START| 72.87|2.Join done | 0.00| 0|3 2019-06-25 08:11:33,577|FF|app-20190625081018-0137|10|4| END| 76.05|2.Join done | 3.18| 24689|3 2019-06-25 08:11:33,577|FF|app-20190625081018-0137|10|4|START| 76.05|3.Flocks to report | 0.00| 0|3 2019-06-25 08:11:34,305|FF|app-20190625081018-0137|10|4| END| 76.78|3.Flocks to report | 0.73| 20688|3 2019-06-25 08:11:34,305|FF|app-20190625081018-0137|10|4|START| 76.78|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:11:34,378|FF|app-20190625081018-0137|10|4|START| 76.85|4a.Making expansions | 0.00| 0|3 2019-06-25 08:11:35,138|FF|app-20190625081018-0137|10|4| END| 77.61|4a.Making expansions | 0.76| 26558|3 2019-06-25 08:11:35,138|FF|app-20190625081018-0137|10|4|START| 77.61|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:11:35,947|FF|app-20190625081018-0137|10|4| END| 78.42|4b.Finding maximals | 0.81| 8256|3 2019-06-25 08:11:36,268|FF|app-20190625081018-0137|10|4| END| 78.74|4.Flocks prunned by expansion | 1.96| 8256|3 2019-06-25 08:11:36,268|FF|app-20190625081018-0137|10|4|START| 78.74|5.Flocks reported | 0.00| 0|3 2019-06-25 08:11:36,726|FF|app-20190625081018-0137|10|4| END| 79.20|5.Flocks reported | 0.46| 8256|3 2019-06-25 08:11:36,726|FF|app-20190625081018-0137|10|4|START| 79.20|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:11:38,156|FF|app-20190625081018-0137|10|4| END| 80.63|6.Candidates indexed | 1.43| 12984|3 2019-06-25 08:11:39,231|Number of flocks: 16406 2019-06-25 08:11:39,969|PFLOCK|app-20190625081018-0137|4|10|80.0|3|3|75.10|16406 2019-06-25 08:11:40,698|FF|app-20190625081018-0137|10|4| END| 83.17|Flock Finder run | 76.57| 16406|3 2019-06-25 08:11:40,698|FF|app-20190625081018-0137|10|4|START| 83.17|Session closed | 0.00| 0|3 2019-06-25 08:11:47,586|FF|app-20190625081018-0137|10|4| END| 90.06|Session closed | 6.89| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:11:49,510|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:11:50,658|FF|app-20190625081150-0138|5|4| END| 1.13|Session start | 1.15| 0|-1 2019-06-25 08:11:50,659|FF|app-20190625081150-0138|5|4|START| 1.13|Data read | 0.00| 0|-1 2019-06-25 08:11:54,402|FF|app-20190625081150-0138|5|4| END| 4.88|Data read | 3.74|110376|-1 2019-06-25 08:11:54,402|FF|app-20190625081150-0138|5|4|START| 4.88|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:11:54,525|FF|app-20190625081150-0138|5|4| END| 5.00|KDBTree partitioner | 0.12| 272|-1 2019-06-25 08:11:54,526|FF|app-20190625081150-0138|5|4|START| 5.00|MF partitioner | 0.00| 0|-1 2019-06-25 08:11:54,539|FF|app-20190625081150-0138|5|4| END| 5.01|MF partitioner | 0.01| 450|-1 2019-06-25 08:11:54,540|FF|app-20190625081150-0138|5|4|START| 5.01|Pointset done | 0.00| 0|-1 2019-06-25 08:11:55,418|FF|app-20190625081150-0138|5|4| END| 5.89|Pointset done | 0.88| 4|-1 2019-06-25 08:11:55,419|FF|app-20190625081150-0138|5|4|START| 5.89|Flock Finder run | 0.00| 0|-1 2019-06-25 08:11:55,587|FF|app-20190625081150-0138|5|4|START| 6.06|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:11:55,590|MF|app-20190625081150-0138|5|4|START| 6.06|A.Points indexed | 0.00| 0|0 2019-06-25 08:11:55,773|MF|app-20190625081150-0138|5|4| END| 6.25|A.Points indexed | 0.18| 18093|0 2019-06-25 08:11:55,773|MF|app-20190625081150-0138|5|4|START| 6.25|B.Pairs found | 0.00| 0|0 2019-06-25 08:11:57,057|MF|app-20190625081150-0138|5|4| END| 7.53|B.Pairs found | 1.28| 23893|0 2019-06-25 08:11:57,057|MF|app-20190625081150-0138|5|4|START| 7.53|C.Centers found | 0.00| 0|0 2019-06-25 08:11:57,810|MF|app-20190625081150-0138|5|4| END| 8.28|C.Centers found | 0.75| 47786|0 2019-06-25 08:11:57,810|MF|app-20190625081150-0138|5|4|START| 8.28|D.Disks found | 0.00| 0|0 2019-06-25 08:12:00,272|MF|app-20190625081150-0138|5|4| END| 10.75|D.Disks found | 2.46| 17451|0 2019-06-25 08:12:00,272|MF|app-20190625081150-0138|5|4|START| 10.75|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:12:01,069|MF|app-20190625081150-0138|5|4| END| 11.54|E.Disks partitioned | 0.80| 23231|0 2019-06-25 08:12:01,069|MF|app-20190625081150-0138|5|4|START| 11.54|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:12:01,071|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:12:01,071|Cell area: 1055533.7681000116 2019-06-25 08:12:02,810|MF|app-20190625081150-0138|5|4| END| 13.28|F.Maximal disks found | 1.74| 5681|0 2019-06-25 08:12:02,810|MAXIMALS|app-20190625081150-0138|4|5|80.0|3|450|7.22|5681 2019-06-25 08:12:03,334|FF|app-20190625081150-0138|5|4| END| 13.81|1.Maximal disks found | 7.75| 5681|0 2019-06-25 08:12:03,334|FF|app-20190625081150-0138|5|4|START| 13.81|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:12:03,335|MF|app-20190625081150-0138|5|4|START| 13.81|A.Points indexed | 0.00| 0|1 2019-06-25 08:12:03,417|MF|app-20190625081150-0138|5|4| END| 13.89|A.Points indexed | 0.08| 18245|1 2019-06-25 08:12:03,417|MF|app-20190625081150-0138|5|4|START| 13.89|B.Pairs found | 0.00| 0|1 2019-06-25 08:12:03,876|MF|app-20190625081150-0138|5|4| END| 14.35|B.Pairs found | 0.46| 24243|1 2019-06-25 08:12:03,876|MF|app-20190625081150-0138|5|4|START| 14.35|C.Centers found | 0.00| 0|1 2019-06-25 08:12:04,258|MF|app-20190625081150-0138|5|4| END| 14.73|C.Centers found | 0.38| 48486|1 2019-06-25 08:12:04,258|MF|app-20190625081150-0138|5|4|START| 14.73|D.Disks found | 0.00| 0|1 2019-06-25 08:12:06,093|MF|app-20190625081150-0138|5|4| END| 16.57|D.Disks found | 1.84| 17763|1 2019-06-25 08:12:06,093|MF|app-20190625081150-0138|5|4|START| 16.57|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:12:06,857|MF|app-20190625081150-0138|5|4| END| 17.33|E.Disks partitioned | 0.76| 23611|1 2019-06-25 08:12:06,857|MF|app-20190625081150-0138|5|4|START| 17.33|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:12:06,857|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:12:06,857|Cell area: 1055533.7681000116 2019-06-25 08:12:08,721|MF|app-20190625081150-0138|5|4| END| 19.19|F.Maximal disks found | 1.86| 5752|1 2019-06-25 08:12:08,721|MAXIMALS|app-20190625081150-0138|4|5|80.0|3|450|5.386|5752 2019-06-25 08:12:09,177|FF|app-20190625081150-0138|5|4| END| 19.65|1.Maximal disks found | 5.84| 5752|1 2019-06-25 08:12:09,177|FF|app-20190625081150-0138|5|4|START| 19.65|2.Join done | 0.00| 0|1 2019-06-25 08:12:10,881|FF|app-20190625081150-0138|5|4| END| 21.35|2.Join done | 1.70| 8996|1 2019-06-25 08:12:10,881|FF|app-20190625081150-0138|5|4|START| 21.35|3.Flocks to report | 0.00| 0|1 2019-06-25 08:12:11,210|FF|app-20190625081150-0138|5|4| END| 21.68|3.Flocks to report | 0.33| 0|1 2019-06-25 08:12:11,211|FF|app-20190625081150-0138|5|4|START| 21.68|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:12:11,249|FF|app-20190625081150-0138|5|4| END| 21.72|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 08:12:11,249|FF|app-20190625081150-0138|5|4|START| 21.72|5.Flocks reported | 0.00| 0|1 2019-06-25 08:12:11,254|FF|app-20190625081150-0138|5|4| END| 21.73|5.Flocks reported | 0.01| 0|1 2019-06-25 08:12:11,254|FF|app-20190625081150-0138|5|4|START| 21.73|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:12:12,317|FF|app-20190625081150-0138|5|4| END| 22.79|6.Candidates indexed | 1.06| 9351|1 2019-06-25 08:12:12,317|FF|app-20190625081150-0138|5|4|START| 22.79|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:12:12,317|MF|app-20190625081150-0138|5|4|START| 22.79|A.Points indexed | 0.00| 0|2 2019-06-25 08:12:12,393|MF|app-20190625081150-0138|5|4| END| 22.87|A.Points indexed | 0.08| 18394|2 2019-06-25 08:12:12,393|MF|app-20190625081150-0138|5|4|START| 22.87|B.Pairs found | 0.00| 0|2 2019-06-25 08:12:12,906|MF|app-20190625081150-0138|5|4| END| 23.38|B.Pairs found | 0.51| 24570|2 2019-06-25 08:12:12,906|MF|app-20190625081150-0138|5|4|START| 23.38|C.Centers found | 0.00| 0|2 2019-06-25 08:12:13,317|MF|app-20190625081150-0138|5|4| END| 23.79|C.Centers found | 0.41| 49140|2 2019-06-25 08:12:13,318|MF|app-20190625081150-0138|5|4|START| 23.79|D.Disks found | 0.00| 0|2 2019-06-25 08:12:15,136|MF|app-20190625081150-0138|5|4| END| 25.61|D.Disks found | 1.82| 18008|2 2019-06-25 08:12:15,136|MF|app-20190625081150-0138|5|4|START| 25.61|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:12:15,725|MF|app-20190625081150-0138|5|4| END| 26.20|E.Disks partitioned | 0.59| 23955|2 2019-06-25 08:12:15,726|MF|app-20190625081150-0138|5|4|START| 26.20|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:12:15,726|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:12:15,726|Cell area: 1055533.7681000116 2019-06-25 08:12:17,420|MF|app-20190625081150-0138|5|4| END| 27.89|F.Maximal disks found | 1.69| 5821|2 2019-06-25 08:12:17,421|MAXIMALS|app-20190625081150-0138|4|5|80.0|3|450|5.104|5821 2019-06-25 08:12:17,794|FF|app-20190625081150-0138|5|4| END| 28.27|1.Maximal disks found | 5.48| 5821|2 2019-06-25 08:12:17,794|FF|app-20190625081150-0138|5|4|START| 28.27|2.Join done | 0.00| 0|2 2019-06-25 08:12:20,969|FF|app-20190625081150-0138|5|4| END| 31.44|2.Join done | 3.18| 12766|2 2019-06-25 08:12:20,969|FF|app-20190625081150-0138|5|4|START| 31.44|3.Flocks to report | 0.00| 0|2 2019-06-25 08:12:21,447|FF|app-20190625081150-0138|5|4| END| 31.92|3.Flocks to report | 0.48| 11004|2 2019-06-25 08:12:21,447|FF|app-20190625081150-0138|5|4|START| 31.92|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:12:21,487|FF|app-20190625081150-0138|5|4|START| 31.96|4a.Making expansions | 0.00| 0|2 2019-06-25 08:12:21,868|FF|app-20190625081150-0138|5|4| END| 32.34|4a.Making expansions | 0.38| 13877|2 2019-06-25 08:12:21,868|FF|app-20190625081150-0138|5|4|START| 32.34|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:12:22,675|FF|app-20190625081150-0138|5|4| END| 33.15|4b.Finding maximals | 0.81| 4075|2 2019-06-25 08:12:22,835|FF|app-20190625081150-0138|5|4| END| 33.31|4.Flocks prunned by expansion | 1.39| 4075|2 2019-06-25 08:12:22,836|FF|app-20190625081150-0138|5|4|START| 33.31|5.Flocks reported | 0.00| 0|2 2019-06-25 08:12:23,097|FF|app-20190625081150-0138|5|4| END| 33.57|5.Flocks reported | 0.26| 4075|2 2019-06-25 08:12:23,098|FF|app-20190625081150-0138|5|4|START| 33.57|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:12:24,074|FF|app-20190625081150-0138|5|4| END| 34.55|6.Candidates indexed | 0.98| 6197|2 2019-06-25 08:12:24,074|FF|app-20190625081150-0138|5|4|START| 34.55|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:12:24,075|MF|app-20190625081150-0138|5|4|START| 34.55|A.Points indexed | 0.00| 0|3 2019-06-25 08:12:24,133|MF|app-20190625081150-0138|5|4| END| 34.61|A.Points indexed | 0.06| 18548|3 2019-06-25 08:12:24,133|MF|app-20190625081150-0138|5|4|START| 34.61|B.Pairs found | 0.00| 0|3 2019-06-25 08:12:24,671|MF|app-20190625081150-0138|5|4| END| 35.14|B.Pairs found | 0.54| 24957|3 2019-06-25 08:12:24,671|MF|app-20190625081150-0138|5|4|START| 35.14|C.Centers found | 0.00| 0|3 2019-06-25 08:12:25,197|MF|app-20190625081150-0138|5|4| END| 35.67|C.Centers found | 0.53| 49914|3 2019-06-25 08:12:25,197|MF|app-20190625081150-0138|5|4|START| 35.67|D.Disks found | 0.00| 0|3 2019-06-25 08:12:27,491|MF|app-20190625081150-0138|5|4| END| 37.96|D.Disks found | 2.29| 18310|3 2019-06-25 08:12:27,491|MF|app-20190625081150-0138|5|4|START| 37.96|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:12:28,203|MF|app-20190625081150-0138|5|4| END| 38.68|E.Disks partitioned | 0.71| 24367|3 2019-06-25 08:12:28,203|MF|app-20190625081150-0138|5|4|START| 38.68|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:12:28,204|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:12:28,204|Cell area: 1055533.7681000116 2019-06-25 08:12:30,177|MF|app-20190625081150-0138|5|4| END| 40.65|F.Maximal disks found | 1.97| 5926|3 2019-06-25 08:12:30,177|MAXIMALS|app-20190625081150-0138|4|5|80.0|3|450|6.103|5926 2019-06-25 08:12:30,594|FF|app-20190625081150-0138|5|4| END| 41.07|1.Maximal disks found | 6.52| 5926|3 2019-06-25 08:12:30,594|FF|app-20190625081150-0138|5|4|START| 41.07|2.Join done | 0.00| 0|3 2019-06-25 08:12:32,710|FF|app-20190625081150-0138|5|4| END| 43.18|2.Join done | 2.12| 12337|3 2019-06-25 08:12:32,710|FF|app-20190625081150-0138|5|4|START| 43.18|3.Flocks to report | 0.00| 0|3 2019-06-25 08:12:33,102|FF|app-20190625081150-0138|5|4| END| 43.58|3.Flocks to report | 0.39| 10340|3 2019-06-25 08:12:33,103|FF|app-20190625081150-0138|5|4|START| 43.58|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:12:33,138|FF|app-20190625081150-0138|5|4|START| 43.61|4a.Making expansions | 0.00| 0|3 2019-06-25 08:12:33,525|FF|app-20190625081150-0138|5|4| END| 44.00|4a.Making expansions | 0.39| 13279|3 2019-06-25 08:12:33,525|FF|app-20190625081150-0138|5|4|START| 44.00|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:12:34,111|FF|app-20190625081150-0138|5|4| END| 44.58|4b.Finding maximals | 0.59| 4128|3 2019-06-25 08:12:34,278|FF|app-20190625081150-0138|5|4| END| 44.75|4.Flocks prunned by expansion | 1.18| 4128|3 2019-06-25 08:12:34,278|FF|app-20190625081150-0138|5|4|START| 44.75|5.Flocks reported | 0.00| 0|3 2019-06-25 08:12:34,523|FF|app-20190625081150-0138|5|4| END| 45.00|5.Flocks reported | 0.25| 4128|3 2019-06-25 08:12:34,523|FF|app-20190625081150-0138|5|4|START| 45.00|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:12:35,520|FF|app-20190625081150-0138|5|4| END| 45.99|6.Candidates indexed | 1.00| 6487|3 2019-06-25 08:12:35,986|Number of flocks: 8203 2019-06-25 08:12:36,343|PFLOCK|app-20190625081150-0138|4|5|80.0|3|3|40.57|8203 2019-06-25 08:12:36,672|FF|app-20190625081150-0138|5|4| END| 47.15|Flock Finder run | 41.25| 8203|3 2019-06-25 08:12:36,672|FF|app-20190625081150-0138|5|4|START| 47.15|Session closed | 0.00| 0|3 2019-06-25 08:12:43,570|FF|app-20190625081150-0138|5|4| END| 54.04|Session closed | 6.90| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:12:45,556|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:12:46,708|FF|app-20190625081246-0139|15|4| END| 1.14|Session start | 1.15| 0|-1 2019-06-25 08:12:46,709|FF|app-20190625081246-0139|15|4|START| 1.14|Data read | 0.00| 0|-1 2019-06-25 08:12:51,017|FF|app-20190625081246-0139|15|4| END| 5.44|Data read | 4.31|331128|-1 2019-06-25 08:12:51,018|FF|app-20190625081246-0139|15|4|START| 5.45|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:12:51,193|FF|app-20190625081246-0139|15|4| END| 5.62|KDBTree partitioner | 0.18| 816|-1 2019-06-25 08:12:51,194|FF|app-20190625081246-0139|15|4|START| 5.62|MF partitioner | 0.00| 0|-1 2019-06-25 08:12:51,222|FF|app-20190625081246-0139|15|4| END| 5.65|MF partitioner | 0.03| 1350|-1 2019-06-25 08:12:51,222|FF|app-20190625081246-0139|15|4|START| 5.65|Pointset done | 0.00| 0|-1 2019-06-25 08:12:52,391|FF|app-20190625081246-0139|15|4| END| 6.82|Pointset done | 1.17| 4|-1 2019-06-25 08:12:52,391|FF|app-20190625081246-0139|15|4|START| 6.82|Flock Finder run | 0.00| 0|-1 2019-06-25 08:12:52,411|FF|app-20190625081246-0139|15|4|START| 6.84|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:12:52,414|MF|app-20190625081246-0139|15|4|START| 6.84|A.Points indexed | 0.00| 0|0 2019-06-25 08:12:52,667|MF|app-20190625081246-0139|15|4| END| 7.09|A.Points indexed | 0.25| 54279|0 2019-06-25 08:12:52,667|MF|app-20190625081246-0139|15|4|START| 7.09|B.Pairs found | 0.00| 0|0 2019-06-25 08:12:54,642|MF|app-20190625081246-0139|15|4| END| 9.07|B.Pairs found | 1.97| 86157|0 2019-06-25 08:12:54,642|MF|app-20190625081246-0139|15|4|START| 9.07|C.Centers found | 0.00| 0|0 2019-06-25 08:12:56,456|MF|app-20190625081246-0139|15|4| END| 10.88|C.Centers found | 1.81|172314|0 2019-06-25 08:12:56,456|MF|app-20190625081246-0139|15|4|START| 10.88|D.Disks found | 0.00| 0|0 2019-06-25 08:13:04,299|MF|app-20190625081246-0139|15|4| END| 18.73|D.Disks found | 7.84| 67818|0 2019-06-25 08:13:04,299|MF|app-20190625081246-0139|15|4|START| 18.73|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:13:06,094|MF|app-20190625081246-0139|15|4| END| 20.52|E.Disks partitioned | 1.80| 93058|0 2019-06-25 08:13:06,094|MF|app-20190625081246-0139|15|4|START| 20.52|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:13:06,097|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:13:06,097|Cell area: 1055533.7681000116 2019-06-25 08:13:10,681|MF|app-20190625081246-0139|15|4| END| 25.11|F.Maximal disks found | 4.59| 20937|0 2019-06-25 08:13:10,681|MAXIMALS|app-20190625081246-0139|4|15|90.0|3|1350|18.267|20937 2019-06-25 08:13:11,754|FF|app-20190625081246-0139|15|4| END| 26.18|1.Maximal disks found | 19.34| 20937|0 2019-06-25 08:13:11,754|FF|app-20190625081246-0139|15|4|START| 26.18|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:13:11,754|MF|app-20190625081246-0139|15|4|START| 26.18|A.Points indexed | 0.00| 0|1 2019-06-25 08:13:11,880|MF|app-20190625081246-0139|15|4| END| 26.31|A.Points indexed | 0.13| 54735|1 2019-06-25 08:13:11,880|MF|app-20190625081246-0139|15|4|START| 26.31|B.Pairs found | 0.00| 0|1 2019-06-25 08:13:12,945|MF|app-20190625081246-0139|15|4| END| 27.37|B.Pairs found | 1.07| 87324|1 2019-06-25 08:13:12,945|MF|app-20190625081246-0139|15|4|START| 27.37|C.Centers found | 0.00| 0|1 2019-06-25 08:13:14,212|MF|app-20190625081246-0139|15|4| END| 28.64|C.Centers found | 1.27|174648|1 2019-06-25 08:13:14,212|MF|app-20190625081246-0139|15|4|START| 28.64|D.Disks found | 0.00| 0|1 2019-06-25 08:13:21,335|MF|app-20190625081246-0139|15|4| END| 35.76|D.Disks found | 7.12| 68973|1 2019-06-25 08:13:21,335|MF|app-20190625081246-0139|15|4|START| 35.76|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:13:23,959|MF|app-20190625081246-0139|15|4| END| 38.39|E.Disks partitioned | 2.62| 94410|1 2019-06-25 08:13:23,959|MF|app-20190625081246-0139|15|4|START| 38.39|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:13:23,960|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:13:23,960|Cell area: 1055533.7681000116 2019-06-25 08:13:28,240|MF|app-20190625081246-0139|15|4| END| 42.67|F.Maximal disks found | 4.28| 21134|1 2019-06-25 08:13:28,241|MAXIMALS|app-20190625081246-0139|4|15|90.0|3|1350|16.487|21134 2019-06-25 08:13:29,290|FF|app-20190625081246-0139|15|4| END| 43.72|1.Maximal disks found | 17.54| 21134|1 2019-06-25 08:13:29,290|FF|app-20190625081246-0139|15|4|START| 43.72|2.Join done | 0.00| 0|1 2019-06-25 08:13:32,001|FF|app-20190625081246-0139|15|4| END| 46.43|2.Join done | 2.71| 37959|1 2019-06-25 08:13:32,001|FF|app-20190625081246-0139|15|4|START| 46.43|3.Flocks to report | 0.00| 0|1 2019-06-25 08:13:32,499|FF|app-20190625081246-0139|15|4| END| 46.93|3.Flocks to report | 0.50| 0|1 2019-06-25 08:13:32,499|FF|app-20190625081246-0139|15|4|START| 46.93|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:13:32,571|FF|app-20190625081246-0139|15|4| END| 47.00|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 08:13:32,571|FF|app-20190625081246-0139|15|4|START| 47.00|5.Flocks reported | 0.00| 0|1 2019-06-25 08:13:32,576|FF|app-20190625081246-0139|15|4| END| 47.00|5.Flocks reported | 0.01| 0|1 2019-06-25 08:13:32,576|FF|app-20190625081246-0139|15|4|START| 47.00|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:13:34,031|FF|app-20190625081246-0139|15|4| END| 48.46|6.Candidates indexed | 1.46| 39178|1 2019-06-25 08:13:34,031|FF|app-20190625081246-0139|15|4|START| 48.46|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:13:34,032|MF|app-20190625081246-0139|15|4|START| 48.46|A.Points indexed | 0.00| 0|2 2019-06-25 08:13:34,159|MF|app-20190625081246-0139|15|4| END| 48.59|A.Points indexed | 0.13| 55182|2 2019-06-25 08:13:34,160|MF|app-20190625081246-0139|15|4|START| 48.59|B.Pairs found | 0.00| 0|2 2019-06-25 08:13:34,893|MF|app-20190625081246-0139|15|4| END| 49.32|B.Pairs found | 0.73| 88509|2 2019-06-25 08:13:34,893|MF|app-20190625081246-0139|15|4|START| 49.32|C.Centers found | 0.00| 0|2 2019-06-25 08:13:35,958|MF|app-20190625081246-0139|15|4| END| 50.39|C.Centers found | 1.07|177018|2 2019-06-25 08:13:35,959|MF|app-20190625081246-0139|15|4|START| 50.39|D.Disks found | 0.00| 0|2 2019-06-25 08:13:39,374|MF|app-20190625081246-0139|15|4| END| 53.80|D.Disks found | 3.42| 69927|2 2019-06-25 08:13:39,374|MF|app-20190625081246-0139|15|4|START| 53.80|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:13:40,224|MF|app-20190625081246-0139|15|4| END| 54.65|E.Disks partitioned | 0.85| 95823|2 2019-06-25 08:13:40,224|MF|app-20190625081246-0139|15|4|START| 54.65|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:13:40,225|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:13:40,225|Cell area: 1055533.7681000116 2019-06-25 08:13:44,605|MF|app-20190625081246-0139|15|4| END| 59.03|F.Maximal disks found | 4.38| 21483|2 2019-06-25 08:13:44,605|MAXIMALS|app-20190625081246-0139|4|15|90.0|3|1350|10.574|21483 2019-06-25 08:13:45,647|FF|app-20190625081246-0139|15|4| END| 60.07|1.Maximal disks found | 11.62| 21483|2 2019-06-25 08:13:45,647|FF|app-20190625081246-0139|15|4|START| 60.07|2.Join done | 0.00| 0|2 2019-06-25 08:13:51,627|FF|app-20190625081246-0139|15|4| END| 66.05|2.Join done | 5.98| 60752|2 2019-06-25 08:13:51,628|FF|app-20190625081246-0139|15|4|START| 66.05|3.Flocks to report | 0.00| 0|2 2019-06-25 08:13:53,053|FF|app-20190625081246-0139|15|4| END| 67.48|3.Flocks to report | 1.43| 52714|2 2019-06-25 08:13:53,053|FF|app-20190625081246-0139|15|4|START| 67.48|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:13:53,132|FF|app-20190625081246-0139|15|4|START| 67.56|4a.Making expansions | 0.00| 0|2 2019-06-25 08:13:54,059|FF|app-20190625081246-0139|15|4| END| 68.49|4a.Making expansions | 0.93| 65754|2 2019-06-25 08:13:54,059|FF|app-20190625081246-0139|15|4|START| 68.49|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:13:57,159|FF|app-20190625081246-0139|15|4| END| 71.59|4b.Finding maximals | 3.10| 14592|2 2019-06-25 08:13:57,612|FF|app-20190625081246-0139|15|4| END| 72.04|4.Flocks prunned by expansion | 4.56| 14592|2 2019-06-25 08:13:57,612|FF|app-20190625081246-0139|15|4|START| 72.04|5.Flocks reported | 0.00| 0|2 2019-06-25 08:13:58,206|FF|app-20190625081246-0139|15|4| END| 72.63|5.Flocks reported | 0.59| 14592|2 2019-06-25 08:13:58,206|FF|app-20190625081246-0139|15|4|START| 72.63|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:13:59,869|FF|app-20190625081246-0139|15|4| END| 74.30|6.Candidates indexed | 1.66| 23966|2 2019-06-25 08:13:59,869|FF|app-20190625081246-0139|15|4|START| 74.30|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:13:59,869|MF|app-20190625081246-0139|15|4|START| 74.30|A.Points indexed | 0.00| 0|3 2019-06-25 08:13:59,986|MF|app-20190625081246-0139|15|4| END| 74.41|A.Points indexed | 0.12| 55644|3 2019-06-25 08:13:59,987|MF|app-20190625081246-0139|15|4|START| 74.41|B.Pairs found | 0.00| 0|3 2019-06-25 08:14:00,739|MF|app-20190625081246-0139|15|4| END| 75.17|B.Pairs found | 0.75| 90000|3 2019-06-25 08:14:00,739|MF|app-20190625081246-0139|15|4|START| 75.17|C.Centers found | 0.00| 0|3 2019-06-25 08:14:01,883|MF|app-20190625081246-0139|15|4| END| 76.31|C.Centers found | 1.14|180000|3 2019-06-25 08:14:01,883|MF|app-20190625081246-0139|15|4|START| 76.31|D.Disks found | 0.00| 0|3 2019-06-25 08:14:05,509|MF|app-20190625081246-0139|15|4| END| 79.94|D.Disks found | 3.63| 71127|3 2019-06-25 08:14:05,509|MF|app-20190625081246-0139|15|4|START| 79.94|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:14:06,381|MF|app-20190625081246-0139|15|4| END| 80.81|E.Disks partitioned | 0.87| 97462|3 2019-06-25 08:14:06,381|MF|app-20190625081246-0139|15|4|START| 80.81|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:14:06,382|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:14:06,382|Cell area: 1055533.7681000116 2019-06-25 08:14:11,150|MF|app-20190625081246-0139|15|4| END| 85.58|F.Maximal disks found | 4.77| 21988|3 2019-06-25 08:14:11,151|MAXIMALS|app-20190625081246-0139|4|15|90.0|3|1350|11.282|21988 2019-06-25 08:14:12,148|FF|app-20190625081246-0139|15|4| END| 86.58|1.Maximal disks found | 12.28| 21988|3 2019-06-25 08:14:12,148|FF|app-20190625081246-0139|15|4|START| 86.58|2.Join done | 0.00| 0|3 2019-06-25 08:14:19,918|FF|app-20190625081246-0139|15|4| END| 94.35|2.Join done | 7.77| 56919|3 2019-06-25 08:14:19,918|FF|app-20190625081246-0139|15|4|START| 94.35|3.Flocks to report | 0.00| 0|3 2019-06-25 08:14:23,036|FF|app-20190625081246-0139|15|4| END| 97.46|3.Flocks to report | 3.12| 48321|3 2019-06-25 08:14:23,036|FF|app-20190625081246-0139|15|4|START| 97.46|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:14:23,167|FF|app-20190625081246-0139|15|4|START| 97.59|4a.Making expansions | 0.00| 0|3 2019-06-25 08:14:24,314|FF|app-20190625081246-0139|15|4| END| 98.74|4a.Making expansions | 1.15| 61681|3 2019-06-25 08:14:24,314|FF|app-20190625081246-0139|15|4|START| 98.74|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:14:26,490|FF|app-20190625081246-0139|15|4| END|100.92|4b.Finding maximals | 2.18| 14847|3 2019-06-25 08:14:26,980|FF|app-20190625081246-0139|15|4| END|101.41|4.Flocks prunned by expansion | 3.94| 14847|3 2019-06-25 08:14:26,980|FF|app-20190625081246-0139|15|4|START|101.41|5.Flocks reported | 0.00| 0|3 2019-06-25 08:14:27,599|FF|app-20190625081246-0139|15|4| END|102.03|5.Flocks reported | 0.62| 14847|3 2019-06-25 08:14:27,599|FF|app-20190625081246-0139|15|4|START|102.03|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:14:29,616|FF|app-20190625081246-0139|15|4| END|104.04|6.Candidates indexed | 2.02| 24850|3 2019-06-25 08:14:30,975|Number of flocks: 29439 2019-06-25 08:14:31,920|PFLOCK|app-20190625081246-0139|4|15|90.0|3|3|98.58|29439 2019-06-25 08:14:32,871|FF|app-20190625081246-0139|15|4| END|107.30|Flock Finder run |100.48| 29439|3 2019-06-25 08:14:32,871|FF|app-20190625081246-0139|15|4|START|107.30|Session closed | 0.00| 0|3 2019-06-25 08:14:40,663|FF|app-20190625081246-0139|15|4| END|115.09|Session closed | 7.79| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:14:42,632|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:14:43,693|FF|app-20190625081443-0140|10|4| END| 1.05|Session start | 1.06| 0|-1 2019-06-25 08:14:43,693|FF|app-20190625081443-0140|10|4|START| 1.05|Data read | 0.00| 0|-1 2019-06-25 08:14:47,676|FF|app-20190625081443-0140|10|4| END| 5.03|Data read | 3.98|220752|-1 2019-06-25 08:14:47,676|FF|app-20190625081443-0140|10|4|START| 5.03|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:14:47,913|FF|app-20190625081443-0140|10|4| END| 5.27|KDBTree partitioner | 0.24| 544|-1 2019-06-25 08:14:47,913|FF|app-20190625081443-0140|10|4|START| 5.27|MF partitioner | 0.00| 0|-1 2019-06-25 08:14:47,934|FF|app-20190625081443-0140|10|4| END| 5.29|MF partitioner | 0.02| 900|-1 2019-06-25 08:14:47,934|FF|app-20190625081443-0140|10|4|START| 5.29|Pointset done | 0.00| 0|-1 2019-06-25 08:14:49,058|FF|app-20190625081443-0140|10|4| END| 6.41|Pointset done | 1.12| 4|-1 2019-06-25 08:14:49,058|FF|app-20190625081443-0140|10|4|START| 6.41|Flock Finder run | 0.00| 0|-1 2019-06-25 08:14:49,075|FF|app-20190625081443-0140|10|4|START| 6.43|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:14:49,077|MF|app-20190625081443-0140|10|4|START| 6.43|A.Points indexed | 0.00| 0|0 2019-06-25 08:14:49,253|MF|app-20190625081443-0140|10|4| END| 6.61|A.Points indexed | 0.18| 36186|0 2019-06-25 08:14:49,253|MF|app-20190625081443-0140|10|4|START| 6.61|B.Pairs found | 0.00| 0|0 2019-06-25 08:14:50,905|MF|app-20190625081443-0140|10|4| END| 8.26|B.Pairs found | 1.65| 57438|0 2019-06-25 08:14:50,905|MF|app-20190625081443-0140|10|4|START| 8.26|C.Centers found | 0.00| 0|0 2019-06-25 08:14:52,127|MF|app-20190625081443-0140|10|4| END| 9.48|C.Centers found | 1.22|114876|0 2019-06-25 08:14:52,128|MF|app-20190625081443-0140|10|4|START| 9.48|D.Disks found | 0.00| 0|0 2019-06-25 08:14:56,813|MF|app-20190625081443-0140|10|4| END| 14.17|D.Disks found | 4.69| 45212|0 2019-06-25 08:14:56,813|MF|app-20190625081443-0140|10|4|START| 14.17|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:14:58,836|MF|app-20190625081443-0140|10|4| END| 16.19|E.Disks partitioned | 2.02| 62040|0 2019-06-25 08:14:58,836|MF|app-20190625081443-0140|10|4|START| 16.19|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:14:58,839|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:14:58,839|Cell area: 1055533.7681000116 2019-06-25 08:15:03,686|MF|app-20190625081443-0140|10|4| END| 21.04|F.Maximal disks found | 4.85| 13955|0 2019-06-25 08:15:03,686|MAXIMALS|app-20190625081443-0140|4|10|90.0|3|900|14.609|13955 2019-06-25 08:15:04,673|FF|app-20190625081443-0140|10|4| END| 22.03|1.Maximal disks found | 15.60| 13955|0 2019-06-25 08:15:04,673|FF|app-20190625081443-0140|10|4|START| 22.03|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:15:04,673|MF|app-20190625081443-0140|10|4|START| 22.03|A.Points indexed | 0.00| 0|1 2019-06-25 08:15:04,778|MF|app-20190625081443-0140|10|4| END| 22.13|A.Points indexed | 0.11| 36490|1 2019-06-25 08:15:04,778|MF|app-20190625081443-0140|10|4|START| 22.13|B.Pairs found | 0.00| 0|1 2019-06-25 08:15:05,562|MF|app-20190625081443-0140|10|4| END| 22.91|B.Pairs found | 0.78| 58216|1 2019-06-25 08:15:05,562|MF|app-20190625081443-0140|10|4|START| 22.91|C.Centers found | 0.00| 0|1 2019-06-25 08:15:06,632|MF|app-20190625081443-0140|10|4| END| 23.98|C.Centers found | 1.07|116432|1 2019-06-25 08:15:06,632|MF|app-20190625081443-0140|10|4|START| 23.98|D.Disks found | 0.00| 0|1 2019-06-25 08:15:11,142|MF|app-20190625081443-0140|10|4| END| 28.49|D.Disks found | 4.51| 45982|1 2019-06-25 08:15:11,142|MF|app-20190625081443-0140|10|4|START| 28.49|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:15:13,038|MF|app-20190625081443-0140|10|4| END| 30.39|E.Disks partitioned | 1.90| 62923|1 2019-06-25 08:15:13,038|MF|app-20190625081443-0140|10|4|START| 30.39|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:15:13,038|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:15:13,039|Cell area: 1055533.7681000116 2019-06-25 08:15:17,421|MF|app-20190625081443-0140|10|4| END| 34.77|F.Maximal disks found | 4.38| 14084|1 2019-06-25 08:15:17,421|MAXIMALS|app-20190625081443-0140|4|10|90.0|3|900|12.748|14084 2019-06-25 08:15:18,294|FF|app-20190625081443-0140|10|4| END| 35.65|1.Maximal disks found | 13.62| 14084|1 2019-06-25 08:15:18,294|FF|app-20190625081443-0140|10|4|START| 35.65|2.Join done | 0.00| 0|1 2019-06-25 08:15:22,879|FF|app-20190625081443-0140|10|4| END| 40.23|2.Join done | 4.59| 25295|1 2019-06-25 08:15:22,879|FF|app-20190625081443-0140|10|4|START| 40.23|3.Flocks to report | 0.00| 0|1 2019-06-25 08:15:23,702|FF|app-20190625081443-0140|10|4| END| 41.05|3.Flocks to report | 0.82| 0|1 2019-06-25 08:15:23,702|FF|app-20190625081443-0140|10|4|START| 41.05|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:15:23,761|FF|app-20190625081443-0140|10|4| END| 41.11|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 08:15:23,762|FF|app-20190625081443-0140|10|4|START| 41.11|5.Flocks reported | 0.00| 0|1 2019-06-25 08:15:23,766|FF|app-20190625081443-0140|10|4| END| 41.12|5.Flocks reported | 0.01| 0|1 2019-06-25 08:15:23,766|FF|app-20190625081443-0140|10|4|START| 41.12|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:15:25,678|FF|app-20190625081443-0140|10|4| END| 43.03|6.Candidates indexed | 1.91| 26108|1 2019-06-25 08:15:25,678|FF|app-20190625081443-0140|10|4|START| 43.03|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:15:25,679|MF|app-20190625081443-0140|10|4|START| 43.03|A.Points indexed | 0.00| 0|2 2019-06-25 08:15:25,771|MF|app-20190625081443-0140|10|4| END| 43.12|A.Points indexed | 0.09| 36788|2 2019-06-25 08:15:25,771|MF|app-20190625081443-0140|10|4|START| 43.12|B.Pairs found | 0.00| 0|2 2019-06-25 08:15:26,568|MF|app-20190625081443-0140|10|4| END| 43.92|B.Pairs found | 0.80| 59006|2 2019-06-25 08:15:26,568|MF|app-20190625081443-0140|10|4|START| 43.92|C.Centers found | 0.00| 0|2 2019-06-25 08:15:27,909|MF|app-20190625081443-0140|10|4| END| 45.26|C.Centers found | 1.34|118012|2 2019-06-25 08:15:27,909|MF|app-20190625081443-0140|10|4|START| 45.26|D.Disks found | 0.00| 0|2 2019-06-25 08:15:33,233|MF|app-20190625081443-0140|10|4| END| 50.59|D.Disks found | 5.32| 46618|2 2019-06-25 08:15:33,233|MF|app-20190625081443-0140|10|4|START| 50.59|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:15:36,998|MF|app-20190625081443-0140|10|4| END| 54.35|E.Disks partitioned | 3.77| 63871|2 2019-06-25 08:15:36,998|MF|app-20190625081443-0140|10|4|START| 54.35|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:15:36,998|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:15:36,998|Cell area: 1055533.7681000116 2019-06-25 08:15:42,736|MF|app-20190625081443-0140|10|4| END| 60.09|F.Maximal disks found | 5.74| 14320|2 2019-06-25 08:15:42,736|MAXIMALS|app-20190625081443-0140|4|10|90.0|3|900|17.057|14320 2019-06-25 08:15:44,246|FF|app-20190625081443-0140|10|4| END| 61.60|1.Maximal disks found | 18.57| 14320|2 2019-06-25 08:15:44,247|FF|app-20190625081443-0140|10|4|START| 61.60|2.Join done | 0.00| 0|2 2019-06-25 08:15:57,259|FF|app-20190625081443-0140|10|4| END| 74.61|2.Join done | 13.01| 40483|2 2019-06-25 08:15:57,259|FF|app-20190625081443-0140|10|4|START| 74.61|3.Flocks to report | 0.00| 0|2 2019-06-25 08:15:59,755|FF|app-20190625081443-0140|10|4| END| 77.11|3.Flocks to report | 2.50| 35129|2 2019-06-25 08:15:59,755|FF|app-20190625081443-0140|10|4|START| 77.11|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:15:59,845|FF|app-20190625081443-0140|10|4|START| 77.20|4a.Making expansions | 0.00| 0|2 2019-06-25 08:16:01,771|FF|app-20190625081443-0140|10|4| END| 79.12|4a.Making expansions | 1.93| 43807|2 2019-06-25 08:16:01,771|FF|app-20190625081443-0140|10|4|START| 79.12|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:16:05,587|FF|app-20190625081443-0140|10|4| END| 82.94|4b.Finding maximals | 3.82| 9728|2 2019-06-25 08:16:06,201|FF|app-20190625081443-0140|10|4| END| 83.55|4.Flocks prunned by expansion | 6.45| 9728|2 2019-06-25 08:16:06,201|FF|app-20190625081443-0140|10|4|START| 83.55|5.Flocks reported | 0.00| 0|2 2019-06-25 08:16:07,137|FF|app-20190625081443-0140|10|4| END| 84.49|5.Flocks reported | 0.94| 9728|2 2019-06-25 08:16:07,137|FF|app-20190625081443-0140|10|4|START| 84.49|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:16:10,184|FF|app-20190625081443-0140|10|4| END| 87.54|6.Candidates indexed | 3.05| 15972|2 2019-06-25 08:16:10,184|FF|app-20190625081443-0140|10|4|START| 87.54|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:16:10,184|MF|app-20190625081443-0140|10|4|START| 87.54|A.Points indexed | 0.00| 0|3 2019-06-25 08:16:10,273|MF|app-20190625081443-0140|10|4| END| 87.63|A.Points indexed | 0.09| 37096|3 2019-06-25 08:16:10,273|MF|app-20190625081443-0140|10|4|START| 87.63|B.Pairs found | 0.00| 0|3 2019-06-25 08:16:10,941|MF|app-20190625081443-0140|10|4| END| 88.29|B.Pairs found | 0.67| 60000|3 2019-06-25 08:16:10,941|MF|app-20190625081443-0140|10|4|START| 88.29|C.Centers found | 0.00| 0|3 2019-06-25 08:16:11,746|MF|app-20190625081443-0140|10|4| END| 89.10|C.Centers found | 0.81|120000|3 2019-06-25 08:16:11,746|MF|app-20190625081443-0140|10|4|START| 89.10|D.Disks found | 0.00| 0|3 2019-06-25 08:16:15,990|MF|app-20190625081443-0140|10|4| END| 93.34|D.Disks found | 4.24| 47418|3 2019-06-25 08:16:15,990|MF|app-20190625081443-0140|10|4|START| 93.34|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:16:17,975|MF|app-20190625081443-0140|10|4| END| 95.33|E.Disks partitioned | 1.99| 64956|3 2019-06-25 08:16:17,975|MF|app-20190625081443-0140|10|4|START| 95.33|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:16:17,975|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:16:17,975|Cell area: 1055533.7681000116 2019-06-25 08:16:22,920|MF|app-20190625081443-0140|10|4| END|100.27|F.Maximal disks found | 4.95| 14656|3 2019-06-25 08:16:22,920|MAXIMALS|app-20190625081443-0140|4|10|90.0|3|900|12.736|14656 2019-06-25 08:16:23,898|FF|app-20190625081443-0140|10|4| END|101.25|1.Maximal disks found | 13.71| 14656|3 2019-06-25 08:16:23,898|FF|app-20190625081443-0140|10|4|START|101.25|2.Join done | 0.00| 0|3 2019-06-25 08:16:29,542|FF|app-20190625081443-0140|10|4| END|106.89|2.Join done | 5.64| 37923|3 2019-06-25 08:16:29,542|FF|app-20190625081443-0140|10|4|START|106.89|3.Flocks to report | 0.00| 0|3 2019-06-25 08:16:30,831|FF|app-20190625081443-0140|10|4| END|108.18|3.Flocks to report | 1.29| 32203|3 2019-06-25 08:16:30,832|FF|app-20190625081443-0140|10|4|START|108.18|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:16:30,897|FF|app-20190625081443-0140|10|4|START|108.25|4a.Making expansions | 0.00| 0|3 2019-06-25 08:16:32,148|FF|app-20190625081443-0140|10|4| END|109.50|4a.Making expansions | 1.25| 41049|3 2019-06-25 08:16:32,148|FF|app-20190625081443-0140|10|4|START|109.50|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:16:34,624|FF|app-20190625081443-0140|10|4| END|111.98|4b.Finding maximals | 2.48| 9898|3 2019-06-25 08:16:35,018|FF|app-20190625081443-0140|10|4| END|112.37|4.Flocks prunned by expansion | 4.19| 9898|3 2019-06-25 08:16:35,018|FF|app-20190625081443-0140|10|4|START|112.37|5.Flocks reported | 0.00| 0|3 2019-06-25 08:16:35,605|FF|app-20190625081443-0140|10|4| END|112.96|5.Flocks reported | 0.59| 9898|3 2019-06-25 08:16:35,605|FF|app-20190625081443-0140|10|4|START|112.96|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:16:37,607|FF|app-20190625081443-0140|10|4| END|114.96|6.Candidates indexed | 2.00| 16555|3 2019-06-25 08:16:39,160|Number of flocks: 19626 2019-06-25 08:16:39,934|PFLOCK|app-20190625081443-0140|4|10|90.0|3|3|110.10|19626 2019-06-25 08:16:40,714|FF|app-20190625081443-0140|10|4| END|118.07|Flock Finder run |111.66| 19626|3 2019-06-25 08:16:40,714|FF|app-20190625081443-0140|10|4|START|118.07|Session closed | 0.00| 0|3 2019-06-25 08:16:47,613|FF|app-20190625081443-0140|10|4| END|124.97|Session closed | 6.90| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:16:49,629|FF|app-00000000000000-0000|5|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 08:16:50,760|FF|app-20190625081650-0141|5|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 08:16:50,760|FF|app-20190625081650-0141|5|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 08:16:54,421|FF|app-20190625081650-0141|5|4| END| 4.77|Data read | 3.66|110376|-1 2019-06-25 08:16:54,422|FF|app-20190625081650-0141|5|4|START| 4.77|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:16:54,549|FF|app-20190625081650-0141|5|4| END| 4.90|KDBTree partitioner | 0.13| 272|-1 2019-06-25 08:16:54,550|FF|app-20190625081650-0141|5|4|START| 4.90|MF partitioner | 0.00| 0|-1 2019-06-25 08:16:54,563|FF|app-20190625081650-0141|5|4| END| 4.92|MF partitioner | 0.01| 450|-1 2019-06-25 08:16:54,563|FF|app-20190625081650-0141|5|4|START| 4.92|Pointset done | 0.00| 0|-1 2019-06-25 08:16:55,400|FF|app-20190625081650-0141|5|4| END| 5.75|Pointset done | 0.84| 4|-1 2019-06-25 08:16:55,401|FF|app-20190625081650-0141|5|4|START| 5.75|Flock Finder run | 0.00| 0|-1 2019-06-25 08:16:55,552|FF|app-20190625081650-0141|5|4|START| 5.91|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:16:55,556|MF|app-20190625081650-0141|5|4|START| 5.91|A.Points indexed | 0.00| 0|0 2019-06-25 08:16:55,723|MF|app-20190625081650-0141|5|4| END| 6.08|A.Points indexed | 0.17| 18093|0 2019-06-25 08:16:55,723|MF|app-20190625081650-0141|5|4|START| 6.08|B.Pairs found | 0.00| 0|0 2019-06-25 08:16:57,017|MF|app-20190625081650-0141|5|4| END| 7.37|B.Pairs found | 1.29| 28719|0 2019-06-25 08:16:57,017|MF|app-20190625081650-0141|5|4|START| 7.37|C.Centers found | 0.00| 0|0 2019-06-25 08:16:57,799|MF|app-20190625081650-0141|5|4| END| 8.15|C.Centers found | 0.78| 57438|0 2019-06-25 08:16:57,800|MF|app-20190625081650-0141|5|4|START| 8.15|D.Disks found | 0.00| 0|0 2019-06-25 08:17:00,499|MF|app-20190625081650-0141|5|4| END| 10.85|D.Disks found | 2.70| 22606|0 2019-06-25 08:17:00,500|MF|app-20190625081650-0141|5|4|START| 10.85|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:17:01,490|MF|app-20190625081650-0141|5|4| END| 11.84|E.Disks partitioned | 0.99| 31017|0 2019-06-25 08:17:01,490|MF|app-20190625081650-0141|5|4|START| 11.84|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:17:01,492|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:17:01,492|Cell area: 1055533.7681000116 2019-06-25 08:17:05,762|MF|app-20190625081650-0141|5|4| END| 16.11|F.Maximal disks found | 4.27| 6974|0 2019-06-25 08:17:05,762|MAXIMALS|app-20190625081650-0141|4|5|90.0|3|450|10.206|6974 2019-06-25 08:17:06,292|FF|app-20190625081650-0141|5|4| END| 16.65|1.Maximal disks found | 10.74| 6974|0 2019-06-25 08:17:06,293|FF|app-20190625081650-0141|5|4|START| 16.65|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:17:06,293|MF|app-20190625081650-0141|5|4|START| 16.65|A.Points indexed | 0.00| 0|1 2019-06-25 08:17:06,375|MF|app-20190625081650-0141|5|4| END| 16.73|A.Points indexed | 0.08| 18245|1 2019-06-25 08:17:06,375|MF|app-20190625081650-0141|5|4|START| 16.73|B.Pairs found | 0.00| 0|1 2019-06-25 08:17:06,803|MF|app-20190625081650-0141|5|4| END| 17.16|B.Pairs found | 0.43| 29108|1 2019-06-25 08:17:06,804|MF|app-20190625081650-0141|5|4|START| 17.16|C.Centers found | 0.00| 0|1 2019-06-25 08:17:07,211|MF|app-20190625081650-0141|5|4| END| 17.56|C.Centers found | 0.41| 58216|1 2019-06-25 08:17:07,211|MF|app-20190625081650-0141|5|4|START| 17.56|D.Disks found | 0.00| 0|1 2019-06-25 08:17:09,044|MF|app-20190625081650-0141|5|4| END| 19.40|D.Disks found | 1.83| 22991|1 2019-06-25 08:17:09,045|MF|app-20190625081650-0141|5|4|START| 19.40|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:17:09,791|MF|app-20190625081650-0141|5|4| END| 20.14|E.Disks partitioned | 0.75| 31459|1 2019-06-25 08:17:09,791|MF|app-20190625081650-0141|5|4|START| 20.14|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:17:09,791|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:17:09,791|Cell area: 1055533.7681000116 2019-06-25 08:17:13,726|MF|app-20190625081650-0141|5|4| END| 24.08|F.Maximal disks found | 3.94| 7040|1 2019-06-25 08:17:13,726|MAXIMALS|app-20190625081650-0141|4|5|90.0|3|450|7.433|7040 2019-06-25 08:17:14,182|FF|app-20190625081650-0141|5|4| END| 24.54|1.Maximal disks found | 7.89| 7040|1 2019-06-25 08:17:14,182|FF|app-20190625081650-0141|5|4|START| 24.54|2.Join done | 0.00| 0|1 2019-06-25 08:17:16,155|FF|app-20190625081650-0141|5|4| END| 26.51|2.Join done | 1.97| 12653|1 2019-06-25 08:17:16,155|FF|app-20190625081650-0141|5|4|START| 26.51|3.Flocks to report | 0.00| 0|1 2019-06-25 08:17:16,569|FF|app-20190625081650-0141|5|4| END| 26.92|3.Flocks to report | 0.41| 0|1 2019-06-25 08:17:16,569|FF|app-20190625081650-0141|5|4|START| 26.92|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:17:16,609|FF|app-20190625081650-0141|5|4| END| 26.96|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 08:17:16,609|FF|app-20190625081650-0141|5|4|START| 26.96|5.Flocks reported | 0.00| 0|1 2019-06-25 08:17:16,614|FF|app-20190625081650-0141|5|4| END| 26.97|5.Flocks reported | 0.01| 0|1 2019-06-25 08:17:16,615|FF|app-20190625081650-0141|5|4|START| 26.97|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:17:17,944|FF|app-20190625081650-0141|5|4| END| 28.30|6.Candidates indexed | 1.33| 13060|1 2019-06-25 08:17:17,944|FF|app-20190625081650-0141|5|4|START| 28.30|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:17:17,945|MF|app-20190625081650-0141|5|4|START| 28.30|A.Points indexed | 0.00| 0|2 2019-06-25 08:17:18,012|MF|app-20190625081650-0141|5|4| END| 28.37|A.Points indexed | 0.07| 18394|2 2019-06-25 08:17:18,012|MF|app-20190625081650-0141|5|4|START| 28.37|B.Pairs found | 0.00| 0|2 2019-06-25 08:17:18,419|MF|app-20190625081650-0141|5|4| END| 28.77|B.Pairs found | 0.41| 29503|2 2019-06-25 08:17:18,419|MF|app-20190625081650-0141|5|4|START| 28.77|C.Centers found | 0.00| 0|2 2019-06-25 08:17:18,854|MF|app-20190625081650-0141|5|4| END| 29.21|C.Centers found | 0.43| 59006|2 2019-06-25 08:17:18,854|MF|app-20190625081650-0141|5|4|START| 29.21|D.Disks found | 0.00| 0|2 2019-06-25 08:17:20,854|MF|app-20190625081650-0141|5|4| END| 31.21|D.Disks found | 2.00| 23309|2 2019-06-25 08:17:20,855|MF|app-20190625081650-0141|5|4|START| 31.21|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:17:21,536|MF|app-20190625081650-0141|5|4| END| 31.89|E.Disks partitioned | 0.68| 31937|2 2019-06-25 08:17:21,537|MF|app-20190625081650-0141|5|4|START| 31.89|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:17:21,537|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:17:21,537|Cell area: 1055533.7681000116 2019-06-25 08:17:25,627|MF|app-20190625081650-0141|5|4| END| 35.98|F.Maximal disks found | 4.09| 7158|2 2019-06-25 08:17:25,627|MAXIMALS|app-20190625081650-0141|4|5|90.0|3|450|7.682|7158 2019-06-25 08:17:26,001|FF|app-20190625081650-0141|5|4| END| 36.35|1.Maximal disks found | 8.06| 7158|2 2019-06-25 08:17:26,001|FF|app-20190625081650-0141|5|4|START| 36.35|2.Join done | 0.00| 0|2 2019-06-25 08:17:30,028|FF|app-20190625081650-0141|5|4| END| 40.38|2.Join done | 4.03| 20250|2 2019-06-25 08:17:30,028|FF|app-20190625081650-0141|5|4|START| 40.38|3.Flocks to report | 0.00| 0|2 2019-06-25 08:17:30,784|FF|app-20190625081650-0141|5|4| END| 41.14|3.Flocks to report | 0.76| 17572|2 2019-06-25 08:17:30,784|FF|app-20190625081650-0141|5|4|START| 41.14|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:17:30,824|FF|app-20190625081650-0141|5|4|START| 41.18|4a.Making expansions | 0.00| 0|2 2019-06-25 08:17:31,394|FF|app-20190625081650-0141|5|4| END| 41.75|4a.Making expansions | 0.57| 21922|2 2019-06-25 08:17:31,394|FF|app-20190625081650-0141|5|4|START| 41.75|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:17:34,368|FF|app-20190625081650-0141|5|4| END| 44.72|4b.Finding maximals | 2.97| 4864|2 2019-06-25 08:17:34,596|FF|app-20190625081650-0141|5|4| END| 44.95|4.Flocks prunned by expansion | 3.81| 4864|2 2019-06-25 08:17:34,596|FF|app-20190625081650-0141|5|4|START| 44.95|5.Flocks reported | 0.00| 0|2 2019-06-25 08:17:34,870|FF|app-20190625081650-0141|5|4| END| 45.22|5.Flocks reported | 0.27| 4864|2 2019-06-25 08:17:34,870|FF|app-20190625081650-0141|5|4|START| 45.22|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:17:36,350|FF|app-20190625081650-0141|5|4| END| 46.70|6.Candidates indexed | 1.48| 7987|2 2019-06-25 08:17:36,350|FF|app-20190625081650-0141|5|4|START| 46.70|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:17:36,350|MF|app-20190625081650-0141|5|4|START| 46.70|A.Points indexed | 0.00| 0|3 2019-06-25 08:17:36,410|MF|app-20190625081650-0141|5|4| END| 46.76|A.Points indexed | 0.06| 18548|3 2019-06-25 08:17:36,410|MF|app-20190625081650-0141|5|4|START| 46.76|B.Pairs found | 0.00| 0|3 2019-06-25 08:17:36,995|MF|app-20190625081650-0141|5|4| END| 47.35|B.Pairs found | 0.59| 30000|3 2019-06-25 08:17:36,996|MF|app-20190625081650-0141|5|4|START| 47.35|C.Centers found | 0.00| 0|3 2019-06-25 08:17:37,624|MF|app-20190625081650-0141|5|4| END| 47.98|C.Centers found | 0.63| 60000|3 2019-06-25 08:17:37,624|MF|app-20190625081650-0141|5|4|START| 47.98|D.Disks found | 0.00| 0|3 2019-06-25 08:17:40,449|MF|app-20190625081650-0141|5|4| END| 50.80|D.Disks found | 2.83| 23709|3 2019-06-25 08:17:40,449|MF|app-20190625081650-0141|5|4|START| 50.80|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:17:41,327|MF|app-20190625081650-0141|5|4| END| 51.68|E.Disks partitioned | 0.88| 32468|3 2019-06-25 08:17:41,327|MF|app-20190625081650-0141|5|4|START| 51.68|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:17:41,327|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:17:41,327|Cell area: 1055533.7681000116 2019-06-25 08:17:45,527|MF|app-20190625081650-0141|5|4| END| 55.88|F.Maximal disks found | 4.20| 7325|3 2019-06-25 08:17:45,527|MAXIMALS|app-20190625081650-0141|4|5|90.0|3|450|9.177|7325 2019-06-25 08:17:45,973|FF|app-20190625081650-0141|5|4| END| 56.33|1.Maximal disks found | 9.62| 7325|3 2019-06-25 08:17:45,974|FF|app-20190625081650-0141|5|4|START| 56.33|2.Join done | 0.00| 0|3 2019-06-25 08:17:48,785|FF|app-20190625081650-0141|5|4| END| 59.14|2.Join done | 2.81| 18963|3 2019-06-25 08:17:48,786|FF|app-20190625081650-0141|5|4|START| 59.14|3.Flocks to report | 0.00| 0|3 2019-06-25 08:17:49,456|FF|app-20190625081650-0141|5|4| END| 59.81|3.Flocks to report | 0.67| 16098|3 2019-06-25 08:17:49,456|FF|app-20190625081650-0141|5|4|START| 59.81|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:17:49,493|FF|app-20190625081650-0141|5|4|START| 59.85|4a.Making expansions | 0.00| 0|3 2019-06-25 08:17:50,065|FF|app-20190625081650-0141|5|4| END| 60.42|4a.Making expansions | 0.57| 20526|3 2019-06-25 08:17:50,065|FF|app-20190625081650-0141|5|4|START| 60.42|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:17:51,972|FF|app-20190625081650-0141|5|4| END| 62.33|4b.Finding maximals | 1.91| 4949|3 2019-06-25 08:17:52,157|FF|app-20190625081650-0141|5|4| END| 62.51|4.Flocks prunned by expansion | 2.70| 4949|3 2019-06-25 08:17:52,157|FF|app-20190625081650-0141|5|4|START| 62.51|5.Flocks reported | 0.00| 0|3 2019-06-25 08:17:52,471|FF|app-20190625081650-0141|5|4| END| 62.82|5.Flocks reported | 0.31| 4949|3 2019-06-25 08:17:52,472|FF|app-20190625081650-0141|5|4|START| 62.82|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:17:53,966|FF|app-20190625081650-0141|5|4| END| 64.32|6.Candidates indexed | 1.50| 8283|3 2019-06-25 08:17:54,639|Number of flocks: 9813 2019-06-25 08:17:54,992|PFLOCK|app-20190625081650-0141|4|5|90.0|3|3|59.24|9813 2019-06-25 08:17:55,366|FF|app-20190625081650-0141|5|4| END| 65.72|Flock Finder run | 59.97| 9813|3 2019-06-25 08:17:55,366|FF|app-20190625081650-0141|5|4|START| 65.72|Session closed | 0.00| 0|3 2019-06-25 08:18:02,469|FF|app-20190625081650-0141|5|4| END| 72.82|Session closed | 7.10| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:18:04,453|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:18:05,554|FF|app-20190625081805-0142|15|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 08:18:05,554|FF|app-20190625081805-0142|15|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 08:18:09,732|FF|app-20190625081805-0142|15|4| END| 5.26|Data read | 4.18|331128|-1 2019-06-25 08:18:09,732|FF|app-20190625081805-0142|15|4|START| 5.26|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:18:10,092|FF|app-20190625081805-0142|15|4| END| 5.62|KDBTree partitioner | 0.36| 816|-1 2019-06-25 08:18:10,092|FF|app-20190625081805-0142|15|4|START| 5.62|MF partitioner | 0.00| 0|-1 2019-06-25 08:18:10,112|FF|app-20190625081805-0142|15|4| END| 5.64|MF partitioner | 0.02| 1350|-1 2019-06-25 08:18:10,112|FF|app-20190625081805-0142|15|4|START| 5.64|Pointset done | 0.00| 0|-1 2019-06-25 08:18:11,352|FF|app-20190625081805-0142|15|4| END| 6.88|Pointset done | 1.24| 4|-1 2019-06-25 08:18:11,353|FF|app-20190625081805-0142|15|4|START| 6.88|Flock Finder run | 0.00| 0|-1 2019-06-25 08:18:11,370|FF|app-20190625081805-0142|15|4|START| 6.90|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:18:11,373|MF|app-20190625081805-0142|15|4|START| 6.90|A.Points indexed | 0.00| 0|0 2019-06-25 08:18:11,588|MF|app-20190625081805-0142|15|4| END| 7.12|A.Points indexed | 0.22| 54279|0 2019-06-25 08:18:11,589|MF|app-20190625081805-0142|15|4|START| 7.12|B.Pairs found | 0.00| 0|0 2019-06-25 08:18:13,641|MF|app-20190625081805-0142|15|4| END| 9.17|B.Pairs found | 2.05|101871|0 2019-06-25 08:18:13,641|MF|app-20190625081805-0142|15|4|START| 9.17|C.Centers found | 0.00| 0|0 2019-06-25 08:18:15,301|MF|app-20190625081805-0142|15|4| END| 10.83|C.Centers found | 1.66|203742|0 2019-06-25 08:18:15,301|MF|app-20190625081805-0142|15|4|START| 10.83|D.Disks found | 0.00| 0|0 2019-06-25 08:18:24,759|MF|app-20190625081805-0142|15|4| END| 20.29|D.Disks found | 9.46| 85998|0 2019-06-25 08:18:24,759|MF|app-20190625081805-0142|15|4|START| 20.29|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:18:27,727|MF|app-20190625081805-0142|15|4| END| 23.26|E.Disks partitioned | 2.97|121693|0 2019-06-25 08:18:27,727|MF|app-20190625081805-0142|15|4|START| 23.26|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:18:27,729|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:18:27,729|Cell area: 1055533.7681000116 2019-06-25 08:18:38,285|MF|app-20190625081805-0142|15|4| END| 33.82|F.Maximal disks found | 10.56| 25114|0 2019-06-25 08:18:38,286|MAXIMALS|app-20190625081805-0142|4|15|100.0|3|1350|26.913|25114 2019-06-25 08:18:39,331|FF|app-20190625081805-0142|15|4| END| 34.86|1.Maximal disks found | 27.96| 25114|0 2019-06-25 08:18:39,331|FF|app-20190625081805-0142|15|4|START| 34.86|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:18:39,331|MF|app-20190625081805-0142|15|4|START| 34.86|A.Points indexed | 0.00| 0|1 2019-06-25 08:18:39,457|MF|app-20190625081805-0142|15|4| END| 34.99|A.Points indexed | 0.13| 54735|1 2019-06-25 08:18:39,458|MF|app-20190625081805-0142|15|4|START| 34.99|B.Pairs found | 0.00| 0|1 2019-06-25 08:18:40,561|MF|app-20190625081805-0142|15|4| END| 36.09|B.Pairs found | 1.10|103386|1 2019-06-25 08:18:40,561|MF|app-20190625081805-0142|15|4|START| 36.09|C.Centers found | 0.00| 0|1 2019-06-25 08:18:42,100|MF|app-20190625081805-0142|15|4| END| 37.63|C.Centers found | 1.54|206772|1 2019-06-25 08:18:42,100|MF|app-20190625081805-0142|15|4|START| 37.63|D.Disks found | 0.00| 0|1 2019-06-25 08:18:51,240|MF|app-20190625081805-0142|15|4| END| 46.77|D.Disks found | 9.14| 87348|1 2019-06-25 08:18:51,241|MF|app-20190625081805-0142|15|4|START| 46.77|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:18:54,072|MF|app-20190625081805-0142|15|4| END| 49.60|E.Disks partitioned | 2.83|123553|1 2019-06-25 08:18:54,073|MF|app-20190625081805-0142|15|4|START| 49.60|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:18:54,073|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:18:54,073|Cell area: 1055533.7681000116 2019-06-25 08:19:03,729|MF|app-20190625081805-0142|15|4| END| 59.26|F.Maximal disks found | 9.66| 25640|1 2019-06-25 08:19:03,730|MAXIMALS|app-20190625081805-0142|4|15|100.0|3|1350|24.399|25640 2019-06-25 08:19:04,743|FF|app-20190625081805-0142|15|4| END| 60.27|1.Maximal disks found | 25.41| 25640|1 2019-06-25 08:19:04,743|FF|app-20190625081805-0142|15|4|START| 60.27|2.Join done | 0.00| 0|1 2019-06-25 08:19:07,761|FF|app-20190625081805-0142|15|4| END| 63.29|2.Join done | 3.02| 51443|1 2019-06-25 08:19:07,761|FF|app-20190625081805-0142|15|4|START| 63.29|3.Flocks to report | 0.00| 0|1 2019-06-25 08:19:08,319|FF|app-20190625081805-0142|15|4| END| 63.85|3.Flocks to report | 0.56| 0|1 2019-06-25 08:19:08,319|FF|app-20190625081805-0142|15|4|START| 63.85|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:19:08,389|FF|app-20190625081805-0142|15|4| END| 63.92|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 08:19:08,390|FF|app-20190625081805-0142|15|4|START| 63.92|5.Flocks reported | 0.00| 0|1 2019-06-25 08:19:08,394|FF|app-20190625081805-0142|15|4| END| 63.92|5.Flocks reported | 0.00| 0|1 2019-06-25 08:19:08,395|FF|app-20190625081805-0142|15|4|START| 63.93|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:19:10,000|FF|app-20190625081805-0142|15|4| END| 65.53|6.Candidates indexed | 1.61| 52931|1 2019-06-25 08:19:10,000|FF|app-20190625081805-0142|15|4|START| 65.53|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:19:10,001|MF|app-20190625081805-0142|15|4|START| 65.53|A.Points indexed | 0.00| 0|2 2019-06-25 08:19:10,128|MF|app-20190625081805-0142|15|4| END| 65.66|A.Points indexed | 0.13| 55182|2 2019-06-25 08:19:10,129|MF|app-20190625081805-0142|15|4|START| 65.66|B.Pairs found | 0.00| 0|2 2019-06-25 08:19:11,012|MF|app-20190625081805-0142|15|4| END| 66.54|B.Pairs found | 0.88|104754|2 2019-06-25 08:19:11,012|MF|app-20190625081805-0142|15|4|START| 66.54|C.Centers found | 0.00| 0|2 2019-06-25 08:19:12,790|MF|app-20190625081805-0142|15|4| END| 68.32|C.Centers found | 1.78|209508|2 2019-06-25 08:19:12,790|MF|app-20190625081805-0142|15|4|START| 68.32|D.Disks found | 0.00| 0|2 2019-06-25 08:19:18,898|MF|app-20190625081805-0142|15|4| END| 74.43|D.Disks found | 6.11| 88647|2 2019-06-25 08:19:18,898|MF|app-20190625081805-0142|15|4|START| 74.43|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:19:21,596|MF|app-20190625081805-0142|15|4| END| 77.13|E.Disks partitioned | 2.70|125639|2 2019-06-25 08:19:21,596|MF|app-20190625081805-0142|15|4|START| 77.13|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:19:21,596|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:19:21,596|Cell area: 1055533.7681000116 2019-06-25 08:19:31,784|MF|app-20190625081805-0142|15|4| END| 87.31|F.Maximal disks found | 10.19| 26055|2 2019-06-25 08:19:31,784|MAXIMALS|app-20190625081805-0142|4|15|100.0|3|1350|21.783|26055 2019-06-25 08:19:32,790|FF|app-20190625081805-0142|15|4| END| 88.32|1.Maximal disks found | 22.79| 26055|2 2019-06-25 08:19:32,790|FF|app-20190625081805-0142|15|4|START| 88.32|2.Join done | 0.00| 0|2 2019-06-25 08:19:43,208|FF|app-20190625081805-0142|15|4| END| 98.74|2.Join done | 10.42| 98043|2 2019-06-25 08:19:43,208|FF|app-20190625081805-0142|15|4|START| 98.74|3.Flocks to report | 0.00| 0|2 2019-06-25 08:19:45,183|FF|app-20190625081805-0142|15|4| END|100.71|3.Flocks to report | 1.98| 83662|2 2019-06-25 08:19:45,183|FF|app-20190625081805-0142|15|4|START|100.71|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:19:45,259|FF|app-20190625081805-0142|15|4|START|100.79|4a.Making expansions | 0.00| 0|2 2019-06-25 08:19:46,405|FF|app-20190625081805-0142|15|4| END|101.94|4a.Making expansions | 1.15|103838|2 2019-06-25 08:19:46,405|FF|app-20190625081805-0142|15|4|START|101.94|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:20:00,921|FF|app-20190625081805-0142|15|4| END|116.45|4b.Finding maximals | 14.52| 17091|2 2019-06-25 08:20:01,375|FF|app-20190625081805-0142|15|4| END|116.90|4.Flocks prunned by expansion | 16.19| 17091|2 2019-06-25 08:20:01,375|FF|app-20190625081805-0142|15|4|START|116.91|5.Flocks reported | 0.00| 0|2 2019-06-25 08:20:01,982|FF|app-20190625081805-0142|15|4| END|117.51|5.Flocks reported | 0.61| 17091|2 2019-06-25 08:20:01,983|FF|app-20190625081805-0142|15|4|START|117.51|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:20:03,850|FF|app-20190625081805-0142|15|4| END|119.38|6.Candidates indexed | 1.87| 33209|2 2019-06-25 08:20:03,850|FF|app-20190625081805-0142|15|4|START|119.38|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:20:03,850|MF|app-20190625081805-0142|15|4|START|119.38|A.Points indexed | 0.00| 0|3 2019-06-25 08:20:03,962|MF|app-20190625081805-0142|15|4| END|119.49|A.Points indexed | 0.11| 55644|3 2019-06-25 08:20:03,963|MF|app-20190625081805-0142|15|4|START|119.49|B.Pairs found | 0.00| 0|3 2019-06-25 08:20:04,691|MF|app-20190625081805-0142|15|4| END|120.22|B.Pairs found | 0.73|106545|3 2019-06-25 08:20:04,691|MF|app-20190625081805-0142|15|4|START|120.22|C.Centers found | 0.00| 0|3 2019-06-25 08:20:05,759|MF|app-20190625081805-0142|15|4| END|121.29|C.Centers found | 1.07|213090|3 2019-06-25 08:20:05,759|MF|app-20190625081805-0142|15|4|START|121.29|D.Disks found | 0.00| 0|3 2019-06-25 08:20:09,060|MF|app-20190625081805-0142|15|4| END|124.59|D.Disks found | 3.30| 90426|3 2019-06-25 08:20:09,060|MF|app-20190625081805-0142|15|4|START|124.59|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:20:10,125|MF|app-20190625081805-0142|15|4| END|125.66|E.Disks partitioned | 1.07|128174|3 2019-06-25 08:20:10,126|MF|app-20190625081805-0142|15|4|START|125.66|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:20:10,126|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:20:10,126|Cell area: 1055533.7681000116 2019-06-25 08:20:22,107|MF|app-20190625081805-0142|15|4| END|137.64|F.Maximal disks found | 11.98| 26538|3 2019-06-25 08:20:22,107|MAXIMALS|app-20190625081805-0142|4|15|100.0|3|1350|18.257|26538 2019-06-25 08:20:23,138|FF|app-20190625081805-0142|15|4| END|138.67|1.Maximal disks found | 19.29| 26538|3 2019-06-25 08:20:23,138|FF|app-20190625081805-0142|15|4|START|138.67|2.Join done | 0.00| 0|3 2019-06-25 08:20:29,412|FF|app-20190625081805-0142|15|4| END|144.94|2.Join done | 6.27| 90376|3 2019-06-25 08:20:29,412|FF|app-20190625081805-0142|15|4|START|144.94|3.Flocks to report | 0.00| 0|3 2019-06-25 08:20:30,825|FF|app-20190625081805-0142|15|4| END|146.36|3.Flocks to report | 1.41| 75864|3 2019-06-25 08:20:30,825|FF|app-20190625081805-0142|15|4|START|146.36|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:20:30,907|FF|app-20190625081805-0142|15|4|START|146.44|4a.Making expansions | 0.00| 0|3 2019-06-25 08:20:31,832|FF|app-20190625081805-0142|15|4| END|147.36|4a.Making expansions | 0.93| 96507|3 2019-06-25 08:20:31,832|FF|app-20190625081805-0142|15|4|START|147.36|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:20:43,959|FF|app-20190625081805-0142|15|4| END|159.49|4b.Finding maximals | 12.13| 17301|3 2019-06-25 08:20:44,407|FF|app-20190625081805-0142|15|4| END|159.94|4.Flocks prunned by expansion | 13.58| 17301|3 2019-06-25 08:20:44,407|FF|app-20190625081805-0142|15|4|START|159.94|5.Flocks reported | 0.00| 0|3 2019-06-25 08:20:45,016|FF|app-20190625081805-0142|15|4| END|160.55|5.Flocks reported | 0.61| 17301|3 2019-06-25 08:20:45,016|FF|app-20190625081805-0142|15|4|START|160.55|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:20:46,852|FF|app-20190625081805-0142|15|4| END|162.38|6.Candidates indexed | 1.84| 33436|3 2019-06-25 08:20:48,195|Number of flocks: 34392 2019-06-25 08:20:49,152|PFLOCK|app-20190625081805-0142|4|15|100.0|3|3|156.84|34392 2019-06-25 08:20:50,107|FF|app-20190625081805-0142|15|4| END|165.64|Flock Finder run |158.75| 34392|3 2019-06-25 08:20:50,107|FF|app-20190625081805-0142|15|4|START|165.64|Session closed | 0.00| 0|3 2019-06-25 08:20:57,540|FF|app-20190625081805-0142|15|4| END|173.07|Session closed | 7.43| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:20:59,551|FF|app-00000000000000-0000|10|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 08:21:00,719|FF|app-20190625082100-0143|10|4| END| 1.15|Session start | 1.17| 0|-1 2019-06-25 08:21:00,719|FF|app-20190625082100-0143|10|4|START| 1.15|Data read | 0.00| 0|-1 2019-06-25 08:21:04,669|FF|app-20190625082100-0143|10|4| END| 5.10|Data read | 3.95|220752|-1 2019-06-25 08:21:04,669|FF|app-20190625082100-0143|10|4|START| 5.10|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:21:04,986|FF|app-20190625082100-0143|10|4| END| 5.42|KDBTree partitioner | 0.32| 544|-1 2019-06-25 08:21:04,987|FF|app-20190625082100-0143|10|4|START| 5.42|MF partitioner | 0.00| 0|-1 2019-06-25 08:21:05,007|FF|app-20190625082100-0143|10|4| END| 5.44|MF partitioner | 0.02| 900|-1 2019-06-25 08:21:05,007|FF|app-20190625082100-0143|10|4|START| 5.44|Pointset done | 0.00| 0|-1 2019-06-25 08:21:06,051|FF|app-20190625082100-0143|10|4| END| 6.48|Pointset done | 1.04| 4|-1 2019-06-25 08:21:06,051|FF|app-20190625082100-0143|10|4|START| 6.48|Flock Finder run | 0.00| 0|-1 2019-06-25 08:21:06,068|FF|app-20190625082100-0143|10|4|START| 6.50|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:21:06,070|MF|app-20190625082100-0143|10|4|START| 6.50|A.Points indexed | 0.00| 0|0 2019-06-25 08:21:06,237|MF|app-20190625082100-0143|10|4| END| 6.67|A.Points indexed | 0.17| 36186|0 2019-06-25 08:21:06,237|MF|app-20190625082100-0143|10|4|START| 6.67|B.Pairs found | 0.00| 0|0 2019-06-25 08:21:08,036|MF|app-20190625082100-0143|10|4| END| 8.47|B.Pairs found | 1.80| 67914|0 2019-06-25 08:21:08,036|MF|app-20190625082100-0143|10|4|START| 8.47|C.Centers found | 0.00| 0|0 2019-06-25 08:21:09,204|MF|app-20190625082100-0143|10|4| END| 9.64|C.Centers found | 1.17|135828|0 2019-06-25 08:21:09,204|MF|app-20190625082100-0143|10|4|START| 9.64|D.Disks found | 0.00| 0|0 2019-06-25 08:21:15,453|MF|app-20190625082100-0143|10|4| END| 15.89|D.Disks found | 6.25| 57332|0 2019-06-25 08:21:15,453|MF|app-20190625082100-0143|10|4|START| 15.89|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:21:17,706|MF|app-20190625082100-0143|10|4| END| 18.14|E.Disks partitioned | 2.25| 81114|0 2019-06-25 08:21:17,706|MF|app-20190625082100-0143|10|4|START| 18.14|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:21:17,708|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:21:17,708|Cell area: 1055533.7681000116 2019-06-25 08:21:28,790|MF|app-20190625082100-0143|10|4| END| 29.22|F.Maximal disks found | 11.08| 16742|0 2019-06-25 08:21:28,790|MAXIMALS|app-20190625082100-0143|4|10|100.0|3|900|22.72|16742 2019-06-25 08:21:29,789|FF|app-20190625082100-0143|10|4| END| 30.22|1.Maximal disks found | 23.72| 16742|0 2019-06-25 08:21:29,790|FF|app-20190625082100-0143|10|4|START| 30.22|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:21:29,790|MF|app-20190625082100-0143|10|4|START| 30.22|A.Points indexed | 0.00| 0|1 2019-06-25 08:21:29,887|MF|app-20190625082100-0143|10|4| END| 30.32|A.Points indexed | 0.10| 36490|1 2019-06-25 08:21:29,887|MF|app-20190625082100-0143|10|4|START| 30.32|B.Pairs found | 0.00| 0|1 2019-06-25 08:21:30,724|MF|app-20190625082100-0143|10|4| END| 31.16|B.Pairs found | 0.84| 68924|1 2019-06-25 08:21:30,724|MF|app-20190625082100-0143|10|4|START| 31.16|C.Centers found | 0.00| 0|1 2019-06-25 08:21:31,735|MF|app-20190625082100-0143|10|4| END| 32.17|C.Centers found | 1.01|137848|1 2019-06-25 08:21:31,736|MF|app-20190625082100-0143|10|4|START| 32.17|D.Disks found | 0.00| 0|1 2019-06-25 08:21:36,294|MF|app-20190625082100-0143|10|4| END| 36.73|D.Disks found | 4.56| 58232|1 2019-06-25 08:21:36,294|MF|app-20190625082100-0143|10|4|START| 36.73|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:21:38,483|MF|app-20190625082100-0143|10|4| END| 38.92|E.Disks partitioned | 2.19| 82341|1 2019-06-25 08:21:38,483|MF|app-20190625082100-0143|10|4|START| 38.92|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:21:38,484|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:21:38,484|Cell area: 1055533.7681000116 2019-06-25 08:21:48,614|MF|app-20190625082100-0143|10|4| END| 49.05|F.Maximal disks found | 10.13| 17096|1 2019-06-25 08:21:48,614|MAXIMALS|app-20190625082100-0143|4|10|100.0|3|900|18.824|17096 2019-06-25 08:21:49,585|FF|app-20190625082100-0143|10|4| END| 50.02|1.Maximal disks found | 19.80| 17096|1 2019-06-25 08:21:49,585|FF|app-20190625082100-0143|10|4|START| 50.02|2.Join done | 0.00| 0|1 2019-06-25 08:21:54,847|FF|app-20190625082100-0143|10|4| END| 55.28|2.Join done | 5.26| 34283|1 2019-06-25 08:21:54,847|FF|app-20190625082100-0143|10|4|START| 55.28|3.Flocks to report | 0.00| 0|1 2019-06-25 08:21:56,016|FF|app-20190625082100-0143|10|4| END| 56.45|3.Flocks to report | 1.17| 0|1 2019-06-25 08:21:56,016|FF|app-20190625082100-0143|10|4|START| 56.45|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:21:56,107|FF|app-20190625082100-0143|10|4| END| 56.54|4.Flocks prunned by expansion | 0.09| 0|1 2019-06-25 08:21:56,107|FF|app-20190625082100-0143|10|4|START| 56.54|5.Flocks reported | 0.00| 0|1 2019-06-25 08:21:56,111|FF|app-20190625082100-0143|10|4| END| 56.54|5.Flocks reported | 0.00| 0|1 2019-06-25 08:21:56,112|FF|app-20190625082100-0143|10|4|START| 56.54|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:21:58,413|FF|app-20190625082100-0143|10|4| END| 58.85|6.Candidates indexed | 2.30| 35275|1 2019-06-25 08:21:58,413|FF|app-20190625082100-0143|10|4|START| 58.85|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:21:58,414|MF|app-20190625082100-0143|10|4|START| 58.85|A.Points indexed | 0.00| 0|2 2019-06-25 08:21:58,511|MF|app-20190625082100-0143|10|4| END| 58.94|A.Points indexed | 0.10| 36788|2 2019-06-25 08:21:58,511|MF|app-20190625082100-0143|10|4|START| 58.94|B.Pairs found | 0.00| 0|2 2019-06-25 08:21:59,487|MF|app-20190625082100-0143|10|4| END| 59.92|B.Pairs found | 0.98| 69836|2 2019-06-25 08:21:59,487|MF|app-20190625082100-0143|10|4|START| 59.92|C.Centers found | 0.00| 0|2 2019-06-25 08:22:00,901|MF|app-20190625082100-0143|10|4| END| 61.33|C.Centers found | 1.41|139672|2 2019-06-25 08:22:00,901|MF|app-20190625082100-0143|10|4|START| 61.33|D.Disks found | 0.00| 0|2 2019-06-25 08:22:04,869|MF|app-20190625082100-0143|10|4| END| 65.30|D.Disks found | 3.97| 59098|2 2019-06-25 08:22:04,869|MF|app-20190625082100-0143|10|4|START| 65.30|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:22:06,668|MF|app-20190625082100-0143|10|4| END| 67.10|E.Disks partitioned | 1.80| 83724|2 2019-06-25 08:22:06,668|MF|app-20190625082100-0143|10|4|START| 67.10|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:22:06,669|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:22:06,669|Cell area: 1055533.7681000116 2019-06-25 08:22:16,782|MF|app-20190625082100-0143|10|4| END| 77.21|F.Maximal disks found | 10.11| 17376|2 2019-06-25 08:22:16,782|MAXIMALS|app-20190625082100-0143|4|10|100.0|3|900|18.369|17376 2019-06-25 08:22:17,576|FF|app-20190625082100-0143|10|4| END| 78.01|1.Maximal disks found | 19.16| 17376|2 2019-06-25 08:22:17,576|FF|app-20190625082100-0143|10|4|START| 78.01|2.Join done | 0.00| 0|2 2019-06-25 08:22:26,288|FF|app-20190625082100-0143|10|4| END| 86.72|2.Join done | 8.71| 65354|2 2019-06-25 08:22:26,288|FF|app-20190625082100-0143|10|4|START| 86.72|3.Flocks to report | 0.00| 0|2 2019-06-25 08:22:27,543|FF|app-20190625082100-0143|10|4| END| 87.98|3.Flocks to report | 1.26| 55757|2 2019-06-25 08:22:27,543|FF|app-20190625082100-0143|10|4|START| 87.98|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:22:27,611|FF|app-20190625082100-0143|10|4|START| 88.04|4a.Making expansions | 0.00| 0|2 2019-06-25 08:22:28,533|FF|app-20190625082100-0143|10|4| END| 88.97|4a.Making expansions | 0.92| 69208|2 2019-06-25 08:22:28,533|FF|app-20190625082100-0143|10|4|START| 88.97|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:22:42,783|FF|app-20190625082100-0143|10|4| END|103.22|4b.Finding maximals | 14.25| 11394|2 2019-06-25 08:22:43,095|FF|app-20190625082100-0143|10|4| END|103.53|4.Flocks prunned by expansion | 15.55| 11394|2 2019-06-25 08:22:43,096|FF|app-20190625082100-0143|10|4|START|103.53|5.Flocks reported | 0.00| 0|2 2019-06-25 08:22:43,551|FF|app-20190625082100-0143|10|4| END|103.98|5.Flocks reported | 0.46| 11394|2 2019-06-25 08:22:43,551|FF|app-20190625082100-0143|10|4|START|103.98|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:22:45,367|FF|app-20190625082100-0143|10|4| END|105.80|6.Candidates indexed | 1.82| 22156|2 2019-06-25 08:22:45,367|FF|app-20190625082100-0143|10|4|START|105.80|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:22:45,367|MF|app-20190625082100-0143|10|4|START|105.80|A.Points indexed | 0.00| 0|3 2019-06-25 08:22:45,450|MF|app-20190625082100-0143|10|4| END|105.88|A.Points indexed | 0.08| 37096|3 2019-06-25 08:22:45,450|MF|app-20190625082100-0143|10|4|START|105.88|B.Pairs found | 0.00| 0|3 2019-06-25 08:22:46,098|MF|app-20190625082100-0143|10|4| END|106.53|B.Pairs found | 0.65| 71030|3 2019-06-25 08:22:46,098|MF|app-20190625082100-0143|10|4|START|106.53|C.Centers found | 0.00| 0|3 2019-06-25 08:22:46,892|MF|app-20190625082100-0143|10|4| END|107.32|C.Centers found | 0.79|142060|3 2019-06-25 08:22:46,892|MF|app-20190625082100-0143|10|4|START|107.32|D.Disks found | 0.00| 0|3 2019-06-25 08:22:50,756|MF|app-20190625082100-0143|10|4| END|111.19|D.Disks found | 3.86| 60284|3 2019-06-25 08:22:50,756|MF|app-20190625082100-0143|10|4|START|111.19|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:22:52,355|MF|app-20190625082100-0143|10|4| END|112.79|E.Disks partitioned | 1.60| 85409|3 2019-06-25 08:22:52,355|MF|app-20190625082100-0143|10|4|START|112.79|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:22:52,356|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:22:52,356|Cell area: 1055533.7681000116 2019-06-25 08:23:04,497|MF|app-20190625082100-0143|10|4| END|124.93|F.Maximal disks found | 12.14| 17693|3 2019-06-25 08:23:04,497|MAXIMALS|app-20190625082100-0143|4|10|100.0|3|900|19.13|17693 2019-06-25 08:23:05,265|FF|app-20190625082100-0143|10|4| END|125.70|1.Maximal disks found | 19.90| 17693|3 2019-06-25 08:23:05,265|FF|app-20190625082100-0143|10|4|START|125.70|2.Join done | 0.00| 0|3 2019-06-25 08:23:11,757|FF|app-20190625082100-0143|10|4| END|132.19|2.Join done | 6.49| 60347|3 2019-06-25 08:23:11,757|FF|app-20190625082100-0143|10|4|START|132.19|3.Flocks to report | 0.00| 0|3 2019-06-25 08:23:12,935|FF|app-20190625082100-0143|10|4| END|133.37|3.Flocks to report | 1.18| 50611|3 2019-06-25 08:23:12,935|FF|app-20190625082100-0143|10|4|START|133.37|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:23:12,997|FF|app-20190625082100-0143|10|4|START|133.43|4a.Making expansions | 0.00| 0|3 2019-06-25 08:23:14,036|FF|app-20190625082100-0143|10|4| END|134.47|4a.Making expansions | 1.04| 64382|3 2019-06-25 08:23:14,036|FF|app-20190625082100-0143|10|4|START|134.47|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:23:24,257|FF|app-20190625082100-0143|10|4| END|144.69|4b.Finding maximals | 10.22| 11534|3 2019-06-25 08:23:24,602|FF|app-20190625082100-0143|10|4| END|145.03|4.Flocks prunned by expansion | 11.67| 11534|3 2019-06-25 08:23:24,602|FF|app-20190625082100-0143|10|4|START|145.03|5.Flocks reported | 0.00| 0|3 2019-06-25 08:23:25,096|FF|app-20190625082100-0143|10|4| END|145.53|5.Flocks reported | 0.49| 11534|3 2019-06-25 08:23:25,097|FF|app-20190625082100-0143|10|4|START|145.53|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:23:26,944|FF|app-20190625082100-0143|10|4| END|147.38|6.Candidates indexed | 1.85| 22352|3 2019-06-25 08:23:28,049|Number of flocks: 22928 2019-06-25 08:23:28,797|PFLOCK|app-20190625082100-0143|4|10|100.0|3|3|142.00|22928 2019-06-25 08:23:29,538|FF|app-20190625082100-0143|10|4| END|149.97|Flock Finder run |143.49| 22928|3 2019-06-25 08:23:29,538|FF|app-20190625082100-0143|10|4|START|149.97|Session closed | 0.00| 0|3 2019-06-25 08:23:36,251|FF|app-20190625082100-0143|10|4| END|156.68|Session closed | 6.71| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:23:38,209|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:23:39,302|FF|app-20190625082339-0144|5|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 08:23:39,302|FF|app-20190625082339-0144|5|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 08:23:43,100|FF|app-20190625082339-0144|5|4| END| 4.87|Data read | 3.80|110376|-1 2019-06-25 08:23:43,100|FF|app-20190625082339-0144|5|4|START| 4.88|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:23:43,229|FF|app-20190625082339-0144|5|4| END| 5.00|KDBTree partitioner | 0.13| 272|-1 2019-06-25 08:23:43,229|FF|app-20190625082339-0144|5|4|START| 5.00|MF partitioner | 0.00| 0|-1 2019-06-25 08:23:43,245|FF|app-20190625082339-0144|5|4| END| 5.02|MF partitioner | 0.02| 450|-1 2019-06-25 08:23:43,245|FF|app-20190625082339-0144|5|4|START| 5.02|Pointset done | 0.00| 0|-1 2019-06-25 08:23:44,036|FF|app-20190625082339-0144|5|4| END| 5.81|Pointset done | 0.79| 4|-1 2019-06-25 08:23:44,037|FF|app-20190625082339-0144|5|4|START| 5.81|Flock Finder run | 0.00| 0|-1 2019-06-25 08:23:44,201|FF|app-20190625082339-0144|5|4|START| 5.98|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:23:44,204|MF|app-20190625082339-0144|5|4|START| 5.98|A.Points indexed | 0.00| 0|0 2019-06-25 08:23:44,368|MF|app-20190625082339-0144|5|4| END| 6.14|A.Points indexed | 0.16| 18093|0 2019-06-25 08:23:44,369|MF|app-20190625082339-0144|5|4|START| 6.14|B.Pairs found | 0.00| 0|0 2019-06-25 08:23:45,566|MF|app-20190625082339-0144|5|4| END| 7.34|B.Pairs found | 1.20| 33957|0 2019-06-25 08:23:45,566|MF|app-20190625082339-0144|5|4|START| 7.34|C.Centers found | 0.00| 0|0 2019-06-25 08:23:46,341|MF|app-20190625082339-0144|5|4| END| 8.12|C.Centers found | 0.78| 67914|0 2019-06-25 08:23:46,341|MF|app-20190625082339-0144|5|4|START| 8.12|D.Disks found | 0.00| 0|0 2019-06-25 08:23:49,523|MF|app-20190625082339-0144|5|4| END| 11.30|D.Disks found | 3.18| 28666|0 2019-06-25 08:23:49,523|MF|app-20190625082339-0144|5|4|START| 11.30|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:23:50,774|MF|app-20190625082339-0144|5|4| END| 12.55|E.Disks partitioned | 1.25| 40550|0 2019-06-25 08:23:50,774|MF|app-20190625082339-0144|5|4|START| 12.55|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:23:50,776|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:23:50,776|Cell area: 1055533.7681000116 2019-06-25 08:24:00,849|MF|app-20190625082339-0144|5|4| END| 22.62|F.Maximal disks found | 10.08| 8371|0 2019-06-25 08:24:00,850|MAXIMALS|app-20190625082339-0144|4|5|100.0|3|450|16.646|8371 2019-06-25 08:24:01,419|FF|app-20190625082339-0144|5|4| END| 23.19|1.Maximal disks found | 17.22| 8371|0 2019-06-25 08:24:01,419|FF|app-20190625082339-0144|5|4|START| 23.19|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:24:01,419|MF|app-20190625082339-0144|5|4|START| 23.19|A.Points indexed | 0.00| 0|1 2019-06-25 08:24:01,506|MF|app-20190625082339-0144|5|4| END| 23.28|A.Points indexed | 0.09| 18245|1 2019-06-25 08:24:01,506|MF|app-20190625082339-0144|5|4|START| 23.28|B.Pairs found | 0.00| 0|1 2019-06-25 08:24:02,012|MF|app-20190625082339-0144|5|4| END| 23.79|B.Pairs found | 0.51| 34462|1 2019-06-25 08:24:02,012|MF|app-20190625082339-0144|5|4|START| 23.79|C.Centers found | 0.00| 0|1 2019-06-25 08:24:02,422|MF|app-20190625082339-0144|5|4| END| 24.20|C.Centers found | 0.41| 68924|1 2019-06-25 08:24:02,422|MF|app-20190625082339-0144|5|4|START| 24.20|D.Disks found | 0.00| 0|1 2019-06-25 08:24:04,399|MF|app-20190625082339-0144|5|4| END| 26.17|D.Disks found | 1.98| 29116|1 2019-06-25 08:24:04,399|MF|app-20190625082339-0144|5|4|START| 26.17|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:24:05,195|MF|app-20190625082339-0144|5|4| END| 26.97|E.Disks partitioned | 0.80| 41162|1 2019-06-25 08:24:05,195|MF|app-20190625082339-0144|5|4|START| 26.97|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:24:05,195|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:24:05,195|Cell area: 1055533.7681000116 2019-06-25 08:24:14,296|MF|app-20190625082339-0144|5|4| END| 36.07|F.Maximal disks found | 9.10| 8547|1 2019-06-25 08:24:14,296|MAXIMALS|app-20190625082339-0144|4|5|100.0|3|450|12.877|8547 2019-06-25 08:24:14,755|FF|app-20190625082339-0144|5|4| END| 36.53|1.Maximal disks found | 13.34| 8547|1 2019-06-25 08:24:14,755|FF|app-20190625082339-0144|5|4|START| 36.53|2.Join done | 0.00| 0|1 2019-06-25 08:24:16,969|FF|app-20190625082339-0144|5|4| END| 38.74|2.Join done | 2.21| 17137|1 2019-06-25 08:24:16,969|FF|app-20190625082339-0144|5|4|START| 38.74|3.Flocks to report | 0.00| 0|1 2019-06-25 08:24:17,489|FF|app-20190625082339-0144|5|4| END| 39.26|3.Flocks to report | 0.52| 0|1 2019-06-25 08:24:17,489|FF|app-20190625082339-0144|5|4|START| 39.26|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:24:17,536|FF|app-20190625082339-0144|5|4| END| 39.31|4.Flocks prunned by expansion | 0.05| 0|1 2019-06-25 08:24:17,536|FF|app-20190625082339-0144|5|4|START| 39.31|5.Flocks reported | 0.00| 0|1 2019-06-25 08:24:17,540|FF|app-20190625082339-0144|5|4| END| 39.32|5.Flocks reported | 0.00| 0|1 2019-06-25 08:24:17,541|FF|app-20190625082339-0144|5|4|START| 39.32|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:24:19,097|FF|app-20190625082339-0144|5|4| END| 40.87|6.Candidates indexed | 1.56| 17633|1 2019-06-25 08:24:19,097|FF|app-20190625082339-0144|5|4|START| 40.87|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:24:19,097|MF|app-20190625082339-0144|5|4|START| 40.87|A.Points indexed | 0.00| 0|2 2019-06-25 08:24:19,164|MF|app-20190625082339-0144|5|4| END| 40.94|A.Points indexed | 0.07| 18394|2 2019-06-25 08:24:19,164|MF|app-20190625082339-0144|5|4|START| 40.94|B.Pairs found | 0.00| 0|2 2019-06-25 08:24:19,601|MF|app-20190625082339-0144|5|4| END| 41.38|B.Pairs found | 0.44| 34918|2 2019-06-25 08:24:19,601|MF|app-20190625082339-0144|5|4|START| 41.38|C.Centers found | 0.00| 0|2 2019-06-25 08:24:20,068|MF|app-20190625082339-0144|5|4| END| 41.84|C.Centers found | 0.47| 69836|2 2019-06-25 08:24:20,068|MF|app-20190625082339-0144|5|4|START| 41.84|D.Disks found | 0.00| 0|2 2019-06-25 08:24:22,167|MF|app-20190625082339-0144|5|4| END| 43.94|D.Disks found | 2.10| 29549|2 2019-06-25 08:24:22,167|MF|app-20190625082339-0144|5|4|START| 43.94|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:24:22,814|MF|app-20190625082339-0144|5|4| END| 44.59|E.Disks partitioned | 0.65| 41840|2 2019-06-25 08:24:22,814|MF|app-20190625082339-0144|5|4|START| 44.59|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:24:22,814|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:24:22,814|Cell area: 1055533.7681000116 2019-06-25 08:24:32,154|MF|app-20190625082339-0144|5|4| END| 53.93|F.Maximal disks found | 9.34| 8685|2 2019-06-25 08:24:32,154|MAXIMALS|app-20190625082339-0144|4|5|100.0|3|450|13.057|8685 2019-06-25 08:24:32,509|FF|app-20190625082339-0144|5|4| END| 54.28|1.Maximal disks found | 13.41| 8685|2 2019-06-25 08:24:32,509|FF|app-20190625082339-0144|5|4|START| 54.28|2.Join done | 0.00| 0|2 2019-06-25 08:24:40,415|FF|app-20190625082339-0144|5|4| END| 62.19|2.Join done | 7.91| 32672|2 2019-06-25 08:24:40,415|FF|app-20190625082339-0144|5|4|START| 62.19|3.Flocks to report | 0.00| 0|2 2019-06-25 08:24:41,347|FF|app-20190625082339-0144|5|4| END| 63.12|3.Flocks to report | 0.93| 27873|2 2019-06-25 08:24:41,347|FF|app-20190625082339-0144|5|4|START| 63.12|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:24:41,392|FF|app-20190625082339-0144|5|4|START| 63.17|4a.Making expansions | 0.00| 0|2 2019-06-25 08:24:42,101|FF|app-20190625082339-0144|5|4| END| 63.88|4a.Making expansions | 0.71| 34686|2 2019-06-25 08:24:42,101|FF|app-20190625082339-0144|5|4|START| 63.88|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:24:54,934|FF|app-20190625082339-0144|5|4| END| 76.71|4b.Finding maximals | 12.83| 5697|2 2019-06-25 08:24:55,116|FF|app-20190625082339-0144|5|4| END| 76.89|4.Flocks prunned by expansion | 13.77| 5697|2 2019-06-25 08:24:55,116|FF|app-20190625082339-0144|5|4|START| 76.89|5.Flocks reported | 0.00| 0|2 2019-06-25 08:24:55,412|FF|app-20190625082339-0144|5|4| END| 77.19|5.Flocks reported | 0.30| 5697|2 2019-06-25 08:24:55,412|FF|app-20190625082339-0144|5|4|START| 77.19|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:24:57,245|FF|app-20190625082339-0144|5|4| END| 79.02|6.Candidates indexed | 1.83| 11079|2 2019-06-25 08:24:57,245|FF|app-20190625082339-0144|5|4|START| 79.02|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:24:57,245|MF|app-20190625082339-0144|5|4|START| 79.02|A.Points indexed | 0.00| 0|3 2019-06-25 08:24:57,305|MF|app-20190625082339-0144|5|4| END| 79.08|A.Points indexed | 0.06| 18548|3 2019-06-25 08:24:57,305|MF|app-20190625082339-0144|5|4|START| 79.08|B.Pairs found | 0.00| 0|3 2019-06-25 08:24:57,819|MF|app-20190625082339-0144|5|4| END| 79.59|B.Pairs found | 0.51| 35515|3 2019-06-25 08:24:57,820|MF|app-20190625082339-0144|5|4|START| 79.60|C.Centers found | 0.00| 0|3 2019-06-25 08:24:58,457|MF|app-20190625082339-0144|5|4| END| 80.23|C.Centers found | 0.64| 71030|3 2019-06-25 08:24:58,457|MF|app-20190625082339-0144|5|4|START| 80.23|D.Disks found | 0.00| 0|3 2019-06-25 08:25:01,434|MF|app-20190625082339-0144|5|4| END| 83.21|D.Disks found | 2.98| 30142|3 2019-06-25 08:25:01,434|MF|app-20190625082339-0144|5|4|START| 83.21|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:25:02,484|MF|app-20190625082339-0144|5|4| END| 84.26|E.Disks partitioned | 1.05| 42665|3 2019-06-25 08:25:02,484|MF|app-20190625082339-0144|5|4|START| 84.26|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:25:02,485|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:25:02,485|Cell area: 1055533.7681000116 2019-06-25 08:25:14,114|MF|app-20190625082339-0144|5|4| END| 95.89|F.Maximal disks found | 11.63| 8846|3 2019-06-25 08:25:14,114|MAXIMALS|app-20190625082339-0144|4|5|100.0|3|450|16.869|8846 2019-06-25 08:25:14,573|FF|app-20190625082339-0144|5|4| END| 96.35|1.Maximal disks found | 17.33| 8846|3 2019-06-25 08:25:14,573|FF|app-20190625082339-0144|5|4|START| 96.35|2.Join done | 0.00| 0|3 2019-06-25 08:25:18,926|FF|app-20190625082339-0144|5|4| END|100.70|2.Join done | 4.35| 30192|3 2019-06-25 08:25:18,926|FF|app-20190625082339-0144|5|4|START|100.70|3.Flocks to report | 0.00| 0|3 2019-06-25 08:25:19,866|FF|app-20190625082339-0144|5|4| END|101.64|3.Flocks to report | 0.94| 25330|3 2019-06-25 08:25:19,866|FF|app-20190625082339-0144|5|4|START|101.64|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:25:19,906|FF|app-20190625082339-0144|5|4|START|101.68|4a.Making expansions | 0.00| 0|3 2019-06-25 08:25:21,116|FF|app-20190625082339-0144|5|4| END|102.89|4a.Making expansions | 1.21| 32264|3 2019-06-25 08:25:21,116|FF|app-20190625082339-0144|5|4|START|102.89|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:25:32,078|FF|app-20190625082339-0144|5|4| END|113.85|4b.Finding maximals | 10.96| 5767|3 2019-06-25 08:25:32,252|FF|app-20190625082339-0144|5|4| END|114.03|4.Flocks prunned by expansion | 12.39| 5767|3 2019-06-25 08:25:32,252|FF|app-20190625082339-0144|5|4|START|114.03|5.Flocks reported | 0.00| 0|3 2019-06-25 08:25:32,544|FF|app-20190625082339-0144|5|4| END|114.32|5.Flocks reported | 0.29| 5767|3 2019-06-25 08:25:32,544|FF|app-20190625082339-0144|5|4|START|114.32|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:25:34,325|FF|app-20190625082339-0144|5|4| END|116.10|6.Candidates indexed | 1.78| 11171|3 2019-06-25 08:25:34,863|Number of flocks: 11464 2019-06-25 08:25:35,205|PFLOCK|app-20190625082339-0144|4|5|100.0|3|3|110.83|11464 2019-06-25 08:25:35,566|FF|app-20190625082339-0144|5|4| END|117.34|Flock Finder run |111.53| 11464|3 2019-06-25 08:25:35,566|FF|app-20190625082339-0144|5|4|START|117.34|Session closed | 0.00| 0|3 2019-06-25 08:25:42,396|FF|app-20190625082339-0144|5|4| END|124.17|Session closed | 6.83| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:25:44,384|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:25:45,483|FF|app-20190625082545-0145|15|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 08:25:45,483|FF|app-20190625082545-0145|15|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 08:25:49,759|FF|app-20190625082545-0145|15|4| END| 5.36|Data read | 4.28|331128|-1 2019-06-25 08:25:49,759|FF|app-20190625082545-0145|15|4|START| 5.36|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:25:49,994|FF|app-20190625082545-0145|15|4| END| 5.59|KDBTree partitioner | 0.24| 816|-1 2019-06-25 08:25:49,995|FF|app-20190625082545-0145|15|4|START| 5.59|MF partitioner | 0.00| 0|-1 2019-06-25 08:25:50,015|FF|app-20190625082545-0145|15|4| END| 5.61|MF partitioner | 0.02| 1350|-1 2019-06-25 08:25:50,016|FF|app-20190625082545-0145|15|4|START| 5.61|Pointset done | 0.00| 0|-1 2019-06-25 08:25:51,044|FF|app-20190625082545-0145|15|4| END| 6.64|Pointset done | 1.03| 4|-1 2019-06-25 08:25:51,044|FF|app-20190625082545-0145|15|4|START| 6.64|Flock Finder run | 0.00| 0|-1 2019-06-25 08:25:51,060|FF|app-20190625082545-0145|15|4|START| 6.66|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:25:51,062|MF|app-20190625082545-0145|15|4|START| 6.66|A.Points indexed | 0.00| 0|0 2019-06-25 08:25:51,279|MF|app-20190625082545-0145|15|4| END| 6.88|A.Points indexed | 0.22| 54279|0 2019-06-25 08:25:51,279|MF|app-20190625082545-0145|15|4|START| 6.88|B.Pairs found | 0.00| 0|0 2019-06-25 08:25:52,991|MF|app-20190625082545-0145|15|4| END| 8.59|B.Pairs found | 1.71|118212|0 2019-06-25 08:25:52,991|MF|app-20190625082545-0145|15|4|START| 8.59|C.Centers found | 0.00| 0|0 2019-06-25 08:25:55,056|MF|app-20190625082545-0145|15|4| END| 10.66|C.Centers found | 2.07|236424|0 2019-06-25 08:25:55,056|MF|app-20190625082545-0145|15|4|START| 10.66|D.Disks found | 0.00| 0|0 2019-06-25 08:26:00,579|MF|app-20190625082545-0145|15|4| END| 16.18|D.Disks found | 5.52|105687|0 2019-06-25 08:26:00,579|MF|app-20190625082545-0145|15|4|START| 16.18|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:26:01,920|MF|app-20190625082545-0145|15|4| END| 17.52|E.Disks partitioned | 1.34|154597|0 2019-06-25 08:26:01,920|MF|app-20190625082545-0145|15|4|START| 17.52|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:26:01,923|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:26:01,923|Cell area: 1055533.7681000116 2019-06-25 08:26:27,338|MF|app-20190625082545-0145|15|4| END| 42.94|F.Maximal disks found | 25.42| 30002|0 2019-06-25 08:26:27,338|MAXIMALS|app-20190625082545-0145|4|15|110.0|3|1350|36.276|30002 2019-06-25 08:26:28,437|FF|app-20190625082545-0145|15|4| END| 44.04|1.Maximal disks found | 37.38| 30002|0 2019-06-25 08:26:28,437|FF|app-20190625082545-0145|15|4|START| 44.04|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:26:28,437|MF|app-20190625082545-0145|15|4|START| 44.04|A.Points indexed | 0.00| 0|1 2019-06-25 08:26:28,556|MF|app-20190625082545-0145|15|4| END| 44.16|A.Points indexed | 0.12| 54735|1 2019-06-25 08:26:28,557|MF|app-20190625082545-0145|15|4|START| 44.16|B.Pairs found | 0.00| 0|1 2019-06-25 08:26:29,700|MF|app-20190625082545-0145|15|4| END| 45.30|B.Pairs found | 1.14|119997|1 2019-06-25 08:26:29,700|MF|app-20190625082545-0145|15|4|START| 45.30|C.Centers found | 0.00| 0|1 2019-06-25 08:26:30,939|MF|app-20190625082545-0145|15|4| END| 46.54|C.Centers found | 1.24|239994|1 2019-06-25 08:26:30,939|MF|app-20190625082545-0145|15|4|START| 46.54|D.Disks found | 0.00| 0|1 2019-06-25 08:26:38,187|MF|app-20190625082545-0145|15|4| END| 53.79|D.Disks found | 7.25|107547|1 2019-06-25 08:26:38,187|MF|app-20190625082545-0145|15|4|START| 53.79|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:26:40,183|MF|app-20190625082545-0145|15|4| END| 55.78|E.Disks partitioned | 2.00|157199|1 2019-06-25 08:26:40,183|MF|app-20190625082545-0145|15|4|START| 55.78|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:26:40,184|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:26:40,184|Cell area: 1055533.7681000116 2019-06-25 08:27:07,442|MF|app-20190625082545-0145|15|4| END| 83.04|F.Maximal disks found | 27.26| 30329|1 2019-06-25 08:27:07,443|MAXIMALS|app-20190625082545-0145|4|15|110.0|3|1350|39.006|30329 2019-06-25 08:27:08,498|FF|app-20190625082545-0145|15|4| END| 84.10|1.Maximal disks found | 40.06| 30329|1 2019-06-25 08:27:08,499|FF|app-20190625082545-0145|15|4|START| 84.10|2.Join done | 0.00| 0|1 2019-06-25 08:27:11,844|FF|app-20190625082545-0145|15|4| END| 87.44|2.Join done | 3.34| 65661|1 2019-06-25 08:27:11,844|FF|app-20190625082545-0145|15|4|START| 87.44|3.Flocks to report | 0.00| 0|1 2019-06-25 08:27:12,446|FF|app-20190625082545-0145|15|4| END| 88.05|3.Flocks to report | 0.60| 0|1 2019-06-25 08:27:12,446|FF|app-20190625082545-0145|15|4|START| 88.05|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:27:12,516|FF|app-20190625082545-0145|15|4| END| 88.12|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 08:27:12,516|FF|app-20190625082545-0145|15|4|START| 88.12|5.Flocks reported | 0.00| 0|1 2019-06-25 08:27:12,522|FF|app-20190625082545-0145|15|4| END| 88.12|5.Flocks reported | 0.01| 0|1 2019-06-25 08:27:12,522|FF|app-20190625082545-0145|15|4|START| 88.12|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:27:14,369|FF|app-20190625082545-0145|15|4| END| 89.97|6.Candidates indexed | 1.85| 67476|1 2019-06-25 08:27:14,369|FF|app-20190625082545-0145|15|4|START| 89.97|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:27:14,369|MF|app-20190625082545-0145|15|4|START| 89.97|A.Points indexed | 0.00| 0|2 2019-06-25 08:27:14,490|MF|app-20190625082545-0145|15|4| END| 90.09|A.Points indexed | 0.12| 55182|2 2019-06-25 08:27:14,490|MF|app-20190625082545-0145|15|4|START| 90.09|B.Pairs found | 0.00| 0|2 2019-06-25 08:27:15,318|MF|app-20190625082545-0145|15|4| END| 90.92|B.Pairs found | 0.83|121698|2 2019-06-25 08:27:15,318|MF|app-20190625082545-0145|15|4|START| 90.92|C.Centers found | 0.00| 0|2 2019-06-25 08:27:16,800|MF|app-20190625082545-0145|15|4| END| 92.40|C.Centers found | 1.48|243396|2 2019-06-25 08:27:16,801|MF|app-20190625082545-0145|15|4|START| 92.40|D.Disks found | 0.00| 0|2 2019-06-25 08:27:20,968|MF|app-20190625082545-0145|15|4| END| 96.57|D.Disks found | 4.17|109059|2 2019-06-25 08:27:20,968|MF|app-20190625082545-0145|15|4|START| 96.57|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:27:22,022|MF|app-20190625082545-0145|15|4| END| 97.62|E.Disks partitioned | 1.05|159559|2 2019-06-25 08:27:22,022|MF|app-20190625082545-0145|15|4|START| 97.62|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:27:22,023|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:27:22,023|Cell area: 1055533.7681000116 2019-06-25 08:27:48,830|MF|app-20190625082545-0145|15|4| END|124.43|F.Maximal disks found | 26.81| 31016|2 2019-06-25 08:27:48,830|MAXIMALS|app-20190625082545-0145|4|15|110.0|3|1350|34.461|31016 2019-06-25 08:27:49,861|FF|app-20190625082545-0145|15|4| END|125.46|1.Maximal disks found | 35.49| 31016|2 2019-06-25 08:27:49,861|FF|app-20190625082545-0145|15|4|START|125.46|2.Join done | 0.00| 0|2 2019-06-25 08:28:07,280|FF|app-20190625082545-0145|15|4| END|142.88|2.Join done | 17.42|134462|2 2019-06-25 08:28:07,280|FF|app-20190625082545-0145|15|4|START|142.88|3.Flocks to report | 0.00| 0|2 2019-06-25 08:28:10,090|FF|app-20190625082545-0145|15|4| END|145.69|3.Flocks to report | 2.81|114833|2 2019-06-25 08:28:10,090|FF|app-20190625082545-0145|15|4|START|145.69|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:28:10,173|FF|app-20190625082545-0145|15|4|START|145.77|4a.Making expansions | 0.00| 0|2 2019-06-25 08:28:11,136|FF|app-20190625082545-0145|15|4| END|146.73|4a.Making expansions | 0.96|143119|2 2019-06-25 08:28:11,136|FF|app-20190625082545-0145|15|4|START|146.74|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:29:04,617|FF|app-20190625082545-0145|15|4| END|200.22|4b.Finding maximals | 53.48| 19803|2 2019-06-25 08:29:05,063|FF|app-20190625082545-0145|15|4| END|200.66|4.Flocks prunned by expansion | 54.97| 19803|2 2019-06-25 08:29:05,063|FF|app-20190625082545-0145|15|4|START|200.66|5.Flocks reported | 0.00| 0|2 2019-06-25 08:29:05,676|FF|app-20190625082545-0145|15|4| END|201.28|5.Flocks reported | 0.61| 19803|2 2019-06-25 08:29:05,676|FF|app-20190625082545-0145|15|4|START|201.28|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:29:07,749|FF|app-20190625082545-0145|15|4| END|203.35|6.Candidates indexed | 2.07| 41368|2 2019-06-25 08:29:07,749|FF|app-20190625082545-0145|15|4|START|203.35|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:29:07,749|MF|app-20190625082545-0145|15|4|START|203.35|A.Points indexed | 0.00| 0|3 2019-06-25 08:29:07,862|MF|app-20190625082545-0145|15|4| END|203.46|A.Points indexed | 0.11| 55644|3 2019-06-25 08:29:07,862|MF|app-20190625082545-0145|15|4|START|203.46|B.Pairs found | 0.00| 0|3 2019-06-25 08:29:08,988|MF|app-20190625082545-0145|15|4| END|204.59|B.Pairs found | 1.13|123771|3 2019-06-25 08:29:08,988|MF|app-20190625082545-0145|15|4|START|204.59|C.Centers found | 0.00| 0|3 2019-06-25 08:29:10,047|MF|app-20190625082545-0145|15|4| END|205.65|C.Centers found | 1.06|247542|3 2019-06-25 08:29:10,048|MF|app-20190625082545-0145|15|4|START|205.65|D.Disks found | 0.00| 0|3 2019-06-25 08:29:17,851|MF|app-20190625082545-0145|15|4| END|213.45|D.Disks found | 7.80|111261|3 2019-06-25 08:29:17,851|MF|app-20190625082545-0145|15|4|START|213.45|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:29:19,535|MF|app-20190625082545-0145|15|4| END|215.13|E.Disks partitioned | 1.68|162756|3 2019-06-25 08:29:19,535|MF|app-20190625082545-0145|15|4|START|215.13|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:29:19,536|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:29:19,536|Cell area: 1055533.7681000116 2019-06-25 08:29:54,757|MF|app-20190625082545-0145|15|4| END|250.36|F.Maximal disks found | 35.22| 31512|3 2019-06-25 08:29:54,757|MAXIMALS|app-20190625082545-0145|4|15|110.0|3|1350|47.008|31512 2019-06-25 08:29:55,795|FF|app-20190625082545-0145|15|4| END|251.39|1.Maximal disks found | 48.05| 31512|3 2019-06-25 08:29:55,795|FF|app-20190625082545-0145|15|4|START|251.39|2.Join done | 0.00| 0|3 2019-06-25 08:30:06,869|FF|app-20190625082545-0145|15|4| END|262.47|2.Join done | 11.07|134798|3 2019-06-25 08:30:06,869|FF|app-20190625082545-0145|15|4|START|262.47|3.Flocks to report | 0.00| 0|3 2019-06-25 08:30:09,411|FF|app-20190625082545-0145|15|4| END|265.01|3.Flocks to report | 2.54|115131|3 2019-06-25 08:30:09,411|FF|app-20190625082545-0145|15|4|START|265.01|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:30:09,499|FF|app-20190625082545-0145|15|4|START|265.10|4a.Making expansions | 0.00| 0|3 2019-06-25 08:30:10,494|FF|app-20190625082545-0145|15|4| END|266.09|4a.Making expansions | 1.00|143315|3 2019-06-25 08:30:10,494|FF|app-20190625082545-0145|15|4|START|266.09|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:31:13,688|FF|app-20190625082545-0145|15|4| END|329.29|4b.Finding maximals | 63.19| 20007|3 2019-06-25 08:31:14,172|FF|app-20190625082545-0145|15|4| END|329.77|4.Flocks prunned by expansion | 64.76| 20007|3 2019-06-25 08:31:14,172|FF|app-20190625082545-0145|15|4|START|329.77|5.Flocks reported | 0.00| 0|3 2019-06-25 08:31:14,794|FF|app-20190625082545-0145|15|4| END|330.39|5.Flocks reported | 0.62| 20007|3 2019-06-25 08:31:14,794|FF|app-20190625082545-0145|15|4|START|330.39|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:31:17,050|FF|app-20190625082545-0145|15|4| END|332.65|6.Candidates indexed | 2.26| 41642|3 2019-06-25 08:31:18,424|Number of flocks: 39810 2019-06-25 08:31:19,385|PFLOCK|app-20190625082545-0145|4|15|110.0|3|3|327.38|39810 2019-06-25 08:31:20,324|FF|app-20190625082545-0145|15|4| END|335.92|Flock Finder run |329.28| 39810|3 2019-06-25 08:31:20,324|FF|app-20190625082545-0145|15|4|START|335.92|Session closed | 0.00| 0|3 2019-06-25 08:31:27,679|FF|app-20190625082545-0145|15|4| END|343.28|Session closed | 7.36| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:31:29,651|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:31:30,778|FF|app-20190625083130-0146|10|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 08:31:30,778|FF|app-20190625083130-0146|10|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 08:31:34,712|FF|app-20190625083130-0146|10|4| END| 5.04|Data read | 3.93|220752|-1 2019-06-25 08:31:34,713|FF|app-20190625083130-0146|10|4|START| 5.04|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:31:34,880|FF|app-20190625083130-0146|10|4| END| 5.21|KDBTree partitioner | 0.17| 544|-1 2019-06-25 08:31:34,881|FF|app-20190625083130-0146|10|4|START| 5.21|MF partitioner | 0.00| 0|-1 2019-06-25 08:31:34,939|FF|app-20190625083130-0146|10|4| END| 5.27|MF partitioner | 0.06| 900|-1 2019-06-25 08:31:34,939|FF|app-20190625083130-0146|10|4|START| 5.27|Pointset done | 0.00| 0|-1 2019-06-25 08:31:36,128|FF|app-20190625083130-0146|10|4| END| 6.46|Pointset done | 1.19| 4|-1 2019-06-25 08:31:36,128|FF|app-20190625083130-0146|10|4|START| 6.46|Flock Finder run | 0.00| 0|-1 2019-06-25 08:31:36,145|FF|app-20190625083130-0146|10|4|START| 6.48|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:31:36,147|MF|app-20190625083130-0146|10|4|START| 6.48|A.Points indexed | 0.00| 0|0 2019-06-25 08:31:36,325|MF|app-20190625083130-0146|10|4| END| 6.66|A.Points indexed | 0.18| 36186|0 2019-06-25 08:31:36,325|MF|app-20190625083130-0146|10|4|START| 6.66|B.Pairs found | 0.00| 0|0 2019-06-25 08:31:38,608|MF|app-20190625083130-0146|10|4| END| 8.94|B.Pairs found | 2.28| 78808|0 2019-06-25 08:31:38,608|MF|app-20190625083130-0146|10|4|START| 8.94|C.Centers found | 0.00| 0|0 2019-06-25 08:31:40,401|MF|app-20190625083130-0146|10|4| END| 10.73|C.Centers found | 1.79|157616|0 2019-06-25 08:31:40,402|MF|app-20190625083130-0146|10|4|START| 10.73|D.Disks found | 0.00| 0|0 2019-06-25 08:31:48,871|MF|app-20190625083130-0146|10|4| END| 19.20|D.Disks found | 8.47| 70458|0 2019-06-25 08:31:48,871|MF|app-20190625083130-0146|10|4|START| 19.20|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:31:53,493|MF|app-20190625083130-0146|10|4| END| 23.83|E.Disks partitioned | 4.62|103004|0 2019-06-25 08:31:53,493|MF|app-20190625083130-0146|10|4|START| 23.83|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:31:53,495|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:31:53,495|Cell area: 1055533.7681000116 2019-06-25 08:32:22,666|MF|app-20190625083130-0146|10|4| END| 53.00|F.Maximal disks found | 29.17| 20001|0 2019-06-25 08:32:22,667|MAXIMALS|app-20190625083130-0146|4|10|110.0|3|900|46.52|20001 2019-06-25 08:32:24,282|FF|app-20190625083130-0146|10|4| END| 54.61|1.Maximal disks found | 48.14| 20001|0 2019-06-25 08:32:24,282|FF|app-20190625083130-0146|10|4|START| 54.61|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:32:24,282|MF|app-20190625083130-0146|10|4|START| 54.61|A.Points indexed | 0.00| 0|1 2019-06-25 08:32:24,383|MF|app-20190625083130-0146|10|4| END| 54.72|A.Points indexed | 0.10| 36490|1 2019-06-25 08:32:24,383|MF|app-20190625083130-0146|10|4|START| 54.72|B.Pairs found | 0.00| 0|1 2019-06-25 08:32:25,433|MF|app-20190625083130-0146|10|4| END| 55.77|B.Pairs found | 1.05| 79998|1 2019-06-25 08:32:25,434|MF|app-20190625083130-0146|10|4|START| 55.77|C.Centers found | 0.00| 0|1 2019-06-25 08:32:26,772|MF|app-20190625083130-0146|10|4| END| 57.10|C.Centers found | 1.34|159996|1 2019-06-25 08:32:26,772|MF|app-20190625083130-0146|10|4|START| 57.10|D.Disks found | 0.00| 0|1 2019-06-25 08:32:32,570|MF|app-20190625083130-0146|10|4| END| 62.90|D.Disks found | 5.80| 71698|1 2019-06-25 08:32:32,570|MF|app-20190625083130-0146|10|4|START| 62.90|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:32:35,118|MF|app-20190625083130-0146|10|4| END| 65.45|E.Disks partitioned | 2.55|104758|1 2019-06-25 08:32:35,118|MF|app-20190625083130-0146|10|4|START| 65.45|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:32:35,120|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:32:35,120|Cell area: 1055533.7681000116 2019-06-25 08:33:02,420|MF|app-20190625083130-0146|10|4| END| 92.75|F.Maximal disks found | 27.30| 20222|1 2019-06-25 08:33:02,420|MAXIMALS|app-20190625083130-0146|4|10|110.0|3|900|38.138|20222 2019-06-25 08:33:03,369|FF|app-20190625083130-0146|10|4| END| 93.70|1.Maximal disks found | 39.09| 20222|1 2019-06-25 08:33:03,369|FF|app-20190625083130-0146|10|4|START| 93.70|2.Join done | 0.00| 0|1 2019-06-25 08:33:09,742|FF|app-20190625083130-0146|10|4| END|100.07|2.Join done | 6.37| 43837|1 2019-06-25 08:33:09,742|FF|app-20190625083130-0146|10|4|START|100.07|3.Flocks to report | 0.00| 0|1 2019-06-25 08:33:10,985|FF|app-20190625083130-0146|10|4| END|101.32|3.Flocks to report | 1.24| 0|1 2019-06-25 08:33:10,985|FF|app-20190625083130-0146|10|4|START|101.32|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:33:11,096|FF|app-20190625083130-0146|10|4| END|101.43|4.Flocks prunned by expansion | 0.11| 0|1 2019-06-25 08:33:11,096|FF|app-20190625083130-0146|10|4|START|101.43|5.Flocks reported | 0.00| 0|1 2019-06-25 08:33:11,101|FF|app-20190625083130-0146|10|4| END|101.43|5.Flocks reported | 0.01| 0|1 2019-06-25 08:33:11,101|FF|app-20190625083130-0146|10|4|START|101.43|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:33:13,679|FF|app-20190625083130-0146|10|4| END|104.01|6.Candidates indexed | 2.58| 45047|1 2019-06-25 08:33:13,679|FF|app-20190625083130-0146|10|4|START|104.01|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:33:13,680|MF|app-20190625083130-0146|10|4|START|104.01|A.Points indexed | 0.00| 0|2 2019-06-25 08:33:13,776|MF|app-20190625083130-0146|10|4| END|104.11|A.Points indexed | 0.10| 36788|2 2019-06-25 08:33:13,776|MF|app-20190625083130-0146|10|4|START|104.11|B.Pairs found | 0.00| 0|2 2019-06-25 08:33:14,406|MF|app-20190625083130-0146|10|4| END|104.74|B.Pairs found | 0.63| 81132|2 2019-06-25 08:33:14,406|MF|app-20190625083130-0146|10|4|START|104.74|C.Centers found | 0.00| 0|2 2019-06-25 08:33:15,915|MF|app-20190625083130-0146|10|4| END|106.25|C.Centers found | 1.51|162264|2 2019-06-25 08:33:15,916|MF|app-20190625083130-0146|10|4|START|106.25|D.Disks found | 0.00| 0|2 2019-06-25 08:33:19,982|MF|app-20190625083130-0146|10|4| END|110.31|D.Disks found | 4.07| 72706|2 2019-06-25 08:33:19,982|MF|app-20190625083130-0146|10|4|START|110.31|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:33:24,095|MF|app-20190625083130-0146|10|4| END|114.43|E.Disks partitioned | 4.11|106347|2 2019-06-25 08:33:24,095|MF|app-20190625083130-0146|10|4|START|114.43|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:33:24,096|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:33:24,096|Cell area: 1055533.7681000116 2019-06-25 08:33:55,215|MF|app-20190625083130-0146|10|4| END|145.55|F.Maximal disks found | 31.12| 20682|2 2019-06-25 08:33:55,215|MAXIMALS|app-20190625083130-0146|4|10|110.0|3|900|41.535|20682 2019-06-25 08:33:56,728|FF|app-20190625083130-0146|10|4| END|147.06|1.Maximal disks found | 43.05| 20682|2 2019-06-25 08:33:56,728|FF|app-20190625083130-0146|10|4|START|147.06|2.Join done | 0.00| 0|2 2019-06-25 08:34:26,019|FF|app-20190625083130-0146|10|4| END|176.35|2.Join done | 29.29| 89740|2 2019-06-25 08:34:26,019|FF|app-20190625083130-0146|10|4|START|176.35|3.Flocks to report | 0.00| 0|2 2019-06-25 08:34:30,338|FF|app-20190625083130-0146|10|4| END|180.67|3.Flocks to report | 4.32| 76643|2 2019-06-25 08:34:30,339|FF|app-20190625083130-0146|10|4|START|180.67|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:34:30,431|FF|app-20190625083130-0146|10|4|START|180.76|4a.Making expansions | 0.00| 0|2 2019-06-25 08:34:32,928|FF|app-20190625083130-0146|10|4| END|183.26|4a.Making expansions | 2.50| 95701|2 2019-06-25 08:34:32,928|FF|app-20190625083130-0146|10|4|START|183.26|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:35:19,102|FF|app-20190625083130-0146|10|4| END|229.43|4b.Finding maximals | 46.17| 13202|2 2019-06-25 08:35:19,754|FF|app-20190625083130-0146|10|4| END|230.09|4.Flocks prunned by expansion | 49.42| 13202|2 2019-06-25 08:35:19,754|FF|app-20190625083130-0146|10|4|START|230.09|5.Flocks reported | 0.00| 0|2 2019-06-25 08:35:20,755|FF|app-20190625083130-0146|10|4| END|231.09|5.Flocks reported | 1.00| 13202|2 2019-06-25 08:35:20,755|FF|app-20190625083130-0146|10|4|START|231.09|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:35:24,852|FF|app-20190625083130-0146|10|4| END|235.18|6.Candidates indexed | 4.10| 27595|2 2019-06-25 08:35:24,852|FF|app-20190625083130-0146|10|4|START|235.18|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:35:24,852|MF|app-20190625083130-0146|10|4|START|235.18|A.Points indexed | 0.00| 0|3 2019-06-25 08:35:24,938|MF|app-20190625083130-0146|10|4| END|235.27|A.Points indexed | 0.09| 37096|3 2019-06-25 08:35:24,938|MF|app-20190625083130-0146|10|4|START|235.27|B.Pairs found | 0.00| 0|3 2019-06-25 08:35:25,568|MF|app-20190625083130-0146|10|4| END|235.90|B.Pairs found | 0.63| 82514|3 2019-06-25 08:35:25,568|MF|app-20190625083130-0146|10|4|START|235.90|C.Centers found | 0.00| 0|3 2019-06-25 08:35:26,965|MF|app-20190625083130-0146|10|4| END|237.30|C.Centers found | 1.40|165028|3 2019-06-25 08:35:26,965|MF|app-20190625083130-0146|10|4|START|237.30|D.Disks found | 0.00| 0|3 2019-06-25 08:35:31,118|MF|app-20190625083130-0146|10|4| END|241.45|D.Disks found | 4.15| 74174|3 2019-06-25 08:35:31,119|MF|app-20190625083130-0146|10|4|START|241.45|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:35:33,090|MF|app-20190625083130-0146|10|4| END|243.42|E.Disks partitioned | 1.97|108468|3 2019-06-25 08:35:33,091|MF|app-20190625083130-0146|10|4|START|243.42|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:35:33,091|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:35:33,091|Cell area: 1055533.7681000116 2019-06-25 08:36:06,584|MF|app-20190625083130-0146|10|4| END|276.92|F.Maximal disks found | 33.49| 21009|3 2019-06-25 08:36:06,584|MAXIMALS|app-20190625083130-0146|4|10|110.0|3|900|41.732|21009 2019-06-25 08:36:07,363|FF|app-20190625083130-0146|10|4| END|277.70|1.Maximal disks found | 42.51| 21009|3 2019-06-25 08:36:07,363|FF|app-20190625083130-0146|10|4|START|277.70|2.Join done | 0.00| 0|3 2019-06-25 08:36:21,693|FF|app-20190625083130-0146|10|4| END|292.03|2.Join done | 14.33| 90003|3 2019-06-25 08:36:21,693|FF|app-20190625083130-0146|10|4|START|292.03|3.Flocks to report | 0.00| 0|3 2019-06-25 08:36:24,236|FF|app-20190625083130-0146|10|4| END|294.57|3.Flocks to report | 2.54| 76861|3 2019-06-25 08:36:24,237|FF|app-20190625083130-0146|10|4|START|294.57|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:36:24,304|FF|app-20190625083130-0146|10|4|START|294.64|4a.Making expansions | 0.00| 0|3 2019-06-25 08:36:25,858|FF|app-20190625083130-0146|10|4| END|296.19|4a.Making expansions | 1.55| 95846|3 2019-06-25 08:36:25,858|FF|app-20190625083130-0146|10|4|START|296.19|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:37:32,500|FF|app-20190625083130-0146|10|4| END|362.83|4b.Finding maximals | 66.64| 13338|3 2019-06-25 08:37:32,942|FF|app-20190625083130-0146|10|4| END|363.27|4.Flocks prunned by expansion | 68.71| 13338|3 2019-06-25 08:37:32,942|FF|app-20190625083130-0146|10|4|START|363.27|5.Flocks reported | 0.00| 0|3 2019-06-25 08:37:33,598|FF|app-20190625083130-0146|10|4| END|363.93|5.Flocks reported | 0.66| 13338|3 2019-06-25 08:37:33,598|FF|app-20190625083130-0146|10|4|START|363.93|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:37:36,102|FF|app-20190625083130-0146|10|4| END|366.43|6.Candidates indexed | 2.50| 27789|3 2019-06-25 08:37:37,639|Number of flocks: 26540 2019-06-25 08:37:38,478|PFLOCK|app-20190625083130-0146|4|10|110.0|3|3|361.51|26540 2019-06-25 08:37:39,258|FF|app-20190625083130-0146|10|4| END|369.59|Flock Finder run |363.13| 26540|3 2019-06-25 08:37:39,258|FF|app-20190625083130-0146|10|4|START|369.59|Session closed | 0.00| 0|3 2019-06-25 08:37:45,985|FF|app-20190625083130-0146|10|4| END|376.32|Session closed | 6.73| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:37:47,922|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:37:49,020|FF|app-20190625083748-0147|5|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 08:37:49,021|FF|app-20190625083748-0147|5|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 08:37:52,755|FF|app-20190625083748-0147|5|4| END| 4.82|Data read | 3.73|110376|-1 2019-06-25 08:37:52,755|FF|app-20190625083748-0147|5|4|START| 4.82|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:37:52,880|FF|app-20190625083748-0147|5|4| END| 4.94|KDBTree partitioner | 0.13| 272|-1 2019-06-25 08:37:52,881|FF|app-20190625083748-0147|5|4|START| 4.94|MF partitioner | 0.00| 0|-1 2019-06-25 08:37:52,891|FF|app-20190625083748-0147|5|4| END| 4.95|MF partitioner | 0.01| 450|-1 2019-06-25 08:37:52,891|FF|app-20190625083748-0147|5|4|START| 4.95|Pointset done | 0.00| 0|-1 2019-06-25 08:37:53,854|FF|app-20190625083748-0147|5|4| END| 5.92|Pointset done | 0.96| 4|-1 2019-06-25 08:37:53,855|FF|app-20190625083748-0147|5|4|START| 5.92|Flock Finder run | 0.00| 0|-1 2019-06-25 08:37:53,874|FF|app-20190625083748-0147|5|4|START| 5.94|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:37:53,877|MF|app-20190625083748-0147|5|4|START| 5.94|A.Points indexed | 0.00| 0|0 2019-06-25 08:37:54,038|MF|app-20190625083748-0147|5|4| END| 6.10|A.Points indexed | 0.16| 18093|0 2019-06-25 08:37:54,038|MF|app-20190625083748-0147|5|4|START| 6.10|B.Pairs found | 0.00| 0|0 2019-06-25 08:37:55,505|MF|app-20190625083748-0147|5|4| END| 7.57|B.Pairs found | 1.47| 39404|0 2019-06-25 08:37:55,505|MF|app-20190625083748-0147|5|4|START| 7.57|C.Centers found | 0.00| 0|0 2019-06-25 08:37:56,307|MF|app-20190625083748-0147|5|4| END| 8.37|C.Centers found | 0.80| 78808|0 2019-06-25 08:37:56,307|MF|app-20190625083748-0147|5|4|START| 8.37|D.Disks found | 0.00| 0|0 2019-06-25 08:37:59,383|MF|app-20190625083748-0147|5|4| END| 11.45|D.Disks found | 3.08| 35229|0 2019-06-25 08:37:59,383|MF|app-20190625083748-0147|5|4|START| 11.45|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:38:00,501|MF|app-20190625083748-0147|5|4| END| 12.56|E.Disks partitioned | 1.12| 51442|0 2019-06-25 08:38:00,501|MF|app-20190625083748-0147|5|4|START| 12.56|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:38:00,502|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:38:00,502|Cell area: 1055533.7681000116 2019-06-25 08:38:25,197|MF|app-20190625083748-0147|5|4| END| 37.26|F.Maximal disks found | 24.70| 10001|0 2019-06-25 08:38:25,197|MAXIMALS|app-20190625083748-0147|4|5|110.0|3|450|31.32|10001 2019-06-25 08:38:25,678|FF|app-20190625083748-0147|5|4| END| 37.74|1.Maximal disks found | 31.80| 10001|0 2019-06-25 08:38:25,679|FF|app-20190625083748-0147|5|4|START| 37.74|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:38:25,679|MF|app-20190625083748-0147|5|4|START| 37.74|A.Points indexed | 0.00| 0|1 2019-06-25 08:38:25,754|MF|app-20190625083748-0147|5|4| END| 37.82|A.Points indexed | 0.08| 18245|1 2019-06-25 08:38:25,754|MF|app-20190625083748-0147|5|4|START| 37.82|B.Pairs found | 0.00| 0|1 2019-06-25 08:38:26,166|MF|app-20190625083748-0147|5|4| END| 38.23|B.Pairs found | 0.41| 39999|1 2019-06-25 08:38:26,166|MF|app-20190625083748-0147|5|4|START| 38.23|C.Centers found | 0.00| 0|1 2019-06-25 08:38:26,561|MF|app-20190625083748-0147|5|4| END| 38.62|C.Centers found | 0.39| 79998|1 2019-06-25 08:38:26,561|MF|app-20190625083748-0147|5|4|START| 38.62|D.Disks found | 0.00| 0|1 2019-06-25 08:38:28,633|MF|app-20190625083748-0147|5|4| END| 40.70|D.Disks found | 2.07| 35849|1 2019-06-25 08:38:28,633|MF|app-20190625083748-0147|5|4|START| 40.70|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:38:29,585|MF|app-20190625083748-0147|5|4| END| 41.65|E.Disks partitioned | 0.95| 52317|1 2019-06-25 08:38:29,586|MF|app-20190625083748-0147|5|4|START| 41.65|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:38:29,586|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:38:29,586|Cell area: 1055533.7681000116 2019-06-25 08:38:54,663|MF|app-20190625083748-0147|5|4| END| 66.73|F.Maximal disks found | 25.08| 10110|1 2019-06-25 08:38:54,663|MAXIMALS|app-20190625083748-0147|4|5|110.0|3|450|28.984|10110 2019-06-25 08:38:55,103|FF|app-20190625083748-0147|5|4| END| 67.17|1.Maximal disks found | 29.43| 10110|1 2019-06-25 08:38:55,103|FF|app-20190625083748-0147|5|4|START| 67.17|2.Join done | 0.00| 0|1 2019-06-25 08:38:57,620|FF|app-20190625083748-0147|5|4| END| 69.68|2.Join done | 2.52| 21993|1 2019-06-25 08:38:57,620|FF|app-20190625083748-0147|5|4|START| 69.68|3.Flocks to report | 0.00| 0|1 2019-06-25 08:38:58,140|FF|app-20190625083748-0147|5|4| END| 70.20|3.Flocks to report | 0.52| 0|1 2019-06-25 08:38:58,140|FF|app-20190625083748-0147|5|4|START| 70.20|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:38:58,178|FF|app-20190625083748-0147|5|4| END| 70.24|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 08:38:58,178|FF|app-20190625083748-0147|5|4|START| 70.24|5.Flocks reported | 0.00| 0|1 2019-06-25 08:38:58,183|FF|app-20190625083748-0147|5|4| END| 70.25|5.Flocks reported | 0.01| 0|1 2019-06-25 08:38:58,184|FF|app-20190625083748-0147|5|4|START| 70.25|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:39:00,050|FF|app-20190625083748-0147|5|4| END| 72.11|6.Candidates indexed | 1.87| 22599|1 2019-06-25 08:39:00,050|FF|app-20190625083748-0147|5|4|START| 72.11|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:39:00,051|MF|app-20190625083748-0147|5|4|START| 72.11|A.Points indexed | 0.00| 0|2 2019-06-25 08:39:00,112|MF|app-20190625083748-0147|5|4| END| 72.17|A.Points indexed | 0.06| 18394|2 2019-06-25 08:39:00,112|MF|app-20190625083748-0147|5|4|START| 72.17|B.Pairs found | 0.00| 0|2 2019-06-25 08:39:00,511|MF|app-20190625083748-0147|5|4| END| 72.57|B.Pairs found | 0.40| 40566|2 2019-06-25 08:39:00,511|MF|app-20190625083748-0147|5|4|START| 72.57|C.Centers found | 0.00| 0|2 2019-06-25 08:39:00,893|MF|app-20190625083748-0147|5|4| END| 72.96|C.Centers found | 0.38| 81132|2 2019-06-25 08:39:00,893|MF|app-20190625083748-0147|5|4|START| 72.96|D.Disks found | 0.00| 0|2 2019-06-25 08:39:02,838|MF|app-20190625083748-0147|5|4| END| 74.90|D.Disks found | 1.94| 36353|2 2019-06-25 08:39:02,838|MF|app-20190625083748-0147|5|4|START| 74.90|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:39:03,674|MF|app-20190625083748-0147|5|4| END| 75.74|E.Disks partitioned | 0.84| 53134|2 2019-06-25 08:39:03,674|MF|app-20190625083748-0147|5|4|START| 75.74|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:39:03,674|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:39:03,674|Cell area: 1055533.7681000116 2019-06-25 08:39:29,298|MF|app-20190625083748-0147|5|4| END|101.36|F.Maximal disks found | 25.62| 10342|2 2019-06-25 08:39:29,298|MAXIMALS|app-20190625083748-0147|4|5|110.0|3|450|29.247|10342 2019-06-25 08:39:29,701|FF|app-20190625083748-0147|5|4| END|101.76|1.Maximal disks found | 29.65| 10342|2 2019-06-25 08:39:29,701|FF|app-20190625083748-0147|5|4|START|101.76|2.Join done | 0.00| 0|2 2019-06-25 08:39:44,631|FF|app-20190625083748-0147|5|4| END|116.69|2.Join done | 14.93| 45000|2 2019-06-25 08:39:44,631|FF|app-20190625083748-0147|5|4|START|116.69|3.Flocks to report | 0.00| 0|2 2019-06-25 08:39:46,766|FF|app-20190625083748-0147|5|4| END|118.83|3.Flocks to report | 2.14| 38432|2 2019-06-25 08:39:46,766|FF|app-20190625083748-0147|5|4|START|118.83|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:39:46,821|FF|app-20190625083748-0147|5|4|START|118.88|4a.Making expansions | 0.00| 0|2 2019-06-25 08:39:48,076|FF|app-20190625083748-0147|5|4| END|120.14|4a.Making expansions | 1.26| 47766|2 2019-06-25 08:39:48,076|FF|app-20190625083748-0147|5|4|START|120.14|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:40:33,799|FF|app-20190625083748-0147|5|4| END|165.86|4b.Finding maximals | 45.72| 6601|2 2019-06-25 08:40:34,125|FF|app-20190625083748-0147|5|4| END|166.19|4.Flocks prunned by expansion | 47.36| 6601|2 2019-06-25 08:40:34,125|FF|app-20190625083748-0147|5|4|START|166.19|5.Flocks reported | 0.00| 0|2 2019-06-25 08:40:34,635|FF|app-20190625083748-0147|5|4| END|166.70|5.Flocks reported | 0.51| 6601|2 2019-06-25 08:40:34,635|FF|app-20190625083748-0147|5|4|START|166.70|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:40:38,235|FF|app-20190625083748-0147|5|4| END|170.30|6.Candidates indexed | 3.60| 13819|2 2019-06-25 08:40:38,235|FF|app-20190625083748-0147|5|4|START|170.30|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:40:38,235|MF|app-20190625083748-0147|5|4|START|170.30|A.Points indexed | 0.00| 0|3 2019-06-25 08:40:38,316|MF|app-20190625083748-0147|5|4| END|170.38|A.Points indexed | 0.08| 18548|3 2019-06-25 08:40:38,316|MF|app-20190625083748-0147|5|4|START|170.38|B.Pairs found | 0.00| 0|3 2019-06-25 08:40:38,878|MF|app-20190625083748-0147|5|4| END|170.94|B.Pairs found | 0.56| 41257|3 2019-06-25 08:40:38,878|MF|app-20190625083748-0147|5|4|START|170.94|C.Centers found | 0.00| 0|3 2019-06-25 08:40:39,486|MF|app-20190625083748-0147|5|4| END|171.55|C.Centers found | 0.61| 82514|3 2019-06-25 08:40:39,486|MF|app-20190625083748-0147|5|4|START|171.55|D.Disks found | 0.00| 0|3 2019-06-25 08:40:42,838|MF|app-20190625083748-0147|5|4| END|174.90|D.Disks found | 3.35| 37087|3 2019-06-25 08:40:42,838|MF|app-20190625083748-0147|5|4|START|174.90|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:40:44,113|MF|app-20190625083748-0147|5|4| END|176.18|E.Disks partitioned | 1.28| 54196|3 2019-06-25 08:40:44,113|MF|app-20190625083748-0147|5|4|START|176.18|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:40:44,113|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:40:44,113|Cell area: 1055533.7681000116 2019-06-25 08:41:16,073|MF|app-20190625083748-0147|5|4| END|208.14|F.Maximal disks found | 31.96| 10503|3 2019-06-25 08:41:16,073|MAXIMALS|app-20190625083748-0147|4|5|110.0|3|450|37.838|10503 2019-06-25 08:41:16,526|FF|app-20190625083748-0147|5|4| END|208.59|1.Maximal disks found | 38.29| 10503|3 2019-06-25 08:41:16,526|FF|app-20190625083748-0147|5|4|START|208.59|2.Join done | 0.00| 0|3 2019-06-25 08:41:24,097|FF|app-20190625083748-0147|5|4| END|216.16|2.Join done | 7.57| 45190|3 2019-06-25 08:41:24,098|FF|app-20190625083748-0147|5|4|START|216.16|3.Flocks to report | 0.00| 0|3 2019-06-25 08:41:25,453|FF|app-20190625083748-0147|5|4| END|217.52|3.Flocks to report | 1.36| 38589|3 2019-06-25 08:41:25,453|FF|app-20190625083748-0147|5|4|START|217.52|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:41:25,494|FF|app-20190625083748-0147|5|4|START|217.56|4a.Making expansions | 0.00| 0|3 2019-06-25 08:41:26,249|FF|app-20190625083748-0147|5|4| END|218.31|4a.Making expansions | 0.76| 47814|3 2019-06-25 08:41:26,249|FF|app-20190625083748-0147|5|4|START|218.31|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:42:29,295|FF|app-20190625083748-0147|5|4| END|281.36|4b.Finding maximals | 63.05| 6669|3 2019-06-25 08:42:29,516|FF|app-20190625083748-0147|5|4| END|281.58|4.Flocks prunned by expansion | 64.06| 6669|3 2019-06-25 08:42:29,516|FF|app-20190625083748-0147|5|4|START|281.58|5.Flocks reported | 0.00| 0|3 2019-06-25 08:42:29,823|FF|app-20190625083748-0147|5|4| END|281.89|5.Flocks reported | 0.31| 6669|3 2019-06-25 08:42:29,823|FF|app-20190625083748-0147|5|4|START|281.89|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:42:32,191|FF|app-20190625083748-0147|5|4| END|284.25|6.Candidates indexed | 2.37| 13927|3 2019-06-25 08:42:32,974|Number of flocks: 13270 2019-06-25 08:42:33,357|PFLOCK|app-20190625083748-0147|4|5|110.0|3|3|279.12|13270 2019-06-25 08:42:33,798|FF|app-20190625083748-0147|5|4| END|285.86|Flock Finder run |279.94| 13270|3 2019-06-25 08:42:33,798|FF|app-20190625083748-0147|5|4|START|285.86|Session closed | 0.00| 0|3 2019-06-25 08:42:40,744|FF|app-20190625083748-0147|5|4| END|292.81|Session closed | 6.95| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:42:42,663|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:42:43,752|FF|app-20190625084243-0148|15|4| END| 1.07|Session start | 1.09| 0|-1 2019-06-25 08:42:43,752|FF|app-20190625084243-0148|15|4|START| 1.07|Data read | 0.00| 0|-1 2019-06-25 08:42:47,829|FF|app-20190625084243-0148|15|4| END| 5.15|Data read | 4.08|331128|-1 2019-06-25 08:42:47,829|FF|app-20190625084243-0148|15|4|START| 5.15|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:42:48,178|FF|app-20190625084243-0148|15|4| END| 5.50|KDBTree partitioner | 0.35| 816|-1 2019-06-25 08:42:48,178|FF|app-20190625084243-0148|15|4|START| 5.50|MF partitioner | 0.00| 0|-1 2019-06-25 08:42:48,204|FF|app-20190625084243-0148|15|4| END| 5.53|MF partitioner | 0.03| 1350|-1 2019-06-25 08:42:48,205|FF|app-20190625084243-0148|15|4|START| 5.53|Pointset done | 0.00| 0|-1 2019-06-25 08:42:49,302|FF|app-20190625084243-0148|15|4| END| 6.62|Pointset done | 1.10| 4|-1 2019-06-25 08:42:49,302|FF|app-20190625084243-0148|15|4|START| 6.62|Flock Finder run | 0.00| 0|-1 2019-06-25 08:42:49,319|FF|app-20190625084243-0148|15|4|START| 6.64|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:42:49,321|MF|app-20190625084243-0148|15|4|START| 6.64|A.Points indexed | 0.00| 0|0 2019-06-25 08:42:49,541|MF|app-20190625084243-0148|15|4| END| 6.86|A.Points indexed | 0.22| 54279|0 2019-06-25 08:42:49,541|MF|app-20190625084243-0148|15|4|START| 6.86|B.Pairs found | 0.00| 0|0 2019-06-25 08:42:51,753|MF|app-20190625084243-0148|15|4| END| 9.07|B.Pairs found | 2.21| 71679|0 2019-06-25 08:42:51,753|MF|app-20190625084243-0148|15|4|START| 9.07|C.Centers found | 0.00| 0|0 2019-06-25 08:42:53,557|MF|app-20190625084243-0148|15|4| END| 10.88|C.Centers found | 1.80|143358|0 2019-06-25 08:42:53,557|MF|app-20190625084243-0148|15|4|START| 10.88|D.Disks found | 0.00| 0|0 2019-06-25 08:43:00,520|MF|app-20190625084243-0148|15|4| END| 17.84|D.Disks found | 6.96| 52353|0 2019-06-25 08:43:00,520|MF|app-20190625084243-0148|15|4|START| 17.84|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:43:02,144|MF|app-20190625084243-0148|15|4| END| 19.47|E.Disks partitioned | 1.62| 69681|0 2019-06-25 08:43:02,144|MF|app-20190625084243-0148|15|4|START| 19.47|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:43:02,146|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:43:02,146|Cell area: 1055533.7681000116 2019-06-25 08:43:04,351|MF|app-20190625084243-0148|15|4| END| 21.67|F.Maximal disks found | 2.21| 17026|0 2019-06-25 08:43:04,351|MAXIMALS|app-20190625084243-0148|4|15|80.0|3|1350|15.03|17026 2019-06-25 08:43:05,397|FF|app-20190625084243-0148|15|4| END| 22.72|1.Maximal disks found | 16.08| 17026|0 2019-06-25 08:43:05,397|FF|app-20190625084243-0148|15|4|START| 22.72|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:43:05,397|MF|app-20190625084243-0148|15|4|START| 22.72|A.Points indexed | 0.00| 0|1 2019-06-25 08:43:05,514|MF|app-20190625084243-0148|15|4| END| 22.84|A.Points indexed | 0.12| 54735|1 2019-06-25 08:43:05,514|MF|app-20190625084243-0148|15|4|START| 22.84|B.Pairs found | 0.00| 0|1 2019-06-25 08:43:06,681|MF|app-20190625084243-0148|15|4| END| 24.00|B.Pairs found | 1.17| 72729|1 2019-06-25 08:43:06,681|MF|app-20190625084243-0148|15|4|START| 24.00|C.Centers found | 0.00| 0|1 2019-06-25 08:43:08,346|MF|app-20190625084243-0148|15|4| END| 25.67|C.Centers found | 1.67|145458|1 2019-06-25 08:43:08,346|MF|app-20190625084243-0148|15|4|START| 25.67|D.Disks found | 0.00| 0|1 2019-06-25 08:43:14,980|MF|app-20190625084243-0148|15|4| END| 32.30|D.Disks found | 6.63| 53289|1 2019-06-25 08:43:14,981|MF|app-20190625084243-0148|15|4|START| 32.30|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:43:16,683|MF|app-20190625084243-0148|15|4| END| 34.00|E.Disks partitioned | 1.70| 70836|1 2019-06-25 08:43:16,683|MF|app-20190625084243-0148|15|4|START| 34.00|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:43:16,683|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:43:16,684|Cell area: 1055533.7681000116 2019-06-25 08:43:18,791|MF|app-20190625084243-0148|15|4| END| 36.11|F.Maximal disks found | 2.11| 17245|1 2019-06-25 08:43:18,791|MAXIMALS|app-20190625084243-0148|4|15|80.0|3|1350|13.394|17245 2019-06-25 08:43:19,796|FF|app-20190625084243-0148|15|4| END| 37.12|1.Maximal disks found | 14.40| 17245|1 2019-06-25 08:43:19,796|FF|app-20190625084243-0148|15|4|START| 37.12|2.Join done | 0.00| 0|1 2019-06-25 08:43:22,257|FF|app-20190625084243-0148|15|4| END| 39.58|2.Join done | 2.46| 27004|1 2019-06-25 08:43:22,257|FF|app-20190625084243-0148|15|4|START| 39.58|3.Flocks to report | 0.00| 0|1 2019-06-25 08:43:22,717|FF|app-20190625084243-0148|15|4| END| 40.04|3.Flocks to report | 0.46| 0|1 2019-06-25 08:43:22,717|FF|app-20190625084243-0148|15|4|START| 40.04|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:43:22,790|FF|app-20190625084243-0148|15|4| END| 40.11|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 08:43:22,790|FF|app-20190625084243-0148|15|4|START| 40.11|5.Flocks reported | 0.00| 0|1 2019-06-25 08:43:22,794|FF|app-20190625084243-0148|15|4| END| 40.12|5.Flocks reported | 0.00| 0|1 2019-06-25 08:43:22,795|FF|app-20190625084243-0148|15|4|START| 40.12|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:43:24,063|FF|app-20190625084243-0148|15|4| END| 41.38|6.Candidates indexed | 1.27| 28069|1 2019-06-25 08:43:24,063|FF|app-20190625084243-0148|15|4|START| 41.38|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:43:24,063|MF|app-20190625084243-0148|15|4|START| 41.38|A.Points indexed | 0.00| 0|2 2019-06-25 08:43:24,179|MF|app-20190625084243-0148|15|4| END| 41.50|A.Points indexed | 0.12| 55182|2 2019-06-25 08:43:24,179|MF|app-20190625084243-0148|15|4|START| 41.50|B.Pairs found | 0.00| 0|2 2019-06-25 08:43:25,037|MF|app-20190625084243-0148|15|4| END| 42.36|B.Pairs found | 0.86| 73710|2 2019-06-25 08:43:25,037|MF|app-20190625084243-0148|15|4|START| 42.36|C.Centers found | 0.00| 0|2 2019-06-25 08:43:26,070|MF|app-20190625084243-0148|15|4| END| 43.39|C.Centers found | 1.03|147420|2 2019-06-25 08:43:26,070|MF|app-20190625084243-0148|15|4|START| 43.39|D.Disks found | 0.00| 0|2 2019-06-25 08:43:32,249|MF|app-20190625084243-0148|15|4| END| 49.57|D.Disks found | 6.18| 54024|2 2019-06-25 08:43:32,249|MF|app-20190625084243-0148|15|4|START| 49.57|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:43:34,321|MF|app-20190625084243-0148|15|4| END| 51.64|E.Disks partitioned | 2.07| 71877|2 2019-06-25 08:43:34,321|MF|app-20190625084243-0148|15|4|START| 51.64|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:43:34,321|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:43:34,321|Cell area: 1055533.7681000116 2019-06-25 08:43:36,292|MF|app-20190625084243-0148|15|4| END| 53.61|F.Maximal disks found | 1.97| 17462|2 2019-06-25 08:43:36,292|MAXIMALS|app-20190625084243-0148|4|15|80.0|3|1350|12.229|17462 2019-06-25 08:43:37,337|FF|app-20190625084243-0148|15|4| END| 54.66|1.Maximal disks found | 13.27| 17462|2 2019-06-25 08:43:37,337|FF|app-20190625084243-0148|15|4|START| 54.66|2.Join done | 0.00| 0|2 2019-06-25 08:43:42,260|FF|app-20190625084243-0148|15|4| END| 59.58|2.Join done | 4.92| 38332|2 2019-06-25 08:43:42,260|FF|app-20190625084243-0148|15|4|START| 59.58|3.Flocks to report | 0.00| 0|2 2019-06-25 08:43:43,201|FF|app-20190625084243-0148|15|4| END| 60.52|3.Flocks to report | 0.94| 33043|2 2019-06-25 08:43:43,201|FF|app-20190625084243-0148|15|4|START| 60.52|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:43:43,274|FF|app-20190625084243-0148|15|4|START| 60.60|4a.Making expansions | 0.00| 0|2 2019-06-25 08:43:44,103|FF|app-20190625084243-0148|15|4| END| 61.42|4a.Making expansions | 0.83| 41699|2 2019-06-25 08:43:44,103|FF|app-20190625084243-0148|15|4|START| 61.42|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:43:45,246|FF|app-20190625084243-0148|15|4| END| 62.57|4b.Finding maximals | 1.14| 12225|2 2019-06-25 08:43:45,689|FF|app-20190625084243-0148|15|4| END| 63.01|4.Flocks prunned by expansion | 2.49| 12225|2 2019-06-25 08:43:45,689|FF|app-20190625084243-0148|15|4|START| 63.01|5.Flocks reported | 0.00| 0|2 2019-06-25 08:43:46,244|FF|app-20190625084243-0148|15|4| END| 63.56|5.Flocks reported | 0.55| 12225|2 2019-06-25 08:43:46,244|FF|app-20190625084243-0148|15|4|START| 63.57|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:43:47,804|FF|app-20190625084243-0148|15|4| END| 65.13|6.Candidates indexed | 1.56| 18597|2 2019-06-25 08:43:47,804|FF|app-20190625084243-0148|15|4|START| 65.13|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:43:47,804|MF|app-20190625084243-0148|15|4|START| 65.13|A.Points indexed | 0.00| 0|3 2019-06-25 08:43:47,914|MF|app-20190625084243-0148|15|4| END| 65.24|A.Points indexed | 0.11| 55644|3 2019-06-25 08:43:47,915|MF|app-20190625084243-0148|15|4|START| 65.24|B.Pairs found | 0.00| 0|3 2019-06-25 08:43:48,672|MF|app-20190625084243-0148|15|4| END| 65.99|B.Pairs found | 0.76| 74871|3 2019-06-25 08:43:48,672|MF|app-20190625084243-0148|15|4|START| 65.99|C.Centers found | 0.00| 0|3 2019-06-25 08:43:50,035|MF|app-20190625084243-0148|15|4| END| 67.36|C.Centers found | 1.36|149742|3 2019-06-25 08:43:50,035|MF|app-20190625084243-0148|15|4|START| 67.36|D.Disks found | 0.00| 0|3 2019-06-25 08:43:53,400|MF|app-20190625084243-0148|15|4| END| 70.72|D.Disks found | 3.37| 54930|3 2019-06-25 08:43:53,401|MF|app-20190625084243-0148|15|4|START| 70.72|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:43:54,271|MF|app-20190625084243-0148|15|4| END| 71.59|E.Disks partitioned | 0.87| 73112|3 2019-06-25 08:43:54,271|MF|app-20190625084243-0148|15|4|START| 71.59|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:43:54,272|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:43:54,272|Cell area: 1055533.7681000116 2019-06-25 08:43:56,521|MF|app-20190625084243-0148|15|4| END| 73.84|F.Maximal disks found | 2.25| 17782|3 2019-06-25 08:43:56,521|MAXIMALS|app-20190625084243-0148|4|15|80.0|3|1350|8.717|17782 2019-06-25 08:43:57,499|FF|app-20190625084243-0148|15|4| END| 74.82|1.Maximal disks found | 9.70| 17782|3 2019-06-25 08:43:57,499|FF|app-20190625084243-0148|15|4|START| 74.82|2.Join done | 0.00| 0|3 2019-06-25 08:44:01,284|FF|app-20190625084243-0148|15|4| END| 78.61|2.Join done | 3.79| 37059|3 2019-06-25 08:44:01,284|FF|app-20190625084243-0148|15|4|START| 78.61|3.Flocks to report | 0.00| 0|3 2019-06-25 08:44:02,497|FF|app-20190625084243-0148|15|4| END| 79.82|3.Flocks to report | 1.21| 31049|3 2019-06-25 08:44:02,497|FF|app-20190625084243-0148|15|4|START| 79.82|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:44:02,580|FF|app-20190625084243-0148|15|4|START| 79.90|4a.Making expansions | 0.00| 0|3 2019-06-25 08:44:03,552|FF|app-20190625084243-0148|15|4| END| 80.87|4a.Making expansions | 0.97| 39872|3 2019-06-25 08:44:03,552|FF|app-20190625084243-0148|15|4|START| 80.87|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:44:04,494|FF|app-20190625084243-0148|15|4| END| 81.82|4b.Finding maximals | 0.94| 12384|3 2019-06-25 08:44:04,937|FF|app-20190625084243-0148|15|4| END| 82.26|4.Flocks prunned by expansion | 2.44| 12384|3 2019-06-25 08:44:04,937|FF|app-20190625084243-0148|15|4|START| 82.26|5.Flocks reported | 0.00| 0|3 2019-06-25 08:44:05,546|FF|app-20190625084243-0148|15|4| END| 82.87|5.Flocks reported | 0.61| 12384|3 2019-06-25 08:44:05,546|FF|app-20190625084243-0148|15|4|START| 82.87|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:44:07,156|FF|app-20190625084243-0148|15|4| END| 84.48|6.Candidates indexed | 1.61| 19484|3 2019-06-25 08:44:08,546|Number of flocks: 24609 2019-06-25 08:44:09,461|PFLOCK|app-20190625084243-0148|4|15|80.0|3|3|79.24|24609 2019-06-25 08:44:10,395|FF|app-20190625084243-0148|15|4| END| 87.72|Flock Finder run | 81.09| 24609|3 2019-06-25 08:44:10,395|FF|app-20190625084243-0148|15|4|START| 87.72|Session closed | 0.00| 0|3 2019-06-25 08:44:20,382|FF|app-20190625084243-0148|15|4| END| 97.70|Session closed | 9.99| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:44:22,290|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:44:23,383|FF|app-20190625084423-0149|10|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 08:44:23,383|FF|app-20190625084423-0149|10|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 08:44:27,446|FF|app-20190625084423-0149|10|4| END| 5.14|Data read | 4.06|220752|-1 2019-06-25 08:44:27,447|FF|app-20190625084423-0149|10|4|START| 5.14|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:44:27,755|FF|app-20190625084423-0149|10|4| END| 5.45|KDBTree partitioner | 0.31| 544|-1 2019-06-25 08:44:27,755|FF|app-20190625084423-0149|10|4|START| 5.45|MF partitioner | 0.00| 0|-1 2019-06-25 08:44:27,776|FF|app-20190625084423-0149|10|4| END| 5.47|MF partitioner | 0.02| 900|-1 2019-06-25 08:44:27,776|FF|app-20190625084423-0149|10|4|START| 5.47|Pointset done | 0.00| 0|-1 2019-06-25 08:44:28,892|FF|app-20190625084423-0149|10|4| END| 6.59|Pointset done | 1.12| 4|-1 2019-06-25 08:44:28,892|FF|app-20190625084423-0149|10|4|START| 6.59|Flock Finder run | 0.00| 0|-1 2019-06-25 08:44:28,913|FF|app-20190625084423-0149|10|4|START| 6.61|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:44:28,916|MF|app-20190625084423-0149|10|4|START| 6.61|A.Points indexed | 0.00| 0|0 2019-06-25 08:44:29,090|MF|app-20190625084423-0149|10|4| END| 6.78|A.Points indexed | 0.17| 36186|0 2019-06-25 08:44:29,090|MF|app-20190625084423-0149|10|4|START| 6.78|B.Pairs found | 0.00| 0|0 2019-06-25 08:44:30,801|MF|app-20190625084423-0149|10|4| END| 8.49|B.Pairs found | 1.71| 47786|0 2019-06-25 08:44:30,802|MF|app-20190625084423-0149|10|4|START| 8.50|C.Centers found | 0.00| 0|0 2019-06-25 08:44:31,801|MF|app-20190625084423-0149|10|4| END| 9.49|C.Centers found | 1.00| 95572|0 2019-06-25 08:44:31,801|MF|app-20190625084423-0149|10|4|START| 9.49|D.Disks found | 0.00| 0|0 2019-06-25 08:44:36,622|MF|app-20190625084423-0149|10|4| END| 14.32|D.Disks found | 4.82| 34902|0 2019-06-25 08:44:36,622|MF|app-20190625084423-0149|10|4|START| 14.32|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:44:38,592|MF|app-20190625084423-0149|10|4| END| 16.29|E.Disks partitioned | 1.97| 46456|0 2019-06-25 08:44:38,592|MF|app-20190625084423-0149|10|4|START| 16.29|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:44:38,594|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:44:38,594|Cell area: 1055533.7681000116 2019-06-25 08:44:40,892|MF|app-20190625084423-0149|10|4| END| 18.59|F.Maximal disks found | 2.30| 11354|0 2019-06-25 08:44:40,892|MAXIMALS|app-20190625084423-0149|4|10|80.0|3|900|11.976|11354 2019-06-25 08:44:41,883|FF|app-20190625084423-0149|10|4| END| 19.58|1.Maximal disks found | 12.97| 11354|0 2019-06-25 08:44:41,883|FF|app-20190625084423-0149|10|4|START| 19.58|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:44:41,883|MF|app-20190625084423-0149|10|4|START| 19.58|A.Points indexed | 0.00| 0|1 2019-06-25 08:44:41,994|MF|app-20190625084423-0149|10|4| END| 19.69|A.Points indexed | 0.11| 36490|1 2019-06-25 08:44:41,994|MF|app-20190625084423-0149|10|4|START| 19.69|B.Pairs found | 0.00| 0|1 2019-06-25 08:44:43,130|MF|app-20190625084423-0149|10|4| END| 20.82|B.Pairs found | 1.14| 48486|1 2019-06-25 08:44:43,130|MF|app-20190625084423-0149|10|4|START| 20.82|C.Centers found | 0.00| 0|1 2019-06-25 08:44:44,878|MF|app-20190625084423-0149|10|4| END| 22.57|C.Centers found | 1.75| 96972|1 2019-06-25 08:44:44,878|MF|app-20190625084423-0149|10|4|START| 22.57|D.Disks found | 0.00| 0|1 2019-06-25 08:44:49,575|MF|app-20190625084423-0149|10|4| END| 27.27|D.Disks found | 4.70| 35526|1 2019-06-25 08:44:49,575|MF|app-20190625084423-0149|10|4|START| 27.27|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:44:51,348|MF|app-20190625084423-0149|10|4| END| 29.04|E.Disks partitioned | 1.77| 47221|1 2019-06-25 08:44:51,348|MF|app-20190625084423-0149|10|4|START| 29.04|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:44:51,348|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:44:51,348|Cell area: 1055533.7681000116 2019-06-25 08:44:53,545|MF|app-20190625084423-0149|10|4| END| 31.24|F.Maximal disks found | 2.20| 11499|1 2019-06-25 08:44:53,545|MAXIMALS|app-20190625084423-0149|4|10|80.0|3|900|11.662|11499 2019-06-25 08:44:54,445|FF|app-20190625084423-0149|10|4| END| 32.14|1.Maximal disks found | 12.56| 11499|1 2019-06-25 08:44:54,445|FF|app-20190625084423-0149|10|4|START| 32.14|2.Join done | 0.00| 0|1 2019-06-25 08:44:58,564|FF|app-20190625084423-0149|10|4| END| 36.26|2.Join done | 4.12| 17993|1 2019-06-25 08:44:58,564|FF|app-20190625084423-0149|10|4|START| 36.26|3.Flocks to report | 0.00| 0|1 2019-06-25 08:44:59,301|FF|app-20190625084423-0149|10|4| END| 36.99|3.Flocks to report | 0.74| 0|1 2019-06-25 08:44:59,301|FF|app-20190625084423-0149|10|4|START| 36.99|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:44:59,362|FF|app-20190625084423-0149|10|4| END| 37.06|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 08:44:59,362|FF|app-20190625084423-0149|10|4|START| 37.06|5.Flocks reported | 0.00| 0|1 2019-06-25 08:44:59,366|FF|app-20190625084423-0149|10|4| END| 37.06|5.Flocks reported | 0.00| 0|1 2019-06-25 08:44:59,367|FF|app-20190625084423-0149|10|4|START| 37.06|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:45:00,950|FF|app-20190625084423-0149|10|4| END| 38.64|6.Candidates indexed | 1.58| 18703|1 2019-06-25 08:45:00,950|FF|app-20190625084423-0149|10|4|START| 38.64|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:45:00,950|MF|app-20190625084423-0149|10|4|START| 38.64|A.Points indexed | 0.00| 0|2 2019-06-25 08:45:01,042|MF|app-20190625084423-0149|10|4| END| 38.74|A.Points indexed | 0.09| 36788|2 2019-06-25 08:45:01,042|MF|app-20190625084423-0149|10|4|START| 38.74|B.Pairs found | 0.00| 0|2 2019-06-25 08:45:01,717|MF|app-20190625084423-0149|10|4| END| 39.41|B.Pairs found | 0.68| 49140|2 2019-06-25 08:45:01,717|MF|app-20190625084423-0149|10|4|START| 39.41|C.Centers found | 0.00| 0|2 2019-06-25 08:45:02,464|MF|app-20190625084423-0149|10|4| END| 40.16|C.Centers found | 0.75| 98280|2 2019-06-25 08:45:02,464|MF|app-20190625084423-0149|10|4|START| 40.16|D.Disks found | 0.00| 0|2 2019-06-25 08:45:06,524|MF|app-20190625084423-0149|10|4| END| 44.22|D.Disks found | 4.06| 36016|2 2019-06-25 08:45:06,524|MF|app-20190625084423-0149|10|4|START| 44.22|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:45:08,279|MF|app-20190625084423-0149|10|4| END| 45.97|E.Disks partitioned | 1.76| 47918|2 2019-06-25 08:45:08,279|MF|app-20190625084423-0149|10|4|START| 45.97|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:45:08,279|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:45:08,279|Cell area: 1055533.7681000116 2019-06-25 08:45:11,016|MF|app-20190625084423-0149|10|4| END| 48.71|F.Maximal disks found | 2.74| 11642|2 2019-06-25 08:45:11,016|MAXIMALS|app-20190625084423-0149|4|10|80.0|3|900|10.066|11642 2019-06-25 08:45:11,926|FF|app-20190625084423-0149|10|4| END| 49.62|1.Maximal disks found | 10.98| 11642|2 2019-06-25 08:45:11,926|FF|app-20190625084423-0149|10|4|START| 49.62|2.Join done | 0.00| 0|2 2019-06-25 08:45:17,495|FF|app-20190625084423-0149|10|4| END| 55.19|2.Join done | 5.57| 25538|2 2019-06-25 08:45:17,495|FF|app-20190625084423-0149|10|4|START| 55.19|3.Flocks to report | 0.00| 0|2 2019-06-25 08:45:18,381|FF|app-20190625084423-0149|10|4| END| 56.07|3.Flocks to report | 0.89| 22013|2 2019-06-25 08:45:18,381|FF|app-20190625084423-0149|10|4|START| 56.07|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:45:18,443|FF|app-20190625084423-0149|10|4|START| 56.14|4a.Making expansions | 0.00| 0|2 2019-06-25 08:45:19,460|FF|app-20190625084423-0149|10|4| END| 57.15|4a.Making expansions | 1.02| 27768|2 2019-06-25 08:45:19,460|FF|app-20190625084423-0149|10|4|START| 57.15|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:45:20,640|FF|app-20190625084423-0149|10|4| END| 58.33|4b.Finding maximals | 1.18| 8150|2 2019-06-25 08:45:21,050|FF|app-20190625084423-0149|10|4| END| 58.74|4.Flocks prunned by expansion | 2.67| 8150|2 2019-06-25 08:45:21,050|FF|app-20190625084423-0149|10|4|START| 58.74|5.Flocks reported | 0.00| 0|2 2019-06-25 08:45:21,640|FF|app-20190625084423-0149|10|4| END| 59.33|5.Flocks reported | 0.59| 8150|2 2019-06-25 08:45:21,640|FF|app-20190625084423-0149|10|4|START| 59.33|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:45:23,362|FF|app-20190625084423-0149|10|4| END| 61.06|6.Candidates indexed | 1.72| 12396|2 2019-06-25 08:45:23,362|FF|app-20190625084423-0149|10|4|START| 61.06|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:45:23,362|MF|app-20190625084423-0149|10|4|START| 61.06|A.Points indexed | 0.00| 0|3 2019-06-25 08:45:23,446|MF|app-20190625084423-0149|10|4| END| 61.14|A.Points indexed | 0.08| 37096|3 2019-06-25 08:45:23,446|MF|app-20190625084423-0149|10|4|START| 61.14|B.Pairs found | 0.00| 0|3 2019-06-25 08:45:24,257|MF|app-20190625084423-0149|10|4| END| 61.95|B.Pairs found | 0.81| 49914|3 2019-06-25 08:45:24,258|MF|app-20190625084423-0149|10|4|START| 61.95|C.Centers found | 0.00| 0|3 2019-06-25 08:45:25,451|MF|app-20190625084423-0149|10|4| END| 63.14|C.Centers found | 1.19| 99828|3 2019-06-25 08:45:25,452|MF|app-20190625084423-0149|10|4|START| 63.14|D.Disks found | 0.00| 0|3 2019-06-25 08:45:29,105|MF|app-20190625084423-0149|10|4| END| 66.80|D.Disks found | 3.65| 36620|3 2019-06-25 08:45:29,105|MF|app-20190625084423-0149|10|4|START| 66.80|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:45:30,299|MF|app-20190625084423-0149|10|4| END| 67.99|E.Disks partitioned | 1.19| 48737|3 2019-06-25 08:45:30,299|MF|app-20190625084423-0149|10|4|START| 67.99|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:45:30,300|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:45:30,300|Cell area: 1055533.7681000116 2019-06-25 08:45:32,538|MF|app-20190625084423-0149|10|4| END| 70.23|F.Maximal disks found | 2.24| 11852|3 2019-06-25 08:45:32,538|MAXIMALS|app-20190625084423-0149|4|10|80.0|3|900|9.176|11852 2019-06-25 08:45:33,260|FF|app-20190625084423-0149|10|4| END| 70.95|1.Maximal disks found | 9.90| 11852|3 2019-06-25 08:45:33,260|FF|app-20190625084423-0149|10|4|START| 70.95|2.Join done | 0.00| 0|3 2019-06-25 08:45:36,393|FF|app-20190625084423-0149|10|4| END| 74.09|2.Join done | 3.13| 24689|3 2019-06-25 08:45:36,393|FF|app-20190625084423-0149|10|4|START| 74.09|3.Flocks to report | 0.00| 0|3 2019-06-25 08:45:37,017|FF|app-20190625084423-0149|10|4| END| 74.71|3.Flocks to report | 0.62| 20688|3 2019-06-25 08:45:37,017|FF|app-20190625084423-0149|10|4|START| 74.71|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:45:37,074|FF|app-20190625084423-0149|10|4|START| 74.77|4a.Making expansions | 0.00| 0|3 2019-06-25 08:45:37,872|FF|app-20190625084423-0149|10|4| END| 75.57|4a.Making expansions | 0.80| 26582|3 2019-06-25 08:45:37,873|FF|app-20190625084423-0149|10|4|START| 75.57|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:45:38,685|FF|app-20190625084423-0149|10|4| END| 76.38|4b.Finding maximals | 0.81| 8256|3 2019-06-25 08:45:39,003|FF|app-20190625084423-0149|10|4| END| 76.70|4.Flocks prunned by expansion | 1.99| 8256|3 2019-06-25 08:45:39,003|FF|app-20190625084423-0149|10|4|START| 76.70|5.Flocks reported | 0.00| 0|3 2019-06-25 08:45:39,490|FF|app-20190625084423-0149|10|4| END| 77.18|5.Flocks reported | 0.49| 8256|3 2019-06-25 08:45:39,490|FF|app-20190625084423-0149|10|4|START| 77.18|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:45:40,944|FF|app-20190625084423-0149|10|4| END| 78.64|6.Candidates indexed | 1.45| 12984|3 2019-06-25 08:45:42,142|Number of flocks: 16406 2019-06-25 08:45:42,942|PFLOCK|app-20190625084423-0149|4|10|80.0|3|3|73.25|16406 2019-06-25 08:45:43,701|FF|app-20190625084423-0149|10|4| END| 81.39|Flock Finder run | 74.81| 16406|3 2019-06-25 08:45:43,701|FF|app-20190625084423-0149|10|4|START| 81.39|Session closed | 0.00| 0|3 2019-06-25 08:45:50,324|FF|app-20190625084423-0149|10|4| END| 88.02|Session closed | 6.62| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:45:52,319|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:45:53,438|FF|app-20190625084553-0150|5|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 08:45:53,438|FF|app-20190625084553-0150|5|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 08:45:57,238|FF|app-20190625084553-0150|5|4| END| 4.90|Data read | 3.80|110376|-1 2019-06-25 08:45:57,238|FF|app-20190625084553-0150|5|4|START| 4.90|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:45:57,358|FF|app-20190625084553-0150|5|4| END| 5.02|KDBTree partitioner | 0.12| 272|-1 2019-06-25 08:45:57,358|FF|app-20190625084553-0150|5|4|START| 5.02|MF partitioner | 0.00| 0|-1 2019-06-25 08:45:57,369|FF|app-20190625084553-0150|5|4| END| 5.03|MF partitioner | 0.01| 450|-1 2019-06-25 08:45:57,369|FF|app-20190625084553-0150|5|4|START| 5.03|Pointset done | 0.00| 0|-1 2019-06-25 08:45:58,420|FF|app-20190625084553-0150|5|4| END| 6.08|Pointset done | 1.05| 4|-1 2019-06-25 08:45:58,420|FF|app-20190625084553-0150|5|4|START| 6.08|Flock Finder run | 0.00| 0|-1 2019-06-25 08:45:58,443|FF|app-20190625084553-0150|5|4|START| 6.11|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:45:58,446|MF|app-20190625084553-0150|5|4|START| 6.11|A.Points indexed | 0.00| 0|0 2019-06-25 08:45:58,593|MF|app-20190625084553-0150|5|4| END| 6.26|A.Points indexed | 0.15| 18093|0 2019-06-25 08:45:58,593|MF|app-20190625084553-0150|5|4|START| 6.26|B.Pairs found | 0.00| 0|0 2019-06-25 08:45:59,820|MF|app-20190625084553-0150|5|4| END| 7.48|B.Pairs found | 1.23| 23893|0 2019-06-25 08:45:59,820|MF|app-20190625084553-0150|5|4|START| 7.48|C.Centers found | 0.00| 0|0 2019-06-25 08:46:00,749|MF|app-20190625084553-0150|5|4| END| 8.41|C.Centers found | 0.93| 47786|0 2019-06-25 08:46:00,750|MF|app-20190625084553-0150|5|4|START| 8.41|D.Disks found | 0.00| 0|0 2019-06-25 08:46:03,198|MF|app-20190625084553-0150|5|4| END| 10.86|D.Disks found | 2.45| 17451|0 2019-06-25 08:46:03,198|MF|app-20190625084553-0150|5|4|START| 10.86|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:46:03,870|MF|app-20190625084553-0150|5|4| END| 11.53|E.Disks partitioned | 0.67| 23231|0 2019-06-25 08:46:03,870|MF|app-20190625084553-0150|5|4|START| 11.53|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:46:03,871|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:46:03,871|Cell area: 1055533.7681000116 2019-06-25 08:46:05,683|MF|app-20190625084553-0150|5|4| END| 13.35|F.Maximal disks found | 1.81| 5681|0 2019-06-25 08:46:05,683|MAXIMALS|app-20190625084553-0150|4|5|80.0|3|450|7.237|5681 2019-06-25 08:46:06,212|FF|app-20190625084553-0150|5|4| END| 13.88|1.Maximal disks found | 7.77| 5681|0 2019-06-25 08:46:06,213|FF|app-20190625084553-0150|5|4|START| 13.88|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:46:06,213|MF|app-20190625084553-0150|5|4|START| 13.88|A.Points indexed | 0.00| 0|1 2019-06-25 08:46:06,299|MF|app-20190625084553-0150|5|4| END| 13.96|A.Points indexed | 0.09| 18245|1 2019-06-25 08:46:06,299|MF|app-20190625084553-0150|5|4|START| 13.96|B.Pairs found | 0.00| 0|1 2019-06-25 08:46:06,737|MF|app-20190625084553-0150|5|4| END| 14.40|B.Pairs found | 0.44| 24243|1 2019-06-25 08:46:06,737|MF|app-20190625084553-0150|5|4|START| 14.40|C.Centers found | 0.00| 0|1 2019-06-25 08:46:07,104|MF|app-20190625084553-0150|5|4| END| 14.77|C.Centers found | 0.37| 48486|1 2019-06-25 08:46:07,104|MF|app-20190625084553-0150|5|4|START| 14.77|D.Disks found | 0.00| 0|1 2019-06-25 08:46:08,970|MF|app-20190625084553-0150|5|4| END| 16.63|D.Disks found | 1.87| 17763|1 2019-06-25 08:46:08,970|MF|app-20190625084553-0150|5|4|START| 16.63|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:46:09,626|MF|app-20190625084553-0150|5|4| END| 17.29|E.Disks partitioned | 0.66| 23611|1 2019-06-25 08:46:09,626|MF|app-20190625084553-0150|5|4|START| 17.29|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:46:09,627|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:46:09,627|Cell area: 1055533.7681000116 2019-06-25 08:46:11,303|MF|app-20190625084553-0150|5|4| END| 18.97|F.Maximal disks found | 1.68| 5752|1 2019-06-25 08:46:11,303|MAXIMALS|app-20190625084553-0150|4|5|80.0|3|450|5.09|5752 2019-06-25 08:46:11,785|FF|app-20190625084553-0150|5|4| END| 19.45|1.Maximal disks found | 5.57| 5752|1 2019-06-25 08:46:11,785|FF|app-20190625084553-0150|5|4|START| 19.45|2.Join done | 0.00| 0|1 2019-06-25 08:46:13,415|FF|app-20190625084553-0150|5|4| END| 21.08|2.Join done | 1.63| 8996|1 2019-06-25 08:46:13,416|FF|app-20190625084553-0150|5|4|START| 21.08|3.Flocks to report | 0.00| 0|1 2019-06-25 08:46:13,742|FF|app-20190625084553-0150|5|4| END| 21.41|3.Flocks to report | 0.33| 0|1 2019-06-25 08:46:13,742|FF|app-20190625084553-0150|5|4|START| 21.41|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:46:13,779|FF|app-20190625084553-0150|5|4| END| 21.44|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 08:46:13,780|FF|app-20190625084553-0150|5|4|START| 21.44|5.Flocks reported | 0.00| 0|1 2019-06-25 08:46:13,784|FF|app-20190625084553-0150|5|4| END| 21.45|5.Flocks reported | 0.00| 0|1 2019-06-25 08:46:13,784|FF|app-20190625084553-0150|5|4|START| 21.45|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:46:14,827|FF|app-20190625084553-0150|5|4| END| 22.49|6.Candidates indexed | 1.04| 9351|1 2019-06-25 08:46:14,827|FF|app-20190625084553-0150|5|4|START| 22.49|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:46:14,827|MF|app-20190625084553-0150|5|4|START| 22.49|A.Points indexed | 0.00| 0|2 2019-06-25 08:46:14,888|MF|app-20190625084553-0150|5|4| END| 22.55|A.Points indexed | 0.06| 18394|2 2019-06-25 08:46:14,888|MF|app-20190625084553-0150|5|4|START| 22.55|B.Pairs found | 0.00| 0|2 2019-06-25 08:46:15,319|MF|app-20190625084553-0150|5|4| END| 22.98|B.Pairs found | 0.43| 24570|2 2019-06-25 08:46:15,319|MF|app-20190625084553-0150|5|4|START| 22.98|C.Centers found | 0.00| 0|2 2019-06-25 08:46:15,735|MF|app-20190625084553-0150|5|4| END| 23.40|C.Centers found | 0.42| 49140|2 2019-06-25 08:46:15,735|MF|app-20190625084553-0150|5|4|START| 23.40|D.Disks found | 0.00| 0|2 2019-06-25 08:46:17,490|MF|app-20190625084553-0150|5|4| END| 25.15|D.Disks found | 1.76| 18008|2 2019-06-25 08:46:17,490|MF|app-20190625084553-0150|5|4|START| 25.15|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:46:18,074|MF|app-20190625084553-0150|5|4| END| 25.74|E.Disks partitioned | 0.58| 23955|2 2019-06-25 08:46:18,074|MF|app-20190625084553-0150|5|4|START| 25.74|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:46:18,074|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:46:18,074|Cell area: 1055533.7681000116 2019-06-25 08:46:19,790|MF|app-20190625084553-0150|5|4| END| 27.45|F.Maximal disks found | 1.72| 5821|2 2019-06-25 08:46:19,790|MAXIMALS|app-20190625084553-0150|4|5|80.0|3|450|4.963|5821 2019-06-25 08:46:20,155|FF|app-20190625084553-0150|5|4| END| 27.82|1.Maximal disks found | 5.33| 5821|2 2019-06-25 08:46:20,155|FF|app-20190625084553-0150|5|4|START| 27.82|2.Join done | 0.00| 0|2 2019-06-25 08:46:22,900|FF|app-20190625084553-0150|5|4| END| 30.56|2.Join done | 2.75| 12766|2 2019-06-25 08:46:22,901|FF|app-20190625084553-0150|5|4|START| 30.57|3.Flocks to report | 0.00| 0|2 2019-06-25 08:46:23,299|FF|app-20190625084553-0150|5|4| END| 30.96|3.Flocks to report | 0.40| 11004|2 2019-06-25 08:46:23,299|FF|app-20190625084553-0150|5|4|START| 30.96|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:46:23,334|FF|app-20190625084553-0150|5|4|START| 31.00|4a.Making expansions | 0.00| 0|2 2019-06-25 08:46:23,671|FF|app-20190625084553-0150|5|4| END| 31.34|4a.Making expansions | 0.34| 13860|2 2019-06-25 08:46:23,671|FF|app-20190625084553-0150|5|4|START| 31.34|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:46:24,475|FF|app-20190625084553-0150|5|4| END| 32.14|4b.Finding maximals | 0.80| 4075|2 2019-06-25 08:46:24,643|FF|app-20190625084553-0150|5|4| END| 32.31|4.Flocks prunned by expansion | 1.34| 4075|2 2019-06-25 08:46:24,643|FF|app-20190625084553-0150|5|4|START| 32.31|5.Flocks reported | 0.00| 0|2 2019-06-25 08:46:24,916|FF|app-20190625084553-0150|5|4| END| 32.58|5.Flocks reported | 0.27| 4075|2 2019-06-25 08:46:24,916|FF|app-20190625084553-0150|5|4|START| 32.58|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:46:25,883|FF|app-20190625084553-0150|5|4| END| 33.55|6.Candidates indexed | 0.97| 6197|2 2019-06-25 08:46:25,883|FF|app-20190625084553-0150|5|4|START| 33.55|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:46:25,883|MF|app-20190625084553-0150|5|4|START| 33.55|A.Points indexed | 0.00| 0|3 2019-06-25 08:46:25,943|MF|app-20190625084553-0150|5|4| END| 33.61|A.Points indexed | 0.06| 18548|3 2019-06-25 08:46:25,943|MF|app-20190625084553-0150|5|4|START| 33.61|B.Pairs found | 0.00| 0|3 2019-06-25 08:46:26,516|MF|app-20190625084553-0150|5|4| END| 34.18|B.Pairs found | 0.57| 24957|3 2019-06-25 08:46:26,516|MF|app-20190625084553-0150|5|4|START| 34.18|C.Centers found | 0.00| 0|3 2019-06-25 08:46:27,168|MF|app-20190625084553-0150|5|4| END| 34.83|C.Centers found | 0.65| 49914|3 2019-06-25 08:46:27,168|MF|app-20190625084553-0150|5|4|START| 34.83|D.Disks found | 0.00| 0|3 2019-06-25 08:46:29,781|MF|app-20190625084553-0150|5|4| END| 37.45|D.Disks found | 2.61| 18310|3 2019-06-25 08:46:29,781|MF|app-20190625084553-0150|5|4|START| 37.45|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:46:30,521|MF|app-20190625084553-0150|5|4| END| 38.19|E.Disks partitioned | 0.74| 24367|3 2019-06-25 08:46:30,521|MF|app-20190625084553-0150|5|4|START| 38.19|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:46:30,522|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:46:30,522|Cell area: 1055533.7681000116 2019-06-25 08:46:32,589|MF|app-20190625084553-0150|5|4| END| 40.25|F.Maximal disks found | 2.07| 5926|3 2019-06-25 08:46:32,589|MAXIMALS|app-20190625084553-0150|4|5|80.0|3|450|6.706|5926 2019-06-25 08:46:33,014|FF|app-20190625084553-0150|5|4| END| 40.68|1.Maximal disks found | 7.13| 5926|3 2019-06-25 08:46:33,014|FF|app-20190625084553-0150|5|4|START| 40.68|2.Join done | 0.00| 0|3 2019-06-25 08:46:35,271|FF|app-20190625084553-0150|5|4| END| 42.94|2.Join done | 2.26| 12337|3 2019-06-25 08:46:35,272|FF|app-20190625084553-0150|5|4|START| 42.94|3.Flocks to report | 0.00| 0|3 2019-06-25 08:46:35,744|FF|app-20190625084553-0150|5|4| END| 43.41|3.Flocks to report | 0.47| 10340|3 2019-06-25 08:46:35,744|FF|app-20190625084553-0150|5|4|START| 43.41|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:46:35,783|FF|app-20190625084553-0150|5|4|START| 43.45|4a.Making expansions | 0.00| 0|3 2019-06-25 08:46:36,293|FF|app-20190625084553-0150|5|4| END| 43.96|4a.Making expansions | 0.51| 13283|3 2019-06-25 08:46:36,293|FF|app-20190625084553-0150|5|4|START| 43.96|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:46:36,908|FF|app-20190625084553-0150|5|4| END| 44.57|4b.Finding maximals | 0.62| 4128|3 2019-06-25 08:46:37,107|FF|app-20190625084553-0150|5|4| END| 44.77|4.Flocks prunned by expansion | 1.36| 4128|3 2019-06-25 08:46:37,107|FF|app-20190625084553-0150|5|4|START| 44.77|5.Flocks reported | 0.00| 0|3 2019-06-25 08:46:37,375|FF|app-20190625084553-0150|5|4| END| 45.04|5.Flocks reported | 0.27| 4128|3 2019-06-25 08:46:37,375|FF|app-20190625084553-0150|5|4|START| 45.04|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:46:38,715|FF|app-20190625084553-0150|5|4| END| 46.38|6.Candidates indexed | 1.34| 6487|3 2019-06-25 08:46:39,241|Number of flocks: 8203 2019-06-25 08:46:39,622|PFLOCK|app-20190625084553-0150|4|5|80.0|3|3|40.82|8203 2019-06-25 08:46:39,965|FF|app-20190625084553-0150|5|4| END| 47.63|Flock Finder run | 41.55| 8203|3 2019-06-25 08:46:39,965|FF|app-20190625084553-0150|5|4|START| 47.63|Session closed | 0.00| 0|3 2019-06-25 08:46:46,391|FF|app-20190625084553-0150|5|4| END| 54.06|Session closed | 6.43| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:46:48,370|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:46:49,462|FF|app-20190625084649-0151|15|4| END| 1.08|Session start | 1.09| 0|-1 2019-06-25 08:46:49,462|FF|app-20190625084649-0151|15|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 08:46:53,698|FF|app-20190625084649-0151|15|4| END| 5.31|Data read | 4.24|331128|-1 2019-06-25 08:46:53,698|FF|app-20190625084649-0151|15|4|START| 5.31|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:46:53,888|FF|app-20190625084649-0151|15|4| END| 5.50|KDBTree partitioner | 0.19| 816|-1 2019-06-25 08:46:53,888|FF|app-20190625084649-0151|15|4|START| 5.50|MF partitioner | 0.00| 0|-1 2019-06-25 08:46:53,912|FF|app-20190625084649-0151|15|4| END| 5.53|MF partitioner | 0.02| 1350|-1 2019-06-25 08:46:53,912|FF|app-20190625084649-0151|15|4|START| 5.53|Pointset done | 0.00| 0|-1 2019-06-25 08:46:54,998|FF|app-20190625084649-0151|15|4| END| 6.61|Pointset done | 1.09| 4|-1 2019-06-25 08:46:54,998|FF|app-20190625084649-0151|15|4|START| 6.61|Flock Finder run | 0.00| 0|-1 2019-06-25 08:46:55,016|FF|app-20190625084649-0151|15|4|START| 6.63|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:46:55,018|MF|app-20190625084649-0151|15|4|START| 6.63|A.Points indexed | 0.00| 0|0 2019-06-25 08:46:55,247|MF|app-20190625084649-0151|15|4| END| 6.86|A.Points indexed | 0.23| 54279|0 2019-06-25 08:46:55,247|MF|app-20190625084649-0151|15|4|START| 6.86|B.Pairs found | 0.00| 0|0 2019-06-25 08:46:57,010|MF|app-20190625084649-0151|15|4| END| 8.62|B.Pairs found | 1.76| 86157|0 2019-06-25 08:46:57,010|MF|app-20190625084649-0151|15|4|START| 8.62|C.Centers found | 0.00| 0|0 2019-06-25 08:46:59,184|MF|app-20190625084649-0151|15|4| END| 10.80|C.Centers found | 2.17|172314|0 2019-06-25 08:46:59,185|MF|app-20190625084649-0151|15|4|START| 10.80|D.Disks found | 0.00| 0|0 2019-06-25 08:47:04,245|MF|app-20190625084649-0151|15|4| END| 15.86|D.Disks found | 5.06| 67818|0 2019-06-25 08:47:04,245|MF|app-20190625084649-0151|15|4|START| 15.86|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:47:05,468|MF|app-20190625084649-0151|15|4| END| 17.08|E.Disks partitioned | 1.22| 93058|0 2019-06-25 08:47:05,468|MF|app-20190625084649-0151|15|4|START| 17.08|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:47:05,470|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:47:05,470|Cell area: 1055533.7681000116 2019-06-25 08:47:09,920|MF|app-20190625084649-0151|15|4| END| 21.53|F.Maximal disks found | 4.45| 20937|0 2019-06-25 08:47:09,920|MAXIMALS|app-20190625084649-0151|4|15|90.0|3|1350|14.902|20937 2019-06-25 08:47:10,973|FF|app-20190625084649-0151|15|4| END| 22.59|1.Maximal disks found | 15.96| 20937|0 2019-06-25 08:47:10,973|FF|app-20190625084649-0151|15|4|START| 22.59|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:47:10,973|MF|app-20190625084649-0151|15|4|START| 22.59|A.Points indexed | 0.00| 0|1 2019-06-25 08:47:11,128|MF|app-20190625084649-0151|15|4| END| 22.74|A.Points indexed | 0.16| 54735|1 2019-06-25 08:47:11,128|MF|app-20190625084649-0151|15|4|START| 22.74|B.Pairs found | 0.00| 0|1 2019-06-25 08:47:12,306|MF|app-20190625084649-0151|15|4| END| 23.92|B.Pairs found | 1.18| 87324|1 2019-06-25 08:47:12,306|MF|app-20190625084649-0151|15|4|START| 23.92|C.Centers found | 0.00| 0|1 2019-06-25 08:47:14,003|MF|app-20190625084649-0151|15|4| END| 25.62|C.Centers found | 1.70|174648|1 2019-06-25 08:47:14,003|MF|app-20190625084649-0151|15|4|START| 25.62|D.Disks found | 0.00| 0|1 2019-06-25 08:47:21,529|MF|app-20190625084649-0151|15|4| END| 33.14|D.Disks found | 7.53| 68973|1 2019-06-25 08:47:21,529|MF|app-20190625084649-0151|15|4|START| 33.14|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:47:23,387|MF|app-20190625084649-0151|15|4| END| 35.00|E.Disks partitioned | 1.86| 94410|1 2019-06-25 08:47:23,387|MF|app-20190625084649-0151|15|4|START| 35.00|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:47:23,388|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:47:23,388|Cell area: 1055533.7681000116 2019-06-25 08:47:27,976|MF|app-20190625084649-0151|15|4| END| 39.59|F.Maximal disks found | 4.59| 21134|1 2019-06-25 08:47:27,976|MAXIMALS|app-20190625084649-0151|4|15|90.0|3|1350|17.003|21134 2019-06-25 08:47:29,013|FF|app-20190625084649-0151|15|4| END| 40.63|1.Maximal disks found | 18.04| 21134|1 2019-06-25 08:47:29,014|FF|app-20190625084649-0151|15|4|START| 40.63|2.Join done | 0.00| 0|1 2019-06-25 08:47:31,639|FF|app-20190625084649-0151|15|4| END| 43.25|2.Join done | 2.63| 37959|1 2019-06-25 08:47:31,639|FF|app-20190625084649-0151|15|4|START| 43.25|3.Flocks to report | 0.00| 0|1 2019-06-25 08:47:32,170|FF|app-20190625084649-0151|15|4| END| 43.78|3.Flocks to report | 0.53| 0|1 2019-06-25 08:47:32,170|FF|app-20190625084649-0151|15|4|START| 43.78|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:47:32,242|FF|app-20190625084649-0151|15|4| END| 43.86|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 08:47:32,242|FF|app-20190625084649-0151|15|4|START| 43.86|5.Flocks reported | 0.00| 0|1 2019-06-25 08:47:32,247|FF|app-20190625084649-0151|15|4| END| 43.86|5.Flocks reported | 0.01| 0|1 2019-06-25 08:47:32,247|FF|app-20190625084649-0151|15|4|START| 43.86|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:47:33,609|FF|app-20190625084649-0151|15|4| END| 45.22|6.Candidates indexed | 1.36| 39178|1 2019-06-25 08:47:33,609|FF|app-20190625084649-0151|15|4|START| 45.22|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:47:33,609|MF|app-20190625084649-0151|15|4|START| 45.22|A.Points indexed | 0.00| 0|2 2019-06-25 08:47:33,740|MF|app-20190625084649-0151|15|4| END| 45.35|A.Points indexed | 0.13| 55182|2 2019-06-25 08:47:33,741|MF|app-20190625084649-0151|15|4|START| 45.36|B.Pairs found | 0.00| 0|2 2019-06-25 08:47:34,602|MF|app-20190625084649-0151|15|4| END| 46.22|B.Pairs found | 0.86| 88509|2 2019-06-25 08:47:34,603|MF|app-20190625084649-0151|15|4|START| 46.22|C.Centers found | 0.00| 0|2 2019-06-25 08:47:35,651|MF|app-20190625084649-0151|15|4| END| 47.27|C.Centers found | 1.05|177018|2 2019-06-25 08:47:35,651|MF|app-20190625084649-0151|15|4|START| 47.27|D.Disks found | 0.00| 0|2 2019-06-25 08:47:38,863|MF|app-20190625084649-0151|15|4| END| 50.48|D.Disks found | 3.21| 69927|2 2019-06-25 08:47:38,864|MF|app-20190625084649-0151|15|4|START| 50.48|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:47:39,889|MF|app-20190625084649-0151|15|4| END| 51.50|E.Disks partitioned | 1.03| 95823|2 2019-06-25 08:47:39,889|MF|app-20190625084649-0151|15|4|START| 51.50|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:47:39,890|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:47:39,890|Cell area: 1055533.7681000116 2019-06-25 08:47:44,016|MF|app-20190625084649-0151|15|4| END| 55.63|F.Maximal disks found | 4.13| 21483|2 2019-06-25 08:47:44,016|MAXIMALS|app-20190625084649-0151|4|15|90.0|3|1350|10.407|21483 2019-06-25 08:47:45,063|FF|app-20190625084649-0151|15|4| END| 56.68|1.Maximal disks found | 11.45| 21483|2 2019-06-25 08:47:45,063|FF|app-20190625084649-0151|15|4|START| 56.68|2.Join done | 0.00| 0|2 2019-06-25 08:47:51,937|FF|app-20190625084649-0151|15|4| END| 63.55|2.Join done | 6.87| 60752|2 2019-06-25 08:47:51,937|FF|app-20190625084649-0151|15|4|START| 63.55|3.Flocks to report | 0.00| 0|2 2019-06-25 08:47:53,364|FF|app-20190625084649-0151|15|4| END| 64.98|3.Flocks to report | 1.43| 52714|2 2019-06-25 08:47:53,364|FF|app-20190625084649-0151|15|4|START| 64.98|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:47:53,440|FF|app-20190625084649-0151|15|4|START| 65.05|4a.Making expansions | 0.00| 0|2 2019-06-25 08:47:54,233|FF|app-20190625084649-0151|15|4| END| 65.85|4a.Making expansions | 0.79| 65780|2 2019-06-25 08:47:54,233|FF|app-20190625084649-0151|15|4|START| 65.85|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:47:57,730|FF|app-20190625084649-0151|15|4| END| 69.34|4b.Finding maximals | 3.50| 14592|2 2019-06-25 08:47:58,182|FF|app-20190625084649-0151|15|4| END| 69.80|4.Flocks prunned by expansion | 4.82| 14592|2 2019-06-25 08:47:58,182|FF|app-20190625084649-0151|15|4|START| 69.80|5.Flocks reported | 0.00| 0|2 2019-06-25 08:47:58,753|FF|app-20190625084649-0151|15|4| END| 70.37|5.Flocks reported | 0.57| 14592|2 2019-06-25 08:47:58,754|FF|app-20190625084649-0151|15|4|START| 70.37|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:48:00,418|FF|app-20190625084649-0151|15|4| END| 72.03|6.Candidates indexed | 1.67| 23966|2 2019-06-25 08:48:00,418|FF|app-20190625084649-0151|15|4|START| 72.03|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:48:00,418|MF|app-20190625084649-0151|15|4|START| 72.03|A.Points indexed | 0.00| 0|3 2019-06-25 08:48:00,529|MF|app-20190625084649-0151|15|4| END| 72.14|A.Points indexed | 0.11| 55644|3 2019-06-25 08:48:00,529|MF|app-20190625084649-0151|15|4|START| 72.14|B.Pairs found | 0.00| 0|3 2019-06-25 08:48:01,610|MF|app-20190625084649-0151|15|4| END| 73.22|B.Pairs found | 1.08| 90000|3 2019-06-25 08:48:01,610|MF|app-20190625084649-0151|15|4|START| 73.22|C.Centers found | 0.00| 0|3 2019-06-25 08:48:02,545|MF|app-20190625084649-0151|15|4| END| 74.16|C.Centers found | 0.94|180000|3 2019-06-25 08:48:02,546|MF|app-20190625084649-0151|15|4|START| 74.16|D.Disks found | 0.00| 0|3 2019-06-25 08:48:08,734|MF|app-20190625084649-0151|15|4| END| 80.35|D.Disks found | 6.19| 71127|3 2019-06-25 08:48:08,734|MF|app-20190625084649-0151|15|4|START| 80.35|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:48:10,398|MF|app-20190625084649-0151|15|4| END| 82.01|E.Disks partitioned | 1.66| 97462|3 2019-06-25 08:48:10,398|MF|app-20190625084649-0151|15|4|START| 82.01|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:48:10,399|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:48:10,399|Cell area: 1055533.7681000116 2019-06-25 08:48:15,219|MF|app-20190625084649-0151|15|4| END| 86.83|F.Maximal disks found | 4.82| 21988|3 2019-06-25 08:48:15,219|MAXIMALS|app-20190625084649-0151|4|15|90.0|3|1350|14.801|21988 2019-06-25 08:48:16,218|FF|app-20190625084649-0151|15|4| END| 87.83|1.Maximal disks found | 15.80| 21988|3 2019-06-25 08:48:16,218|FF|app-20190625084649-0151|15|4|START| 87.83|2.Join done | 0.00| 0|3 2019-06-25 08:48:23,769|FF|app-20190625084649-0151|15|4| END| 95.38|2.Join done | 7.55| 56919|3 2019-06-25 08:48:23,769|FF|app-20190625084649-0151|15|4|START| 95.38|3.Flocks to report | 0.00| 0|3 2019-06-25 08:48:26,689|FF|app-20190625084649-0151|15|4| END| 98.30|3.Flocks to report | 2.92| 48321|3 2019-06-25 08:48:26,689|FF|app-20190625084649-0151|15|4|START| 98.30|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:48:26,824|FF|app-20190625084649-0151|15|4|START| 98.44|4a.Making expansions | 0.00| 0|3 2019-06-25 08:48:28,052|FF|app-20190625084649-0151|15|4| END| 99.67|4a.Making expansions | 1.23| 61660|3 2019-06-25 08:48:28,052|FF|app-20190625084649-0151|15|4|START| 99.67|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:48:30,340|FF|app-20190625084649-0151|15|4| END|101.95|4b.Finding maximals | 2.29| 14847|3 2019-06-25 08:48:30,852|FF|app-20190625084649-0151|15|4| END|102.47|4.Flocks prunned by expansion | 4.16| 14847|3 2019-06-25 08:48:30,853|FF|app-20190625084649-0151|15|4|START|102.47|5.Flocks reported | 0.00| 0|3 2019-06-25 08:48:31,513|FF|app-20190625084649-0151|15|4| END|103.13|5.Flocks reported | 0.66| 14847|3 2019-06-25 08:48:31,513|FF|app-20190625084649-0151|15|4|START|103.13|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:48:33,543|FF|app-20190625084649-0151|15|4| END|105.16|6.Candidates indexed | 2.03| 24850|3 2019-06-25 08:48:34,883|Number of flocks: 29439 2019-06-25 08:48:35,859|PFLOCK|app-20190625084649-0151|4|15|90.0|3|3|99.89|29439 2019-06-25 08:48:36,829|FF|app-20190625084649-0151|15|4| END|108.44|Flock Finder run |101.83| 29439|3 2019-06-25 08:48:36,829|FF|app-20190625084649-0151|15|4|START|108.44|Session closed | 0.00| 0|3 2019-06-25 08:48:44,299|FF|app-20190625084649-0151|15|4| END|115.91|Session closed | 7.47| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:48:46,257|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:48:47,344|FF|app-20190625084847-0152|10|4| END| 1.07|Session start | 1.09| 0|-1 2019-06-25 08:48:47,345|FF|app-20190625084847-0152|10|4|START| 1.07|Data read | 0.00| 0|-1 2019-06-25 08:48:51,395|FF|app-20190625084847-0152|10|4| END| 5.12|Data read | 4.05|220752|-1 2019-06-25 08:48:51,395|FF|app-20190625084847-0152|10|4|START| 5.12|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:48:51,601|FF|app-20190625084847-0152|10|4| END| 5.33|KDBTree partitioner | 0.21| 544|-1 2019-06-25 08:48:51,601|FF|app-20190625084847-0152|10|4|START| 5.33|MF partitioner | 0.00| 0|-1 2019-06-25 08:48:51,631|FF|app-20190625084847-0152|10|4| END| 5.36|MF partitioner | 0.03| 900|-1 2019-06-25 08:48:51,632|FF|app-20190625084847-0152|10|4|START| 5.36|Pointset done | 0.00| 0|-1 2019-06-25 08:48:52,839|FF|app-20190625084847-0152|10|4| END| 6.57|Pointset done | 1.21| 4|-1 2019-06-25 08:48:52,839|FF|app-20190625084847-0152|10|4|START| 6.57|Flock Finder run | 0.00| 0|-1 2019-06-25 08:48:52,856|FF|app-20190625084847-0152|10|4|START| 6.58|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:48:52,858|MF|app-20190625084847-0152|10|4|START| 6.59|A.Points indexed | 0.00| 0|0 2019-06-25 08:48:53,039|MF|app-20190625084847-0152|10|4| END| 6.77|A.Points indexed | 0.18| 36186|0 2019-06-25 08:48:53,039|MF|app-20190625084847-0152|10|4|START| 6.77|B.Pairs found | 0.00| 0|0 2019-06-25 08:48:55,094|MF|app-20190625084847-0152|10|4| END| 8.82|B.Pairs found | 2.06| 57438|0 2019-06-25 08:48:55,094|MF|app-20190625084847-0152|10|4|START| 8.82|C.Centers found | 0.00| 0|0 2019-06-25 08:48:56,997|MF|app-20190625084847-0152|10|4| END| 10.72|C.Centers found | 1.90|114876|0 2019-06-25 08:48:56,997|MF|app-20190625084847-0152|10|4|START| 10.72|D.Disks found | 0.00| 0|0 2019-06-25 08:49:04,422|MF|app-20190625084847-0152|10|4| END| 18.15|D.Disks found | 7.43| 45212|0 2019-06-25 08:49:04,423|MF|app-20190625084847-0152|10|4|START| 18.15|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:49:07,854|MF|app-20190625084847-0152|10|4| END| 21.58|E.Disks partitioned | 3.43| 62040|0 2019-06-25 08:49:07,854|MF|app-20190625084847-0152|10|4|START| 21.58|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:49:07,856|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:49:07,856|Cell area: 1055533.7681000116 2019-06-25 08:49:14,159|MF|app-20190625084847-0152|10|4| END| 27.89|F.Maximal disks found | 6.31| 13955|0 2019-06-25 08:49:14,159|MAXIMALS|app-20190625084847-0152|4|10|90.0|3|900|21.301|13955 2019-06-25 08:49:15,726|FF|app-20190625084847-0152|10|4| END| 29.45|1.Maximal disks found | 22.87| 13955|0 2019-06-25 08:49:15,726|FF|app-20190625084847-0152|10|4|START| 29.45|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:49:15,726|MF|app-20190625084847-0152|10|4|START| 29.45|A.Points indexed | 0.00| 0|1 2019-06-25 08:49:15,827|MF|app-20190625084847-0152|10|4| END| 29.55|A.Points indexed | 0.10| 36490|1 2019-06-25 08:49:15,827|MF|app-20190625084847-0152|10|4|START| 29.55|B.Pairs found | 0.00| 0|1 2019-06-25 08:49:16,976|MF|app-20190625084847-0152|10|4| END| 30.70|B.Pairs found | 1.15| 58216|1 2019-06-25 08:49:16,976|MF|app-20190625084847-0152|10|4|START| 30.70|C.Centers found | 0.00| 0|1 2019-06-25 08:49:18,417|MF|app-20190625084847-0152|10|4| END| 32.14|C.Centers found | 1.44|116432|1 2019-06-25 08:49:18,417|MF|app-20190625084847-0152|10|4|START| 32.14|D.Disks found | 0.00| 0|1 2019-06-25 08:49:23,840|MF|app-20190625084847-0152|10|4| END| 37.57|D.Disks found | 5.42| 45982|1 2019-06-25 08:49:23,841|MF|app-20190625084847-0152|10|4|START| 37.57|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:49:25,778|MF|app-20190625084847-0152|10|4| END| 39.51|E.Disks partitioned | 1.94| 62923|1 2019-06-25 08:49:25,778|MF|app-20190625084847-0152|10|4|START| 39.51|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:49:25,779|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:49:25,779|Cell area: 1055533.7681000116 2019-06-25 08:49:30,555|MF|app-20190625084847-0152|10|4| END| 44.28|F.Maximal disks found | 4.78| 14084|1 2019-06-25 08:49:30,555|MAXIMALS|app-20190625084847-0152|4|10|90.0|3|900|14.829|14084 2019-06-25 08:49:31,580|FF|app-20190625084847-0152|10|4| END| 45.31|1.Maximal disks found | 15.85| 14084|1 2019-06-25 08:49:31,580|FF|app-20190625084847-0152|10|4|START| 45.31|2.Join done | 0.00| 0|1 2019-06-25 08:49:36,435|FF|app-20190625084847-0152|10|4| END| 50.16|2.Join done | 4.86| 25295|1 2019-06-25 08:49:36,435|FF|app-20190625084847-0152|10|4|START| 50.16|3.Flocks to report | 0.00| 0|1 2019-06-25 08:49:37,273|FF|app-20190625084847-0152|10|4| END| 51.00|3.Flocks to report | 0.84| 0|1 2019-06-25 08:49:37,273|FF|app-20190625084847-0152|10|4|START| 51.00|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:49:37,332|FF|app-20190625084847-0152|10|4| END| 51.06|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 08:49:37,332|FF|app-20190625084847-0152|10|4|START| 51.06|5.Flocks reported | 0.00| 0|1 2019-06-25 08:49:37,337|FF|app-20190625084847-0152|10|4| END| 51.06|5.Flocks reported | 0.01| 0|1 2019-06-25 08:49:37,337|FF|app-20190625084847-0152|10|4|START| 51.06|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:49:39,207|FF|app-20190625084847-0152|10|4| END| 52.93|6.Candidates indexed | 1.87| 26108|1 2019-06-25 08:49:39,208|FF|app-20190625084847-0152|10|4|START| 52.94|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:49:39,208|MF|app-20190625084847-0152|10|4|START| 52.94|A.Points indexed | 0.00| 0|2 2019-06-25 08:49:39,307|MF|app-20190625084847-0152|10|4| END| 53.03|A.Points indexed | 0.10| 36788|2 2019-06-25 08:49:39,307|MF|app-20190625084847-0152|10|4|START| 53.03|B.Pairs found | 0.00| 0|2 2019-06-25 08:49:40,255|MF|app-20190625084847-0152|10|4| END| 53.98|B.Pairs found | 0.95| 59006|2 2019-06-25 08:49:40,255|MF|app-20190625084847-0152|10|4|START| 53.98|C.Centers found | 0.00| 0|2 2019-06-25 08:49:41,358|MF|app-20190625084847-0152|10|4| END| 55.09|C.Centers found | 1.10|118012|2 2019-06-25 08:49:41,359|MF|app-20190625084847-0152|10|4|START| 55.09|D.Disks found | 0.00| 0|2 2019-06-25 08:49:45,435|MF|app-20190625084847-0152|10|4| END| 59.16|D.Disks found | 4.08| 46618|2 2019-06-25 08:49:45,436|MF|app-20190625084847-0152|10|4|START| 59.16|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:49:46,940|MF|app-20190625084847-0152|10|4| END| 60.67|E.Disks partitioned | 1.51| 63871|2 2019-06-25 08:49:46,941|MF|app-20190625084847-0152|10|4|START| 60.67|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:49:46,941|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:49:46,941|Cell area: 1055533.7681000116 2019-06-25 08:49:51,417|MF|app-20190625084847-0152|10|4| END| 65.14|F.Maximal disks found | 4.48| 14320|2 2019-06-25 08:49:51,417|MAXIMALS|app-20190625084847-0152|4|10|90.0|3|900|12.209|14320 2019-06-25 08:49:52,198|FF|app-20190625084847-0152|10|4| END| 65.93|1.Maximal disks found | 12.99| 14320|2 2019-06-25 08:49:52,198|FF|app-20190625084847-0152|10|4|START| 65.93|2.Join done | 0.00| 0|2 2019-06-25 08:49:57,822|FF|app-20190625084847-0152|10|4| END| 71.55|2.Join done | 5.62| 40482|2 2019-06-25 08:49:57,822|FF|app-20190625084847-0152|10|4|START| 71.55|3.Flocks to report | 0.00| 0|2 2019-06-25 08:49:59,052|FF|app-20190625084847-0152|10|4| END| 72.78|3.Flocks to report | 1.23| 35128|2 2019-06-25 08:49:59,052|FF|app-20190625084847-0152|10|4|START| 72.78|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:49:59,109|FF|app-20190625084847-0152|10|4|START| 72.84|4a.Making expansions | 0.00| 0|2 2019-06-25 08:49:59,975|FF|app-20190625084847-0152|10|4| END| 73.70|4a.Making expansions | 0.87| 43823|2 2019-06-25 08:49:59,975|FF|app-20190625084847-0152|10|4|START| 73.70|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:50:03,066|FF|app-20190625084847-0152|10|4| END| 76.79|4b.Finding maximals | 3.09| 9728|2 2019-06-25 08:50:03,429|FF|app-20190625084847-0152|10|4| END| 77.16|4.Flocks prunned by expansion | 4.38| 9728|2 2019-06-25 08:50:03,429|FF|app-20190625084847-0152|10|4|START| 77.16|5.Flocks reported | 0.00| 0|2 2019-06-25 08:50:03,868|FF|app-20190625084847-0152|10|4| END| 77.60|5.Flocks reported | 0.44| 9728|2 2019-06-25 08:50:03,868|FF|app-20190625084847-0152|10|4|START| 77.60|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:50:05,439|FF|app-20190625084847-0152|10|4| END| 79.17|6.Candidates indexed | 1.57| 15972|2 2019-06-25 08:50:05,439|FF|app-20190625084847-0152|10|4|START| 79.17|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:50:05,439|MF|app-20190625084847-0152|10|4|START| 79.17|A.Points indexed | 0.00| 0|3 2019-06-25 08:50:05,523|MF|app-20190625084847-0152|10|4| END| 79.25|A.Points indexed | 0.08| 37096|3 2019-06-25 08:50:05,523|MF|app-20190625084847-0152|10|4|START| 79.25|B.Pairs found | 0.00| 0|3 2019-06-25 08:50:06,367|MF|app-20190625084847-0152|10|4| END| 80.09|B.Pairs found | 0.84| 60000|3 2019-06-25 08:50:06,368|MF|app-20190625084847-0152|10|4|START| 80.10|C.Centers found | 0.00| 0|3 2019-06-25 08:50:07,395|MF|app-20190625084847-0152|10|4| END| 81.12|C.Centers found | 1.03|120000|3 2019-06-25 08:50:07,395|MF|app-20190625084847-0152|10|4|START| 81.12|D.Disks found | 0.00| 0|3 2019-06-25 08:50:11,251|MF|app-20190625084847-0152|10|4| END| 84.98|D.Disks found | 3.86| 47418|3 2019-06-25 08:50:11,251|MF|app-20190625084847-0152|10|4|START| 84.98|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:50:12,727|MF|app-20190625084847-0152|10|4| END| 86.45|E.Disks partitioned | 1.48| 64956|3 2019-06-25 08:50:12,727|MF|app-20190625084847-0152|10|4|START| 86.45|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:50:12,727|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:50:12,727|Cell area: 1055533.7681000116 2019-06-25 08:50:17,463|MF|app-20190625084847-0152|10|4| END| 91.19|F.Maximal disks found | 4.74| 14656|3 2019-06-25 08:50:17,463|MAXIMALS|app-20190625084847-0152|4|10|90.0|3|900|12.024|14656 2019-06-25 08:50:18,170|FF|app-20190625084847-0152|10|4| END| 91.90|1.Maximal disks found | 12.73| 14656|3 2019-06-25 08:50:18,170|FF|app-20190625084847-0152|10|4|START| 91.90|2.Join done | 0.00| 0|3 2019-06-25 08:50:22,211|FF|app-20190625084847-0152|10|4| END| 95.94|2.Join done | 4.04| 37922|3 2019-06-25 08:50:22,211|FF|app-20190625084847-0152|10|4|START| 95.94|3.Flocks to report | 0.00| 0|3 2019-06-25 08:50:23,123|FF|app-20190625084847-0152|10|4| END| 96.85|3.Flocks to report | 0.91| 32202|3 2019-06-25 08:50:23,123|FF|app-20190625084847-0152|10|4|START| 96.85|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:50:23,184|FF|app-20190625084847-0152|10|4|START| 96.91|4a.Making expansions | 0.00| 0|3 2019-06-25 08:50:24,008|FF|app-20190625084847-0152|10|4| END| 97.74|4a.Making expansions | 0.82| 41032|3 2019-06-25 08:50:24,008|FF|app-20190625084847-0152|10|4|START| 97.74|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:50:26,006|FF|app-20190625084847-0152|10|4| END| 99.73|4b.Finding maximals | 2.00| 9898|3 2019-06-25 08:50:26,344|FF|app-20190625084847-0152|10|4| END|100.07|4.Flocks prunned by expansion | 3.22| 9898|3 2019-06-25 08:50:26,344|FF|app-20190625084847-0152|10|4|START|100.07|5.Flocks reported | 0.00| 0|3 2019-06-25 08:50:26,789|FF|app-20190625084847-0152|10|4| END|100.52|5.Flocks reported | 0.45| 9898|3 2019-06-25 08:50:26,789|FF|app-20190625084847-0152|10|4|START|100.52|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:50:28,445|FF|app-20190625084847-0152|10|4| END|102.17|6.Candidates indexed | 1.66| 16555|3 2019-06-25 08:50:29,603|Number of flocks: 19626 2019-06-25 08:50:30,327|PFLOCK|app-20190625084847-0152|4|10|90.0|3|3|96.76|19626 2019-06-25 08:50:31,064|FF|app-20190625084847-0152|10|4| END|104.79|Flock Finder run | 98.23| 19626|3 2019-06-25 08:50:31,064|FF|app-20190625084847-0152|10|4|START|104.79|Session closed | 0.00| 0|3 2019-06-25 08:50:37,802|FF|app-20190625084847-0152|10|4| END|111.53|Session closed | 6.74| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:50:39,740|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:50:40,850|FF|app-20190625085040-0153|5|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 08:50:40,850|FF|app-20190625085040-0153|5|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 08:50:44,686|FF|app-20190625085040-0153|5|4| END| 4.93|Data read | 3.84|110376|-1 2019-06-25 08:50:44,686|FF|app-20190625085040-0153|5|4|START| 4.93|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:50:44,815|FF|app-20190625085040-0153|5|4| END| 5.06|KDBTree partitioner | 0.13| 272|-1 2019-06-25 08:50:44,816|FF|app-20190625085040-0153|5|4|START| 5.06|MF partitioner | 0.00| 0|-1 2019-06-25 08:50:44,832|FF|app-20190625085040-0153|5|4| END| 5.08|MF partitioner | 0.02| 450|-1 2019-06-25 08:50:44,832|FF|app-20190625085040-0153|5|4|START| 5.08|Pointset done | 0.00| 0|-1 2019-06-25 08:50:45,713|FF|app-20190625085040-0153|5|4| END| 5.96|Pointset done | 0.88| 4|-1 2019-06-25 08:50:45,713|FF|app-20190625085040-0153|5|4|START| 5.96|Flock Finder run | 0.00| 0|-1 2019-06-25 08:50:45,735|FF|app-20190625085040-0153|5|4|START| 5.98|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:50:45,738|MF|app-20190625085040-0153|5|4|START| 5.98|A.Points indexed | 0.00| 0|0 2019-06-25 08:50:45,879|MF|app-20190625085040-0153|5|4| END| 6.12|A.Points indexed | 0.14| 18093|0 2019-06-25 08:50:45,880|MF|app-20190625085040-0153|5|4|START| 6.12|B.Pairs found | 0.00| 0|0 2019-06-25 08:50:47,104|MF|app-20190625085040-0153|5|4| END| 7.35|B.Pairs found | 1.22| 28719|0 2019-06-25 08:50:47,104|MF|app-20190625085040-0153|5|4|START| 7.35|C.Centers found | 0.00| 0|0 2019-06-25 08:50:47,864|MF|app-20190625085040-0153|5|4| END| 8.11|C.Centers found | 0.76| 57438|0 2019-06-25 08:50:47,865|MF|app-20190625085040-0153|5|4|START| 8.11|D.Disks found | 0.00| 0|0 2019-06-25 08:50:50,697|MF|app-20190625085040-0153|5|4| END| 10.94|D.Disks found | 2.83| 22606|0 2019-06-25 08:50:50,697|MF|app-20190625085040-0153|5|4|START| 10.94|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:50:51,737|MF|app-20190625085040-0153|5|4| END| 11.98|E.Disks partitioned | 1.04| 31017|0 2019-06-25 08:50:51,737|MF|app-20190625085040-0153|5|4|START| 11.98|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:50:51,738|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:50:51,738|Cell area: 1055533.7681000116 2019-06-25 08:50:56,027|MF|app-20190625085040-0153|5|4| END| 16.27|F.Maximal disks found | 4.29| 6974|0 2019-06-25 08:50:56,027|MAXIMALS|app-20190625085040-0153|4|5|90.0|3|450|10.29|6974 2019-06-25 08:50:56,507|FF|app-20190625085040-0153|5|4| END| 16.75|1.Maximal disks found | 10.77| 6974|0 2019-06-25 08:50:56,508|FF|app-20190625085040-0153|5|4|START| 16.75|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:50:56,508|MF|app-20190625085040-0153|5|4|START| 16.75|A.Points indexed | 0.00| 0|1 2019-06-25 08:50:56,586|MF|app-20190625085040-0153|5|4| END| 16.83|A.Points indexed | 0.08| 18245|1 2019-06-25 08:50:56,586|MF|app-20190625085040-0153|5|4|START| 16.83|B.Pairs found | 0.00| 0|1 2019-06-25 08:50:57,014|MF|app-20190625085040-0153|5|4| END| 17.26|B.Pairs found | 0.43| 29108|1 2019-06-25 08:50:57,014|MF|app-20190625085040-0153|5|4|START| 17.26|C.Centers found | 0.00| 0|1 2019-06-25 08:50:57,390|MF|app-20190625085040-0153|5|4| END| 17.63|C.Centers found | 0.38| 58216|1 2019-06-25 08:50:57,390|MF|app-20190625085040-0153|5|4|START| 17.63|D.Disks found | 0.00| 0|1 2019-06-25 08:50:59,357|MF|app-20190625085040-0153|5|4| END| 19.60|D.Disks found | 1.97| 22991|1 2019-06-25 08:50:59,357|MF|app-20190625085040-0153|5|4|START| 19.60|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:51:00,143|MF|app-20190625085040-0153|5|4| END| 20.39|E.Disks partitioned | 0.79| 31459|1 2019-06-25 08:51:00,143|MF|app-20190625085040-0153|5|4|START| 20.39|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:51:00,143|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:51:00,143|Cell area: 1055533.7681000116 2019-06-25 08:51:04,128|MF|app-20190625085040-0153|5|4| END| 24.37|F.Maximal disks found | 3.99| 7040|1 2019-06-25 08:51:04,128|MAXIMALS|app-20190625085040-0153|4|5|90.0|3|450|7.62|7040 2019-06-25 08:51:04,572|FF|app-20190625085040-0153|5|4| END| 24.82|1.Maximal disks found | 8.06| 7040|1 2019-06-25 08:51:04,573|FF|app-20190625085040-0153|5|4|START| 24.82|2.Join done | 0.00| 0|1 2019-06-25 08:51:06,521|FF|app-20190625085040-0153|5|4| END| 26.76|2.Join done | 1.95| 12653|1 2019-06-25 08:51:06,521|FF|app-20190625085040-0153|5|4|START| 26.76|3.Flocks to report | 0.00| 0|1 2019-06-25 08:51:06,919|FF|app-20190625085040-0153|5|4| END| 27.16|3.Flocks to report | 0.40| 0|1 2019-06-25 08:51:06,920|FF|app-20190625085040-0153|5|4|START| 27.16|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:51:06,956|FF|app-20190625085040-0153|5|4| END| 27.20|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 08:51:06,956|FF|app-20190625085040-0153|5|4|START| 27.20|5.Flocks reported | 0.00| 0|1 2019-06-25 08:51:06,960|FF|app-20190625085040-0153|5|4| END| 27.20|5.Flocks reported | 0.00| 0|1 2019-06-25 08:51:06,961|FF|app-20190625085040-0153|5|4|START| 27.20|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:51:08,273|FF|app-20190625085040-0153|5|4| END| 28.52|6.Candidates indexed | 1.31| 13060|1 2019-06-25 08:51:08,273|FF|app-20190625085040-0153|5|4|START| 28.52|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:51:08,273|MF|app-20190625085040-0153|5|4|START| 28.52|A.Points indexed | 0.00| 0|2 2019-06-25 08:51:08,336|MF|app-20190625085040-0153|5|4| END| 28.58|A.Points indexed | 0.06| 18394|2 2019-06-25 08:51:08,336|MF|app-20190625085040-0153|5|4|START| 28.58|B.Pairs found | 0.00| 0|2 2019-06-25 08:51:08,915|MF|app-20190625085040-0153|5|4| END| 29.16|B.Pairs found | 0.58| 29503|2 2019-06-25 08:51:08,915|MF|app-20190625085040-0153|5|4|START| 29.16|C.Centers found | 0.00| 0|2 2019-06-25 08:51:09,323|MF|app-20190625085040-0153|5|4| END| 29.57|C.Centers found | 0.41| 59006|2 2019-06-25 08:51:09,323|MF|app-20190625085040-0153|5|4|START| 29.57|D.Disks found | 0.00| 0|2 2019-06-25 08:51:11,443|MF|app-20190625085040-0153|5|4| END| 31.69|D.Disks found | 2.12| 23309|2 2019-06-25 08:51:11,443|MF|app-20190625085040-0153|5|4|START| 31.69|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:51:12,146|MF|app-20190625085040-0153|5|4| END| 32.39|E.Disks partitioned | 0.70| 31937|2 2019-06-25 08:51:12,146|MF|app-20190625085040-0153|5|4|START| 32.39|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:51:12,147|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:51:12,147|Cell area: 1055533.7681000116 2019-06-25 08:51:16,162|MF|app-20190625085040-0153|5|4| END| 36.41|F.Maximal disks found | 4.02| 7158|2 2019-06-25 08:51:16,162|MAXIMALS|app-20190625085040-0153|4|5|90.0|3|450|7.889|7158 2019-06-25 08:51:16,570|FF|app-20190625085040-0153|5|4| END| 36.81|1.Maximal disks found | 8.30| 7158|2 2019-06-25 08:51:16,571|FF|app-20190625085040-0153|5|4|START| 36.81|2.Join done | 0.00| 0|2 2019-06-25 08:51:23,112|FF|app-20190625085040-0153|5|4| END| 43.36|2.Join done | 6.54| 20251|2 2019-06-25 08:51:23,112|FF|app-20190625085040-0153|5|4|START| 43.36|3.Flocks to report | 0.00| 0|2 2019-06-25 08:51:24,474|FF|app-20190625085040-0153|5|4| END| 44.72|3.Flocks to report | 1.36| 17573|2 2019-06-25 08:51:24,474|FF|app-20190625085040-0153|5|4|START| 44.72|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:51:24,530|FF|app-20190625085040-0153|5|4|START| 44.77|4a.Making expansions | 0.00| 0|2 2019-06-25 08:51:25,491|FF|app-20190625085040-0153|5|4| END| 45.73|4a.Making expansions | 0.96| 21978|2 2019-06-25 08:51:25,491|FF|app-20190625085040-0153|5|4|START| 45.73|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:51:28,595|FF|app-20190625085040-0153|5|4| END| 48.84|4b.Finding maximals | 3.10| 4864|2 2019-06-25 08:51:28,941|FF|app-20190625085040-0153|5|4| END| 49.18|4.Flocks prunned by expansion | 4.47| 4864|2 2019-06-25 08:51:28,941|FF|app-20190625085040-0153|5|4|START| 49.18|5.Flocks reported | 0.00| 0|2 2019-06-25 08:51:29,431|FF|app-20190625085040-0153|5|4| END| 49.67|5.Flocks reported | 0.49| 4864|2 2019-06-25 08:51:29,431|FF|app-20190625085040-0153|5|4|START| 49.67|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:51:31,979|FF|app-20190625085040-0153|5|4| END| 52.22|6.Candidates indexed | 2.55| 7987|2 2019-06-25 08:51:31,979|FF|app-20190625085040-0153|5|4|START| 52.22|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:51:31,979|MF|app-20190625085040-0153|5|4|START| 52.22|A.Points indexed | 0.00| 0|3 2019-06-25 08:51:32,039|MF|app-20190625085040-0153|5|4| END| 52.28|A.Points indexed | 0.06| 18548|3 2019-06-25 08:51:32,039|MF|app-20190625085040-0153|5|4|START| 52.28|B.Pairs found | 0.00| 0|3 2019-06-25 08:51:32,618|MF|app-20190625085040-0153|5|4| END| 52.86|B.Pairs found | 0.58| 30000|3 2019-06-25 08:51:32,618|MF|app-20190625085040-0153|5|4|START| 52.86|C.Centers found | 0.00| 0|3 2019-06-25 08:51:33,252|MF|app-20190625085040-0153|5|4| END| 53.50|C.Centers found | 0.63| 60000|3 2019-06-25 08:51:33,252|MF|app-20190625085040-0153|5|4|START| 53.50|D.Disks found | 0.00| 0|3 2019-06-25 08:51:36,160|MF|app-20190625085040-0153|5|4| END| 56.40|D.Disks found | 2.91| 23709|3 2019-06-25 08:51:36,161|MF|app-20190625085040-0153|5|4|START| 56.40|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:51:37,012|MF|app-20190625085040-0153|5|4| END| 57.26|E.Disks partitioned | 0.85| 32468|3 2019-06-25 08:51:37,012|MF|app-20190625085040-0153|5|4|START| 57.26|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:51:37,012|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:51:37,013|Cell area: 1055533.7681000116 2019-06-25 08:51:41,394|MF|app-20190625085040-0153|5|4| END| 61.64|F.Maximal disks found | 4.38| 7325|3 2019-06-25 08:51:41,394|MAXIMALS|app-20190625085040-0153|4|5|90.0|3|450|9.415|7325 2019-06-25 08:51:41,841|FF|app-20190625085040-0153|5|4| END| 62.08|1.Maximal disks found | 9.86| 7325|3 2019-06-25 08:51:41,841|FF|app-20190625085040-0153|5|4|START| 62.08|2.Join done | 0.00| 0|3 2019-06-25 08:51:44,804|FF|app-20190625085040-0153|5|4| END| 65.05|2.Join done | 2.96| 18964|3 2019-06-25 08:51:44,805|FF|app-20190625085040-0153|5|4|START| 65.05|3.Flocks to report | 0.00| 0|3 2019-06-25 08:51:45,437|FF|app-20190625085040-0153|5|4| END| 65.68|3.Flocks to report | 0.63| 16099|3 2019-06-25 08:51:45,437|FF|app-20190625085040-0153|5|4|START| 65.68|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:51:45,484|FF|app-20190625085040-0153|5|4|START| 65.73|4a.Making expansions | 0.00| 0|3 2019-06-25 08:51:46,060|FF|app-20190625085040-0153|5|4| END| 66.30|4a.Making expansions | 0.58| 20521|3 2019-06-25 08:51:46,060|FF|app-20190625085040-0153|5|4|START| 66.30|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:51:47,993|FF|app-20190625085040-0153|5|4| END| 68.24|4b.Finding maximals | 1.93| 4949|3 2019-06-25 08:51:48,186|FF|app-20190625085040-0153|5|4| END| 68.43|4.Flocks prunned by expansion | 2.75| 4949|3 2019-06-25 08:51:48,186|FF|app-20190625085040-0153|5|4|START| 68.43|5.Flocks reported | 0.00| 0|3 2019-06-25 08:51:48,483|FF|app-20190625085040-0153|5|4| END| 68.73|5.Flocks reported | 0.30| 4949|3 2019-06-25 08:51:48,484|FF|app-20190625085040-0153|5|4|START| 68.73|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:51:50,065|FF|app-20190625085040-0153|5|4| END| 70.31|6.Candidates indexed | 1.58| 8283|3 2019-06-25 08:51:50,784|Number of flocks: 9813 2019-06-25 08:51:51,161|PFLOCK|app-20190625085040-0153|4|5|90.0|3|3|65.07|9813 2019-06-25 08:51:51,545|FF|app-20190625085040-0153|5|4| END| 71.79|Flock Finder run | 65.83| 9813|3 2019-06-25 08:51:51,545|FF|app-20190625085040-0153|5|4|START| 71.79|Session closed | 0.00| 0|3 2019-06-25 08:51:58,470|FF|app-20190625085040-0153|5|4| END| 78.71|Session closed | 6.93| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:52:00,441|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:52:01,548|FF|app-20190625085201-0154|15|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 08:52:01,549|FF|app-20190625085201-0154|15|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 08:52:05,711|FF|app-20190625085201-0154|15|4| END| 5.25|Data read | 4.16|331128|-1 2019-06-25 08:52:05,712|FF|app-20190625085201-0154|15|4|START| 5.25|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:52:06,123|FF|app-20190625085201-0154|15|4| END| 5.66|KDBTree partitioner | 0.41| 816|-1 2019-06-25 08:52:06,123|FF|app-20190625085201-0154|15|4|START| 5.67|MF partitioner | 0.00| 0|-1 2019-06-25 08:52:06,142|FF|app-20190625085201-0154|15|4| END| 5.68|MF partitioner | 0.02| 1350|-1 2019-06-25 08:52:06,142|FF|app-20190625085201-0154|15|4|START| 5.68|Pointset done | 0.00| 0|-1 2019-06-25 08:52:07,348|FF|app-20190625085201-0154|15|4| END| 6.89|Pointset done | 1.21| 4|-1 2019-06-25 08:52:07,348|FF|app-20190625085201-0154|15|4|START| 6.89|Flock Finder run | 0.00| 0|-1 2019-06-25 08:52:07,363|FF|app-20190625085201-0154|15|4|START| 6.91|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:52:07,366|MF|app-20190625085201-0154|15|4|START| 6.91|A.Points indexed | 0.00| 0|0 2019-06-25 08:52:07,573|MF|app-20190625085201-0154|15|4| END| 7.12|A.Points indexed | 0.21| 54279|0 2019-06-25 08:52:07,573|MF|app-20190625085201-0154|15|4|START| 7.12|B.Pairs found | 0.00| 0|0 2019-06-25 08:52:09,493|MF|app-20190625085201-0154|15|4| END| 9.03|B.Pairs found | 1.92|101871|0 2019-06-25 08:52:09,493|MF|app-20190625085201-0154|15|4|START| 9.04|C.Centers found | 0.00| 0|0 2019-06-25 08:52:11,273|MF|app-20190625085201-0154|15|4| END| 10.82|C.Centers found | 1.78|203742|0 2019-06-25 08:52:11,273|MF|app-20190625085201-0154|15|4|START| 10.82|D.Disks found | 0.00| 0|0 2019-06-25 08:52:16,467|MF|app-20190625085201-0154|15|4| END| 16.01|D.Disks found | 5.19| 85998|0 2019-06-25 08:52:16,467|MF|app-20190625085201-0154|15|4|START| 16.01|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:52:17,737|MF|app-20190625085201-0154|15|4| END| 17.28|E.Disks partitioned | 1.27|121693|0 2019-06-25 08:52:17,737|MF|app-20190625085201-0154|15|4|START| 17.28|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:52:17,740|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:52:17,740|Cell area: 1055533.7681000116 2019-06-25 08:52:28,598|MF|app-20190625085201-0154|15|4| END| 28.14|F.Maximal disks found | 10.86| 25114|0 2019-06-25 08:52:28,598|MAXIMALS|app-20190625085201-0154|4|15|100.0|3|1350|21.232|25114 2019-06-25 08:52:29,668|FF|app-20190625085201-0154|15|4| END| 29.21|1.Maximal disks found | 22.31| 25114|0 2019-06-25 08:52:29,668|FF|app-20190625085201-0154|15|4|START| 29.21|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:52:29,668|MF|app-20190625085201-0154|15|4|START| 29.21|A.Points indexed | 0.00| 0|1 2019-06-25 08:52:29,797|MF|app-20190625085201-0154|15|4| END| 29.34|A.Points indexed | 0.13| 54735|1 2019-06-25 08:52:29,797|MF|app-20190625085201-0154|15|4|START| 29.34|B.Pairs found | 0.00| 0|1 2019-06-25 08:52:30,817|MF|app-20190625085201-0154|15|4| END| 30.36|B.Pairs found | 1.02|103386|1 2019-06-25 08:52:30,818|MF|app-20190625085201-0154|15|4|START| 30.36|C.Centers found | 0.00| 0|1 2019-06-25 08:52:32,071|MF|app-20190625085201-0154|15|4| END| 31.61|C.Centers found | 1.25|206772|1 2019-06-25 08:52:32,071|MF|app-20190625085201-0154|15|4|START| 31.61|D.Disks found | 0.00| 0|1 2019-06-25 08:52:39,198|MF|app-20190625085201-0154|15|4| END| 38.74|D.Disks found | 7.13| 87348|1 2019-06-25 08:52:39,198|MF|app-20190625085201-0154|15|4|START| 38.74|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:52:41,954|MF|app-20190625085201-0154|15|4| END| 41.50|E.Disks partitioned | 2.76|123553|1 2019-06-25 08:52:41,954|MF|app-20190625085201-0154|15|4|START| 41.50|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:52:41,955|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:52:41,955|Cell area: 1055533.7681000116 2019-06-25 08:52:51,603|MF|app-20190625085201-0154|15|4| END| 51.15|F.Maximal disks found | 9.65| 25640|1 2019-06-25 08:52:51,603|MAXIMALS|app-20190625085201-0154|4|15|100.0|3|1350|21.935|25640 2019-06-25 08:52:52,640|FF|app-20190625085201-0154|15|4| END| 52.18|1.Maximal disks found | 22.97| 25640|1 2019-06-25 08:52:52,640|FF|app-20190625085201-0154|15|4|START| 52.18|2.Join done | 0.00| 0|1 2019-06-25 08:52:55,577|FF|app-20190625085201-0154|15|4| END| 55.12|2.Join done | 2.94| 51443|1 2019-06-25 08:52:55,577|FF|app-20190625085201-0154|15|4|START| 55.12|3.Flocks to report | 0.00| 0|1 2019-06-25 08:52:56,133|FF|app-20190625085201-0154|15|4| END| 55.68|3.Flocks to report | 0.56| 0|1 2019-06-25 08:52:56,133|FF|app-20190625085201-0154|15|4|START| 55.68|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:52:56,205|FF|app-20190625085201-0154|15|4| END| 55.75|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 08:52:56,205|FF|app-20190625085201-0154|15|4|START| 55.75|5.Flocks reported | 0.00| 0|1 2019-06-25 08:52:56,210|FF|app-20190625085201-0154|15|4| END| 55.75|5.Flocks reported | 0.01| 0|1 2019-06-25 08:52:56,210|FF|app-20190625085201-0154|15|4|START| 55.75|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:52:57,857|FF|app-20190625085201-0154|15|4| END| 57.40|6.Candidates indexed | 1.65| 52931|1 2019-06-25 08:52:57,857|FF|app-20190625085201-0154|15|4|START| 57.40|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:52:57,857|MF|app-20190625085201-0154|15|4|START| 57.40|A.Points indexed | 0.00| 0|2 2019-06-25 08:52:57,975|MF|app-20190625085201-0154|15|4| END| 57.52|A.Points indexed | 0.12| 55182|2 2019-06-25 08:52:57,975|MF|app-20190625085201-0154|15|4|START| 57.52|B.Pairs found | 0.00| 0|2 2019-06-25 08:52:58,718|MF|app-20190625085201-0154|15|4| END| 58.26|B.Pairs found | 0.74|104754|2 2019-06-25 08:52:58,718|MF|app-20190625085201-0154|15|4|START| 58.26|C.Centers found | 0.00| 0|2 2019-06-25 08:52:59,751|MF|app-20190625085201-0154|15|4| END| 59.29|C.Centers found | 1.03|209508|2 2019-06-25 08:52:59,751|MF|app-20190625085201-0154|15|4|START| 59.29|D.Disks found | 0.00| 0|2 2019-06-25 08:53:03,255|MF|app-20190625085201-0154|15|4| END| 62.80|D.Disks found | 3.50| 88647|2 2019-06-25 08:53:03,255|MF|app-20190625085201-0154|15|4|START| 62.80|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:53:04,276|MF|app-20190625085201-0154|15|4| END| 63.82|E.Disks partitioned | 1.02|125639|2 2019-06-25 08:53:04,276|MF|app-20190625085201-0154|15|4|START| 63.82|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:53:04,277|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:53:04,277|Cell area: 1055533.7681000116 2019-06-25 08:53:14,083|MF|app-20190625085201-0154|15|4| END| 73.63|F.Maximal disks found | 9.81| 26055|2 2019-06-25 08:53:14,083|MAXIMALS|app-20190625085201-0154|4|15|100.0|3|1350|16.226|26055 2019-06-25 08:53:15,123|FF|app-20190625085201-0154|15|4| END| 74.67|1.Maximal disks found | 17.27| 26055|2 2019-06-25 08:53:15,123|FF|app-20190625085201-0154|15|4|START| 74.67|2.Join done | 0.00| 0|2 2019-06-25 08:53:25,562|FF|app-20190625085201-0154|15|4| END| 85.10|2.Join done | 10.44| 98052|2 2019-06-25 08:53:25,562|FF|app-20190625085201-0154|15|4|START| 85.10|3.Flocks to report | 0.00| 0|2 2019-06-25 08:53:27,563|FF|app-20190625085201-0154|15|4| END| 87.11|3.Flocks to report | 2.00| 83671|2 2019-06-25 08:53:27,563|FF|app-20190625085201-0154|15|4|START| 87.11|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:53:27,640|FF|app-20190625085201-0154|15|4|START| 87.18|4a.Making expansions | 0.00| 0|2 2019-06-25 08:53:28,508|FF|app-20190625085201-0154|15|4| END| 88.05|4a.Making expansions | 0.87|103881|2 2019-06-25 08:53:28,508|FF|app-20190625085201-0154|15|4|START| 88.05|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:53:43,482|FF|app-20190625085201-0154|15|4| END|103.02|4b.Finding maximals | 14.97| 17091|2 2019-06-25 08:53:43,987|FF|app-20190625085201-0154|15|4| END|103.53|4.Flocks prunned by expansion | 16.42| 17091|2 2019-06-25 08:53:43,987|FF|app-20190625085201-0154|15|4|START|103.53|5.Flocks reported | 0.00| 0|2 2019-06-25 08:53:44,564|FF|app-20190625085201-0154|15|4| END|104.11|5.Flocks reported | 0.58| 17091|2 2019-06-25 08:53:44,564|FF|app-20190625085201-0154|15|4|START|104.11|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:53:46,363|FF|app-20190625085201-0154|15|4| END|105.91|6.Candidates indexed | 1.80| 33209|2 2019-06-25 08:53:46,363|FF|app-20190625085201-0154|15|4|START|105.91|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:53:46,363|MF|app-20190625085201-0154|15|4|START|105.91|A.Points indexed | 0.00| 0|3 2019-06-25 08:53:46,472|MF|app-20190625085201-0154|15|4| END|106.01|A.Points indexed | 0.11| 55644|3 2019-06-25 08:53:46,472|MF|app-20190625085201-0154|15|4|START|106.01|B.Pairs found | 0.00| 0|3 2019-06-25 08:53:47,377|MF|app-20190625085201-0154|15|4| END|106.92|B.Pairs found | 0.91|106545|3 2019-06-25 08:53:47,377|MF|app-20190625085201-0154|15|4|START|106.92|C.Centers found | 0.00| 0|3 2019-06-25 08:53:48,822|MF|app-20190625085201-0154|15|4| END|108.36|C.Centers found | 1.45|213090|3 2019-06-25 08:53:48,822|MF|app-20190625085201-0154|15|4|START|108.36|D.Disks found | 0.00| 0|3 2019-06-25 08:53:56,916|MF|app-20190625085201-0154|15|4| END|116.46|D.Disks found | 8.09| 90426|3 2019-06-25 08:53:56,916|MF|app-20190625085201-0154|15|4|START|116.46|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:53:59,403|MF|app-20190625085201-0154|15|4| END|118.95|E.Disks partitioned | 2.49|128174|3 2019-06-25 08:53:59,403|MF|app-20190625085201-0154|15|4|START|118.95|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:53:59,404|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:53:59,404|Cell area: 1055533.7681000116 2019-06-25 08:54:11,576|MF|app-20190625085201-0154|15|4| END|131.12|F.Maximal disks found | 12.17| 26538|3 2019-06-25 08:54:11,577|MAXIMALS|app-20190625085201-0154|4|15|100.0|3|1350|25.213|26538 2019-06-25 08:54:12,619|FF|app-20190625085201-0154|15|4| END|132.16|1.Maximal disks found | 26.26| 26538|3 2019-06-25 08:54:12,619|FF|app-20190625085201-0154|15|4|START|132.16|2.Join done | 0.00| 0|3 2019-06-25 08:54:19,291|FF|app-20190625085201-0154|15|4| END|138.83|2.Join done | 6.67| 90375|3 2019-06-25 08:54:19,292|FF|app-20190625085201-0154|15|4|START|138.83|3.Flocks to report | 0.00| 0|3 2019-06-25 08:54:21,101|FF|app-20190625085201-0154|15|4| END|140.64|3.Flocks to report | 1.81| 75863|3 2019-06-25 08:54:21,101|FF|app-20190625085201-0154|15|4|START|140.64|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:54:21,185|FF|app-20190625085201-0154|15|4|START|140.73|4a.Making expansions | 0.00| 0|3 2019-06-25 08:54:22,080|FF|app-20190625085201-0154|15|4| END|141.62|4a.Making expansions | 0.90| 96527|3 2019-06-25 08:54:22,080|FF|app-20190625085201-0154|15|4|START|141.62|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:54:33,244|FF|app-20190625085201-0154|15|4| END|152.79|4b.Finding maximals | 11.16| 17301|3 2019-06-25 08:54:33,707|FF|app-20190625085201-0154|15|4| END|153.25|4.Flocks prunned by expansion | 12.61| 17301|3 2019-06-25 08:54:33,707|FF|app-20190625085201-0154|15|4|START|153.25|5.Flocks reported | 0.00| 0|3 2019-06-25 08:54:34,341|FF|app-20190625085201-0154|15|4| END|153.88|5.Flocks reported | 0.63| 17301|3 2019-06-25 08:54:34,341|FF|app-20190625085201-0154|15|4|START|153.88|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:54:36,203|FF|app-20190625085201-0154|15|4| END|155.75|6.Candidates indexed | 1.86| 33436|3 2019-06-25 08:54:37,551|Number of flocks: 34392 2019-06-25 08:54:38,491|PFLOCK|app-20190625085201-0154|4|15|100.0|3|3|150.20|34392 2019-06-25 08:54:39,421|FF|app-20190625085201-0154|15|4| END|158.96|Flock Finder run |152.07| 34392|3 2019-06-25 08:54:39,421|FF|app-20190625085201-0154|15|4|START|158.96|Session closed | 0.00| 0|3 2019-06-25 08:54:46,736|FF|app-20190625085201-0154|15|4| END|166.28|Session closed | 7.31| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:54:48,685|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:54:49,771|FF|app-20190625085449-0155|10|4| END| 1.07|Session start | 1.09| 0|-1 2019-06-25 08:54:49,772|FF|app-20190625085449-0155|10|4|START| 1.07|Data read | 0.00| 0|-1 2019-06-25 08:54:54,150|FF|app-20190625085449-0155|10|4| END| 5.45|Data read | 4.38|220752|-1 2019-06-25 08:54:54,150|FF|app-20190625085449-0155|10|4|START| 5.45|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:54:54,295|FF|app-20190625085449-0155|10|4| END| 5.59|KDBTree partitioner | 0.15| 544|-1 2019-06-25 08:54:54,295|FF|app-20190625085449-0155|10|4|START| 5.59|MF partitioner | 0.00| 0|-1 2019-06-25 08:54:54,322|FF|app-20190625085449-0155|10|4| END| 5.62|MF partitioner | 0.03| 900|-1 2019-06-25 08:54:54,322|FF|app-20190625085449-0155|10|4|START| 5.62|Pointset done | 0.00| 0|-1 2019-06-25 08:54:55,214|FF|app-20190625085449-0155|10|4| END| 6.51|Pointset done | 0.89| 4|-1 2019-06-25 08:54:55,214|FF|app-20190625085449-0155|10|4|START| 6.51|Flock Finder run | 0.00| 0|-1 2019-06-25 08:54:55,232|FF|app-20190625085449-0155|10|4|START| 6.53|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:54:55,235|MF|app-20190625085449-0155|10|4|START| 6.53|A.Points indexed | 0.00| 0|0 2019-06-25 08:54:55,410|MF|app-20190625085449-0155|10|4| END| 6.71|A.Points indexed | 0.18| 36186|0 2019-06-25 08:54:55,410|MF|app-20190625085449-0155|10|4|START| 6.71|B.Pairs found | 0.00| 0|0 2019-06-25 08:54:57,557|MF|app-20190625085449-0155|10|4| END| 8.86|B.Pairs found | 2.15| 67914|0 2019-06-25 08:54:57,557|MF|app-20190625085449-0155|10|4|START| 8.86|C.Centers found | 0.00| 0|0 2019-06-25 08:54:59,450|MF|app-20190625085449-0155|10|4| END| 10.75|C.Centers found | 1.89|135828|0 2019-06-25 08:54:59,450|MF|app-20190625085449-0155|10|4|START| 10.75|D.Disks found | 0.00| 0|0 2019-06-25 08:55:07,500|MF|app-20190625085449-0155|10|4| END| 18.80|D.Disks found | 8.05| 57332|0 2019-06-25 08:55:07,500|MF|app-20190625085449-0155|10|4|START| 18.80|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:55:11,465|MF|app-20190625085449-0155|10|4| END| 22.76|E.Disks partitioned | 3.97| 81114|0 2019-06-25 08:55:11,466|MF|app-20190625085449-0155|10|4|START| 22.76|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:55:11,467|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:55:11,467|Cell area: 1055533.7681000116 2019-06-25 08:55:24,636|MF|app-20190625085449-0155|10|4| END| 35.93|F.Maximal disks found | 13.17| 16742|0 2019-06-25 08:55:24,637|MAXIMALS|app-20190625085449-0155|4|10|100.0|3|900|29.401|16742 2019-06-25 08:55:26,343|FF|app-20190625085449-0155|10|4| END| 37.64|1.Maximal disks found | 31.11| 16742|0 2019-06-25 08:55:26,343|FF|app-20190625085449-0155|10|4|START| 37.64|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:55:26,344|MF|app-20190625085449-0155|10|4|START| 37.64|A.Points indexed | 0.00| 0|1 2019-06-25 08:55:26,442|MF|app-20190625085449-0155|10|4| END| 37.74|A.Points indexed | 0.10| 36490|1 2019-06-25 08:55:26,443|MF|app-20190625085449-0155|10|4|START| 37.74|B.Pairs found | 0.00| 0|1 2019-06-25 08:55:27,324|MF|app-20190625085449-0155|10|4| END| 38.62|B.Pairs found | 0.88| 68924|1 2019-06-25 08:55:27,324|MF|app-20190625085449-0155|10|4|START| 38.62|C.Centers found | 0.00| 0|1 2019-06-25 08:55:29,268|MF|app-20190625085449-0155|10|4| END| 40.57|C.Centers found | 1.94|137848|1 2019-06-25 08:55:29,269|MF|app-20190625085449-0155|10|4|START| 40.57|D.Disks found | 0.00| 0|1 2019-06-25 08:55:34,091|MF|app-20190625085449-0155|10|4| END| 45.39|D.Disks found | 4.82| 58232|1 2019-06-25 08:55:34,091|MF|app-20190625085449-0155|10|4|START| 45.39|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:55:36,508|MF|app-20190625085449-0155|10|4| END| 47.81|E.Disks partitioned | 2.42| 82341|1 2019-06-25 08:55:36,508|MF|app-20190625085449-0155|10|4|START| 47.81|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:55:36,509|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:55:36,509|Cell area: 1055533.7681000116 2019-06-25 08:55:47,687|MF|app-20190625085449-0155|10|4| END| 58.99|F.Maximal disks found | 11.18| 17096|1 2019-06-25 08:55:47,687|MAXIMALS|app-20190625085449-0155|4|10|100.0|3|900|21.344|17096 2019-06-25 08:55:48,626|FF|app-20190625085449-0155|10|4| END| 59.92|1.Maximal disks found | 22.28| 17096|1 2019-06-25 08:55:48,626|FF|app-20190625085449-0155|10|4|START| 59.92|2.Join done | 0.00| 0|1 2019-06-25 08:55:54,185|FF|app-20190625085449-0155|10|4| END| 65.48|2.Join done | 5.56| 34283|1 2019-06-25 08:55:54,185|FF|app-20190625085449-0155|10|4|START| 65.48|3.Flocks to report | 0.00| 0|1 2019-06-25 08:55:55,250|FF|app-20190625085449-0155|10|4| END| 66.55|3.Flocks to report | 1.07| 0|1 2019-06-25 08:55:55,250|FF|app-20190625085449-0155|10|4|START| 66.55|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:55:55,312|FF|app-20190625085449-0155|10|4| END| 66.61|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 08:55:55,312|FF|app-20190625085449-0155|10|4|START| 66.61|5.Flocks reported | 0.00| 0|1 2019-06-25 08:55:55,316|FF|app-20190625085449-0155|10|4| END| 66.61|5.Flocks reported | 0.00| 0|1 2019-06-25 08:55:55,316|FF|app-20190625085449-0155|10|4|START| 66.61|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:55:57,506|FF|app-20190625085449-0155|10|4| END| 68.80|6.Candidates indexed | 2.19| 35275|1 2019-06-25 08:55:57,506|FF|app-20190625085449-0155|10|4|START| 68.80|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:55:57,506|MF|app-20190625085449-0155|10|4|START| 68.80|A.Points indexed | 0.00| 0|2 2019-06-25 08:55:57,624|MF|app-20190625085449-0155|10|4| END| 68.92|A.Points indexed | 0.12| 36788|2 2019-06-25 08:55:57,624|MF|app-20190625085449-0155|10|4|START| 68.92|B.Pairs found | 0.00| 0|2 2019-06-25 08:55:58,625|MF|app-20190625085449-0155|10|4| END| 69.92|B.Pairs found | 1.00| 69836|2 2019-06-25 08:55:58,626|MF|app-20190625085449-0155|10|4|START| 69.92|C.Centers found | 0.00| 0|2 2019-06-25 08:56:00,062|MF|app-20190625085449-0155|10|4| END| 71.36|C.Centers found | 1.44|139672|2 2019-06-25 08:56:00,062|MF|app-20190625085449-0155|10|4|START| 71.36|D.Disks found | 0.00| 0|2 2019-06-25 08:56:04,987|MF|app-20190625085449-0155|10|4| END| 76.29|D.Disks found | 4.93| 59098|2 2019-06-25 08:56:04,987|MF|app-20190625085449-0155|10|4|START| 76.29|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:56:07,298|MF|app-20190625085449-0155|10|4| END| 78.60|E.Disks partitioned | 2.31| 83724|2 2019-06-25 08:56:07,298|MF|app-20190625085449-0155|10|4|START| 78.60|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:56:07,298|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:56:07,299|Cell area: 1055533.7681000116 2019-06-25 08:56:18,289|MF|app-20190625085449-0155|10|4| END| 89.59|F.Maximal disks found | 10.99| 17376|2 2019-06-25 08:56:18,289|MAXIMALS|app-20190625085449-0155|4|10|100.0|3|900|20.783|17376 2019-06-25 08:56:19,278|FF|app-20190625085449-0155|10|4| END| 90.58|1.Maximal disks found | 21.77| 17376|2 2019-06-25 08:56:19,278|FF|app-20190625085449-0155|10|4|START| 90.58|2.Join done | 0.00| 0|2 2019-06-25 08:56:32,124|FF|app-20190625085449-0155|10|4| END|103.42|2.Join done | 12.85| 65352|2 2019-06-25 08:56:32,124|FF|app-20190625085449-0155|10|4|START|103.42|3.Flocks to report | 0.00| 0|2 2019-06-25 08:56:33,879|FF|app-20190625085449-0155|10|4| END|105.18|3.Flocks to report | 1.76| 55755|2 2019-06-25 08:56:33,879|FF|app-20190625085449-0155|10|4|START|105.18|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:56:33,944|FF|app-20190625085449-0155|10|4|START|105.24|4a.Making expansions | 0.00| 0|2 2019-06-25 08:56:35,290|FF|app-20190625085449-0155|10|4| END|106.59|4a.Making expansions | 1.35| 69194|2 2019-06-25 08:56:35,291|FF|app-20190625085449-0155|10|4|START|106.59|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:56:50,755|FF|app-20190625085449-0155|10|4| END|122.05|4b.Finding maximals | 15.46| 11394|2 2019-06-25 08:56:51,178|FF|app-20190625085449-0155|10|4| END|122.48|4.Flocks prunned by expansion | 17.30| 11394|2 2019-06-25 08:56:51,178|FF|app-20190625085449-0155|10|4|START|122.48|5.Flocks reported | 0.00| 0|2 2019-06-25 08:56:51,805|FF|app-20190625085449-0155|10|4| END|123.10|5.Flocks reported | 0.63| 11394|2 2019-06-25 08:56:51,806|FF|app-20190625085449-0155|10|4|START|123.10|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:56:54,097|FF|app-20190625085449-0155|10|4| END|125.40|6.Candidates indexed | 2.29| 22156|2 2019-06-25 08:56:54,098|FF|app-20190625085449-0155|10|4|START|125.40|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:56:54,098|MF|app-20190625085449-0155|10|4|START|125.40|A.Points indexed | 0.00| 0|3 2019-06-25 08:56:54,181|MF|app-20190625085449-0155|10|4| END|125.48|A.Points indexed | 0.08| 37096|3 2019-06-25 08:56:54,181|MF|app-20190625085449-0155|10|4|START|125.48|B.Pairs found | 0.00| 0|3 2019-06-25 08:56:54,828|MF|app-20190625085449-0155|10|4| END|126.13|B.Pairs found | 0.65| 71030|3 2019-06-25 08:56:54,828|MF|app-20190625085449-0155|10|4|START|126.13|C.Centers found | 0.00| 0|3 2019-06-25 08:56:55,774|MF|app-20190625085449-0155|10|4| END|127.07|C.Centers found | 0.95|142060|3 2019-06-25 08:56:55,774|MF|app-20190625085449-0155|10|4|START|127.07|D.Disks found | 0.00| 0|3 2019-06-25 08:57:00,030|MF|app-20190625085449-0155|10|4| END|131.33|D.Disks found | 4.26| 60284|3 2019-06-25 08:57:00,030|MF|app-20190625085449-0155|10|4|START|131.33|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:57:02,199|MF|app-20190625085449-0155|10|4| END|133.50|E.Disks partitioned | 2.17| 85409|3 2019-06-25 08:57:02,199|MF|app-20190625085449-0155|10|4|START|133.50|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:57:02,199|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:57:02,200|Cell area: 1055533.7681000116 2019-06-25 08:57:15,134|MF|app-20190625085449-0155|10|4| END|146.43|F.Maximal disks found | 12.94| 17693|3 2019-06-25 08:57:15,134|MAXIMALS|app-20190625085449-0155|4|10|100.0|3|900|21.036|17693 2019-06-25 08:57:16,018|FF|app-20190625085449-0155|10|4| END|147.32|1.Maximal disks found | 21.92| 17693|3 2019-06-25 08:57:16,018|FF|app-20190625085449-0155|10|4|START|147.32|2.Join done | 0.00| 0|3 2019-06-25 08:57:24,333|FF|app-20190625085449-0155|10|4| END|155.63|2.Join done | 8.31| 60349|3 2019-06-25 08:57:24,333|FF|app-20190625085449-0155|10|4|START|155.63|3.Flocks to report | 0.00| 0|3 2019-06-25 08:57:26,012|FF|app-20190625085449-0155|10|4| END|157.31|3.Flocks to report | 1.68| 50613|3 2019-06-25 08:57:26,012|FF|app-20190625085449-0155|10|4|START|157.31|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:57:26,084|FF|app-20190625085449-0155|10|4|START|157.38|4a.Making expansions | 0.00| 0|3 2019-06-25 08:57:27,824|FF|app-20190625085449-0155|10|4| END|159.12|4a.Making expansions | 1.74| 64301|3 2019-06-25 08:57:27,824|FF|app-20190625085449-0155|10|4|START|159.12|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:57:38,061|FF|app-20190625085449-0155|10|4| END|169.36|4b.Finding maximals | 10.24| 11534|3 2019-06-25 08:57:38,448|FF|app-20190625085449-0155|10|4| END|169.75|4.Flocks prunned by expansion | 12.44| 11534|3 2019-06-25 08:57:38,448|FF|app-20190625085449-0155|10|4|START|169.75|5.Flocks reported | 0.00| 0|3 2019-06-25 08:57:39,043|FF|app-20190625085449-0155|10|4| END|170.34|5.Flocks reported | 0.60| 11534|3 2019-06-25 08:57:39,044|FF|app-20190625085449-0155|10|4|START|170.34|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:57:41,350|FF|app-20190625085449-0155|10|4| END|172.65|6.Candidates indexed | 2.31| 22352|3 2019-06-25 08:57:42,704|Number of flocks: 22928 2019-06-25 08:57:43,513|PFLOCK|app-20190625085449-0155|4|10|100.0|3|3|167.49|22928 2019-06-25 08:57:44,310|FF|app-20190625085449-0155|10|4| END|175.61|Flock Finder run |169.10| 22928|3 2019-06-25 08:57:44,310|FF|app-20190625085449-0155|10|4|START|175.61|Session closed | 0.00| 0|3 2019-06-25 08:57:50,946|FF|app-20190625085449-0155|10|4| END|182.24|Session closed | 6.64| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 08:57:52,892|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 08:57:54,018|FF|app-20190625085753-0156|5|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 08:57:54,018|FF|app-20190625085753-0156|5|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 08:57:57,710|FF|app-20190625085753-0156|5|4| END| 4.80|Data read | 3.69|110376|-1 2019-06-25 08:57:57,711|FF|app-20190625085753-0156|5|4|START| 4.80|KDBTree partitioner | 0.00| 0|-1 2019-06-25 08:57:57,927|FF|app-20190625085753-0156|5|4| END| 5.02|KDBTree partitioner | 0.22| 272|-1 2019-06-25 08:57:57,927|FF|app-20190625085753-0156|5|4|START| 5.02|MF partitioner | 0.00| 0|-1 2019-06-25 08:57:57,937|FF|app-20190625085753-0156|5|4| END| 5.03|MF partitioner | 0.01| 450|-1 2019-06-25 08:57:57,937|FF|app-20190625085753-0156|5|4|START| 5.03|Pointset done | 0.00| 0|-1 2019-06-25 08:57:58,674|FF|app-20190625085753-0156|5|4| END| 5.77|Pointset done | 0.74| 4|-1 2019-06-25 08:57:58,674|FF|app-20190625085753-0156|5|4|START| 5.77|Flock Finder run | 0.00| 0|-1 2019-06-25 08:57:58,831|FF|app-20190625085753-0156|5|4|START| 5.92|1.Maximal disks found | 0.00| 0|0 2019-06-25 08:57:58,834|MF|app-20190625085753-0156|5|4|START| 5.93|A.Points indexed | 0.00| 0|0 2019-06-25 08:57:59,002|MF|app-20190625085753-0156|5|4| END| 6.09|A.Points indexed | 0.17| 18093|0 2019-06-25 08:57:59,002|MF|app-20190625085753-0156|5|4|START| 6.09|B.Pairs found | 0.00| 0|0 2019-06-25 08:58:00,457|MF|app-20190625085753-0156|5|4| END| 7.55|B.Pairs found | 1.46| 33957|0 2019-06-25 08:58:00,458|MF|app-20190625085753-0156|5|4|START| 7.55|C.Centers found | 0.00| 0|0 2019-06-25 08:58:01,176|MF|app-20190625085753-0156|5|4| END| 8.27|C.Centers found | 0.72| 67914|0 2019-06-25 08:58:01,176|MF|app-20190625085753-0156|5|4|START| 8.27|D.Disks found | 0.00| 0|0 2019-06-25 08:58:04,302|MF|app-20190625085753-0156|5|4| END| 11.39|D.Disks found | 3.13| 28666|0 2019-06-25 08:58:04,302|MF|app-20190625085753-0156|5|4|START| 11.39|E.Disks partitioned | 0.00| 0|0 2019-06-25 08:58:05,747|MF|app-20190625085753-0156|5|4| END| 12.84|E.Disks partitioned | 1.45| 40550|0 2019-06-25 08:58:05,747|MF|app-20190625085753-0156|5|4|START| 12.84|F.Maximal disks found | 0.00| 0|0 2019-06-25 08:58:05,748|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:58:05,748|Cell area: 1055533.7681000116 2019-06-25 08:58:16,064|MF|app-20190625085753-0156|5|4| END| 23.16|F.Maximal disks found | 10.32| 8371|0 2019-06-25 08:58:16,064|MAXIMALS|app-20190625085753-0156|4|5|100.0|3|450|17.23|8371 2019-06-25 08:58:16,621|FF|app-20190625085753-0156|5|4| END| 23.71|1.Maximal disks found | 17.79| 8371|0 2019-06-25 08:58:16,621|FF|app-20190625085753-0156|5|4|START| 23.71|1.Maximal disks found | 0.00| 0|1 2019-06-25 08:58:16,622|MF|app-20190625085753-0156|5|4|START| 23.71|A.Points indexed | 0.00| 0|1 2019-06-25 08:58:16,704|MF|app-20190625085753-0156|5|4| END| 23.80|A.Points indexed | 0.08| 18245|1 2019-06-25 08:58:16,704|MF|app-20190625085753-0156|5|4|START| 23.80|B.Pairs found | 0.00| 0|1 2019-06-25 08:58:17,166|MF|app-20190625085753-0156|5|4| END| 24.26|B.Pairs found | 0.46| 34462|1 2019-06-25 08:58:17,166|MF|app-20190625085753-0156|5|4|START| 24.26|C.Centers found | 0.00| 0|1 2019-06-25 08:58:17,572|MF|app-20190625085753-0156|5|4| END| 24.66|C.Centers found | 0.41| 68924|1 2019-06-25 08:58:17,572|MF|app-20190625085753-0156|5|4|START| 24.66|D.Disks found | 0.00| 0|1 2019-06-25 08:58:19,585|MF|app-20190625085753-0156|5|4| END| 26.68|D.Disks found | 2.01| 29116|1 2019-06-25 08:58:19,585|MF|app-20190625085753-0156|5|4|START| 26.68|E.Disks partitioned | 0.00| 0|1 2019-06-25 08:58:20,382|MF|app-20190625085753-0156|5|4| END| 27.47|E.Disks partitioned | 0.80| 41162|1 2019-06-25 08:58:20,383|MF|app-20190625085753-0156|5|4|START| 27.47|F.Maximal disks found | 0.00| 0|1 2019-06-25 08:58:20,383|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:58:20,383|Cell area: 1055533.7681000116 2019-06-25 08:58:29,733|MF|app-20190625085753-0156|5|4| END| 36.82|F.Maximal disks found | 9.35| 8547|1 2019-06-25 08:58:29,733|MAXIMALS|app-20190625085753-0156|4|5|100.0|3|450|13.111|8547 2019-06-25 08:58:30,185|FF|app-20190625085753-0156|5|4| END| 37.28|1.Maximal disks found | 13.56| 8547|1 2019-06-25 08:58:30,186|FF|app-20190625085753-0156|5|4|START| 37.28|2.Join done | 0.00| 0|1 2019-06-25 08:58:32,466|FF|app-20190625085753-0156|5|4| END| 39.56|2.Join done | 2.28| 17137|1 2019-06-25 08:58:32,466|FF|app-20190625085753-0156|5|4|START| 39.56|3.Flocks to report | 0.00| 0|1 2019-06-25 08:58:32,958|FF|app-20190625085753-0156|5|4| END| 40.05|3.Flocks to report | 0.49| 0|1 2019-06-25 08:58:32,959|FF|app-20190625085753-0156|5|4|START| 40.05|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 08:58:33,000|FF|app-20190625085753-0156|5|4| END| 40.09|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 08:58:33,000|FF|app-20190625085753-0156|5|4|START| 40.09|5.Flocks reported | 0.00| 0|1 2019-06-25 08:58:33,004|FF|app-20190625085753-0156|5|4| END| 40.10|5.Flocks reported | 0.00| 0|1 2019-06-25 08:58:33,004|FF|app-20190625085753-0156|5|4|START| 40.10|6.Candidates indexed | 0.00| 0|1 2019-06-25 08:58:34,593|FF|app-20190625085753-0156|5|4| END| 41.68|6.Candidates indexed | 1.59| 17633|1 2019-06-25 08:58:34,593|FF|app-20190625085753-0156|5|4|START| 41.68|1.Maximal disks found | 0.00| 0|2 2019-06-25 08:58:34,593|MF|app-20190625085753-0156|5|4|START| 41.68|A.Points indexed | 0.00| 0|2 2019-06-25 08:58:34,656|MF|app-20190625085753-0156|5|4| END| 41.75|A.Points indexed | 0.06| 18394|2 2019-06-25 08:58:34,656|MF|app-20190625085753-0156|5|4|START| 41.75|B.Pairs found | 0.00| 0|2 2019-06-25 08:58:35,064|MF|app-20190625085753-0156|5|4| END| 42.16|B.Pairs found | 0.41| 34918|2 2019-06-25 08:58:35,064|MF|app-20190625085753-0156|5|4|START| 42.16|C.Centers found | 0.00| 0|2 2019-06-25 08:58:35,519|MF|app-20190625085753-0156|5|4| END| 42.61|C.Centers found | 0.46| 69836|2 2019-06-25 08:58:35,519|MF|app-20190625085753-0156|5|4|START| 42.61|D.Disks found | 0.00| 0|2 2019-06-25 08:58:37,612|MF|app-20190625085753-0156|5|4| END| 44.70|D.Disks found | 2.09| 29549|2 2019-06-25 08:58:37,612|MF|app-20190625085753-0156|5|4|START| 44.70|E.Disks partitioned | 0.00| 0|2 2019-06-25 08:58:38,251|MF|app-20190625085753-0156|5|4| END| 45.34|E.Disks partitioned | 0.64| 41840|2 2019-06-25 08:58:38,251|MF|app-20190625085753-0156|5|4|START| 45.34|F.Maximal disks found | 0.00| 0|2 2019-06-25 08:58:38,251|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:58:38,251|Cell area: 1055533.7681000116 2019-06-25 08:58:47,858|MF|app-20190625085753-0156|5|4| END| 54.95|F.Maximal disks found | 9.61| 8685|2 2019-06-25 08:58:47,859|MAXIMALS|app-20190625085753-0156|4|5|100.0|3|450|13.266|8685 2019-06-25 08:58:48,258|FF|app-20190625085753-0156|5|4| END| 55.35|1.Maximal disks found | 13.66| 8685|2 2019-06-25 08:58:48,258|FF|app-20190625085753-0156|5|4|START| 55.35|2.Join done | 0.00| 0|2 2019-06-25 08:58:58,377|FF|app-20190625085753-0156|5|4| END| 65.47|2.Join done | 10.12| 32676|2 2019-06-25 08:58:58,377|FF|app-20190625085753-0156|5|4|START| 65.47|3.Flocks to report | 0.00| 0|2 2019-06-25 08:58:59,987|FF|app-20190625085753-0156|5|4| END| 67.08|3.Flocks to report | 1.61| 27877|2 2019-06-25 08:58:59,988|FF|app-20190625085753-0156|5|4|START| 67.08|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 08:59:00,042|FF|app-20190625085753-0156|5|4|START| 67.13|4a.Making expansions | 0.00| 0|2 2019-06-25 08:59:01,054|FF|app-20190625085753-0156|5|4| END| 68.15|4a.Making expansions | 1.01| 34595|2 2019-06-25 08:59:01,054|FF|app-20190625085753-0156|5|4|START| 68.15|4b.Finding maximals | 0.00| 0|2 2019-06-25 08:59:15,959|FF|app-20190625085753-0156|5|4| END| 83.05|4b.Finding maximals | 14.91| 5697|2 2019-06-25 08:59:16,262|FF|app-20190625085753-0156|5|4| END| 83.35|4.Flocks prunned by expansion | 16.28| 5697|2 2019-06-25 08:59:16,262|FF|app-20190625085753-0156|5|4|START| 83.35|5.Flocks reported | 0.00| 0|2 2019-06-25 08:59:16,760|FF|app-20190625085753-0156|5|4| END| 83.85|5.Flocks reported | 0.50| 5697|2 2019-06-25 08:59:16,760|FF|app-20190625085753-0156|5|4|START| 83.85|6.Candidates indexed | 0.00| 0|2 2019-06-25 08:59:19,655|FF|app-20190625085753-0156|5|4| END| 86.75|6.Candidates indexed | 2.90| 11079|2 2019-06-25 08:59:19,655|FF|app-20190625085753-0156|5|4|START| 86.75|1.Maximal disks found | 0.00| 0|3 2019-06-25 08:59:19,655|MF|app-20190625085753-0156|5|4|START| 86.75|A.Points indexed | 0.00| 0|3 2019-06-25 08:59:19,716|MF|app-20190625085753-0156|5|4| END| 86.81|A.Points indexed | 0.06| 18548|3 2019-06-25 08:59:19,716|MF|app-20190625085753-0156|5|4|START| 86.81|B.Pairs found | 0.00| 0|3 2019-06-25 08:59:20,279|MF|app-20190625085753-0156|5|4| END| 87.37|B.Pairs found | 0.56| 35515|3 2019-06-25 08:59:20,279|MF|app-20190625085753-0156|5|4|START| 87.37|C.Centers found | 0.00| 0|3 2019-06-25 08:59:20,889|MF|app-20190625085753-0156|5|4| END| 87.98|C.Centers found | 0.61| 71030|3 2019-06-25 08:59:20,889|MF|app-20190625085753-0156|5|4|START| 87.98|D.Disks found | 0.00| 0|3 2019-06-25 08:59:23,931|MF|app-20190625085753-0156|5|4| END| 91.02|D.Disks found | 3.04| 30142|3 2019-06-25 08:59:23,931|MF|app-20190625085753-0156|5|4|START| 91.02|E.Disks partitioned | 0.00| 0|3 2019-06-25 08:59:24,917|MF|app-20190625085753-0156|5|4| END| 92.01|E.Disks partitioned | 0.99| 42665|3 2019-06-25 08:59:24,917|MF|app-20190625085753-0156|5|4|START| 92.01|F.Maximal disks found | 0.00| 0|3 2019-06-25 08:59:24,918|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 08:59:24,918|Cell area: 1055533.7681000116 2019-06-25 08:59:36,368|MF|app-20190625085753-0156|5|4| END|103.46|F.Maximal disks found | 11.45| 8846|3 2019-06-25 08:59:36,369|MAXIMALS|app-20190625085753-0156|4|5|100.0|3|450|16.714|8846 2019-06-25 08:59:36,805|FF|app-20190625085753-0156|5|4| END|103.90|1.Maximal disks found | 17.15| 8846|3 2019-06-25 08:59:36,805|FF|app-20190625085753-0156|5|4|START|103.90|2.Join done | 0.00| 0|3 2019-06-25 08:59:41,381|FF|app-20190625085753-0156|5|4| END|108.47|2.Join done | 4.58| 30192|3 2019-06-25 08:59:41,381|FF|app-20190625085753-0156|5|4|START|108.47|3.Flocks to report | 0.00| 0|3 2019-06-25 08:59:42,313|FF|app-20190625085753-0156|5|4| END|109.40|3.Flocks to report | 0.93| 25330|3 2019-06-25 08:59:42,314|FF|app-20190625085753-0156|5|4|START|109.40|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 08:59:42,356|FF|app-20190625085753-0156|5|4|START|109.45|4a.Making expansions | 0.00| 0|3 2019-06-25 08:59:43,010|FF|app-20190625085753-0156|5|4| END|110.10|4a.Making expansions | 0.65| 32282|3 2019-06-25 08:59:43,010|FF|app-20190625085753-0156|5|4|START|110.10|4b.Finding maximals | 0.00| 0|3 2019-06-25 08:59:52,889|FF|app-20190625085753-0156|5|4| END|119.98|4b.Finding maximals | 9.88| 5767|3 2019-06-25 08:59:53,108|FF|app-20190625085753-0156|5|4| END|120.20|4.Flocks prunned by expansion | 10.80| 5767|3 2019-06-25 08:59:53,108|FF|app-20190625085753-0156|5|4|START|120.20|5.Flocks reported | 0.00| 0|3 2019-06-25 08:59:53,399|FF|app-20190625085753-0156|5|4| END|120.49|5.Flocks reported | 0.29| 5767|3 2019-06-25 08:59:53,400|FF|app-20190625085753-0156|5|4|START|120.49|6.Candidates indexed | 0.00| 0|3 2019-06-25 08:59:55,360|FF|app-20190625085753-0156|5|4| END|122.45|6.Candidates indexed | 1.96| 11171|3 2019-06-25 08:59:56,137|Number of flocks: 11464 2019-06-25 08:59:56,523|PFLOCK|app-20190625085753-0156|4|5|100.0|3|3|117.46|11464 2019-06-25 08:59:56,972|FF|app-20190625085753-0156|5|4| END|124.06|Flock Finder run |118.30| 11464|3 2019-06-25 08:59:56,972|FF|app-20190625085753-0156|5|4|START|124.06|Session closed | 0.00| 0|3 2019-06-25 09:00:03,905|FF|app-20190625085753-0156|5|4| END|131.00|Session closed | 6.93| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:00:05,904|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 09:00:07,002|FF|app-20190625090006-0157|15|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 09:00:07,003|FF|app-20190625090006-0157|15|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 09:00:11,316|FF|app-20190625090006-0157|15|4| END| 5.40|Data read | 4.31|331128|-1 2019-06-25 09:00:11,316|FF|app-20190625090006-0157|15|4|START| 5.40|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:00:11,501|FF|app-20190625090006-0157|15|4| END| 5.58|KDBTree partitioner | 0.19| 816|-1 2019-06-25 09:00:11,502|FF|app-20190625090006-0157|15|4|START| 5.58|MF partitioner | 0.00| 0|-1 2019-06-25 09:00:11,523|FF|app-20190625090006-0157|15|4| END| 5.60|MF partitioner | 0.02| 1350|-1 2019-06-25 09:00:11,523|FF|app-20190625090006-0157|15|4|START| 5.60|Pointset done | 0.00| 0|-1 2019-06-25 09:00:12,656|FF|app-20190625090006-0157|15|4| END| 6.74|Pointset done | 1.13| 4|-1 2019-06-25 09:00:12,656|FF|app-20190625090006-0157|15|4|START| 6.74|Flock Finder run | 0.00| 0|-1 2019-06-25 09:00:12,675|FF|app-20190625090006-0157|15|4|START| 6.76|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:00:12,677|MF|app-20190625090006-0157|15|4|START| 6.76|A.Points indexed | 0.00| 0|0 2019-06-25 09:00:12,871|MF|app-20190625090006-0157|15|4| END| 6.95|A.Points indexed | 0.19| 54279|0 2019-06-25 09:00:12,871|MF|app-20190625090006-0157|15|4|START| 6.95|B.Pairs found | 0.00| 0|0 2019-06-25 09:00:15,051|MF|app-20190625090006-0157|15|4| END| 9.13|B.Pairs found | 2.18|118212|0 2019-06-25 09:00:15,052|MF|app-20190625090006-0157|15|4|START| 9.13|C.Centers found | 0.00| 0|0 2019-06-25 09:00:16,859|MF|app-20190625090006-0157|15|4| END| 10.94|C.Centers found | 1.81|236424|0 2019-06-25 09:00:16,860|MF|app-20190625090006-0157|15|4|START| 10.94|D.Disks found | 0.00| 0|0 2019-06-25 09:00:25,089|MF|app-20190625090006-0157|15|4| END| 19.17|D.Disks found | 8.23|105687|0 2019-06-25 09:00:25,089|MF|app-20190625090006-0157|15|4|START| 19.17|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:00:27,211|MF|app-20190625090006-0157|15|4| END| 21.29|E.Disks partitioned | 2.12|154597|0 2019-06-25 09:00:27,211|MF|app-20190625090006-0157|15|4|START| 21.29|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:00:27,213|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:00:27,213|Cell area: 1055533.7681000116 2019-06-25 09:00:52,275|MF|app-20190625090006-0157|15|4| END| 46.36|F.Maximal disks found | 25.06| 30002|0 2019-06-25 09:00:52,275|MAXIMALS|app-20190625090006-0157|4|15|110.0|3|1350|39.598|30002 2019-06-25 09:00:53,347|FF|app-20190625090006-0157|15|4| END| 47.43|1.Maximal disks found | 40.67| 30002|0 2019-06-25 09:00:53,348|FF|app-20190625090006-0157|15|4|START| 47.43|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:00:53,348|MF|app-20190625090006-0157|15|4|START| 47.43|A.Points indexed | 0.00| 0|1 2019-06-25 09:00:53,470|MF|app-20190625090006-0157|15|4| END| 47.55|A.Points indexed | 0.12| 54735|1 2019-06-25 09:00:53,470|MF|app-20190625090006-0157|15|4|START| 47.55|B.Pairs found | 0.00| 0|1 2019-06-25 09:00:54,655|MF|app-20190625090006-0157|15|4| END| 48.73|B.Pairs found | 1.18|119997|1 2019-06-25 09:00:54,655|MF|app-20190625090006-0157|15|4|START| 48.74|C.Centers found | 0.00| 0|1 2019-06-25 09:00:56,614|MF|app-20190625090006-0157|15|4| END| 50.69|C.Centers found | 1.96|239994|1 2019-06-25 09:00:56,614|MF|app-20190625090006-0157|15|4|START| 50.69|D.Disks found | 0.00| 0|1 2019-06-25 09:01:04,370|MF|app-20190625090006-0157|15|4| END| 58.45|D.Disks found | 7.76|107547|1 2019-06-25 09:01:04,371|MF|app-20190625090006-0157|15|4|START| 58.45|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:01:06,246|MF|app-20190625090006-0157|15|4| END| 60.33|E.Disks partitioned | 1.88|157199|1 2019-06-25 09:01:06,246|MF|app-20190625090006-0157|15|4|START| 60.33|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:01:06,247|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:01:06,247|Cell area: 1055533.7681000116 2019-06-25 09:01:32,794|MF|app-20190625090006-0157|15|4| END| 86.87|F.Maximal disks found | 26.55| 30329|1 2019-06-25 09:01:32,794|MAXIMALS|app-20190625090006-0157|4|15|110.0|3|1350|39.446|30329 2019-06-25 09:01:33,830|FF|app-20190625090006-0157|15|4| END| 87.91|1.Maximal disks found | 40.48| 30329|1 2019-06-25 09:01:33,830|FF|app-20190625090006-0157|15|4|START| 87.91|2.Join done | 0.00| 0|1 2019-06-25 09:01:37,514|FF|app-20190625090006-0157|15|4| END| 91.59|2.Join done | 3.68| 65661|1 2019-06-25 09:01:37,514|FF|app-20190625090006-0157|15|4|START| 91.59|3.Flocks to report | 0.00| 0|1 2019-06-25 09:01:38,159|FF|app-20190625090006-0157|15|4| END| 92.24|3.Flocks to report | 0.65| 0|1 2019-06-25 09:01:38,159|FF|app-20190625090006-0157|15|4|START| 92.24|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:01:38,232|FF|app-20190625090006-0157|15|4| END| 92.31|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 09:01:38,232|FF|app-20190625090006-0157|15|4|START| 92.31|5.Flocks reported | 0.00| 0|1 2019-06-25 09:01:38,237|FF|app-20190625090006-0157|15|4| END| 92.32|5.Flocks reported | 0.00| 0|1 2019-06-25 09:01:38,237|FF|app-20190625090006-0157|15|4|START| 92.32|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:01:40,045|FF|app-20190625090006-0157|15|4| END| 94.13|6.Candidates indexed | 1.81| 67476|1 2019-06-25 09:01:40,045|FF|app-20190625090006-0157|15|4|START| 94.13|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:01:40,046|MF|app-20190625090006-0157|15|4|START| 94.13|A.Points indexed | 0.00| 0|2 2019-06-25 09:01:40,168|MF|app-20190625090006-0157|15|4| END| 94.25|A.Points indexed | 0.12| 55182|2 2019-06-25 09:01:40,168|MF|app-20190625090006-0157|15|4|START| 94.25|B.Pairs found | 0.00| 0|2 2019-06-25 09:01:41,241|MF|app-20190625090006-0157|15|4| END| 95.32|B.Pairs found | 1.07|121698|2 2019-06-25 09:01:41,241|MF|app-20190625090006-0157|15|4|START| 95.32|C.Centers found | 0.00| 0|2 2019-06-25 09:01:42,440|MF|app-20190625090006-0157|15|4| END| 96.52|C.Centers found | 1.20|243396|2 2019-06-25 09:01:42,440|MF|app-20190625090006-0157|15|4|START| 96.52|D.Disks found | 0.00| 0|2 2019-06-25 09:01:51,713|MF|app-20190625090006-0157|15|4| END|105.79|D.Disks found | 9.27|109059|2 2019-06-25 09:01:51,714|MF|app-20190625090006-0157|15|4|START|105.79|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:01:54,695|MF|app-20190625090006-0157|15|4| END|108.78|E.Disks partitioned | 2.98|159559|2 2019-06-25 09:01:54,695|MF|app-20190625090006-0157|15|4|START|108.78|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:01:54,695|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:01:54,696|Cell area: 1055533.7681000116 2019-06-25 09:02:21,178|MF|app-20190625090006-0157|15|4| END|135.26|F.Maximal disks found | 26.48| 31016|2 2019-06-25 09:02:21,178|MAXIMALS|app-20190625090006-0157|4|15|110.0|3|1350|41.132|31016 2019-06-25 09:02:22,286|FF|app-20190625090006-0157|15|4| END|136.37|1.Maximal disks found | 42.24| 31016|2 2019-06-25 09:02:22,286|FF|app-20190625090006-0157|15|4|START|136.37|2.Join done | 0.00| 0|2 2019-06-25 09:02:38,065|FF|app-20190625090006-0157|15|4| END|152.15|2.Join done | 15.78|134462|2 2019-06-25 09:02:38,065|FF|app-20190625090006-0157|15|4|START|152.15|3.Flocks to report | 0.00| 0|2 2019-06-25 09:02:40,601|FF|app-20190625090006-0157|15|4| END|154.68|3.Flocks to report | 2.54|114833|2 2019-06-25 09:02:40,601|FF|app-20190625090006-0157|15|4|START|154.68|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:02:40,680|FF|app-20190625090006-0157|15|4|START|154.76|4a.Making expansions | 0.00| 0|2 2019-06-25 09:02:41,707|FF|app-20190625090006-0157|15|4| END|155.79|4a.Making expansions | 1.03|143141|2 2019-06-25 09:02:41,707|FF|app-20190625090006-0157|15|4|START|155.79|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:03:28,851|FF|app-20190625090006-0157|15|4| END|202.93|4b.Finding maximals | 47.14| 19803|2 2019-06-25 09:03:29,298|FF|app-20190625090006-0157|15|4| END|203.38|4.Flocks prunned by expansion | 48.70| 19803|2 2019-06-25 09:03:29,298|FF|app-20190625090006-0157|15|4|START|203.38|5.Flocks reported | 0.00| 0|2 2019-06-25 09:03:29,886|FF|app-20190625090006-0157|15|4| END|203.97|5.Flocks reported | 0.59| 19803|2 2019-06-25 09:03:29,886|FF|app-20190625090006-0157|15|4|START|203.97|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:03:31,908|FF|app-20190625090006-0157|15|4| END|205.99|6.Candidates indexed | 2.02| 41368|2 2019-06-25 09:03:31,908|FF|app-20190625090006-0157|15|4|START|205.99|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:03:31,908|MF|app-20190625090006-0157|15|4|START|205.99|A.Points indexed | 0.00| 0|3 2019-06-25 09:03:32,038|MF|app-20190625090006-0157|15|4| END|206.12|A.Points indexed | 0.13| 55644|3 2019-06-25 09:03:32,038|MF|app-20190625090006-0157|15|4|START|206.12|B.Pairs found | 0.00| 0|3 2019-06-25 09:03:33,189|MF|app-20190625090006-0157|15|4| END|207.27|B.Pairs found | 1.15|123771|3 2019-06-25 09:03:33,190|MF|app-20190625090006-0157|15|4|START|207.27|C.Centers found | 0.00| 0|3 2019-06-25 09:03:34,386|MF|app-20190625090006-0157|15|4| END|208.47|C.Centers found | 1.20|247542|3 2019-06-25 09:03:34,386|MF|app-20190625090006-0157|15|4|START|208.47|D.Disks found | 0.00| 0|3 2019-06-25 09:03:41,462|MF|app-20190625090006-0157|15|4| END|215.54|D.Disks found | 7.08|111261|3 2019-06-25 09:03:41,462|MF|app-20190625090006-0157|15|4|START|215.54|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:03:43,206|MF|app-20190625090006-0157|15|4| END|217.29|E.Disks partitioned | 1.74|162756|3 2019-06-25 09:03:43,206|MF|app-20190625090006-0157|15|4|START|217.29|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:03:43,207|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:03:43,207|Cell area: 1055533.7681000116 2019-06-25 09:04:17,403|MF|app-20190625090006-0157|15|4| END|251.48|F.Maximal disks found | 34.20| 31512|3 2019-06-25 09:04:17,403|MAXIMALS|app-20190625090006-0157|4|15|110.0|3|1350|45.495|31512 2019-06-25 09:04:18,433|FF|app-20190625090006-0157|15|4| END|252.51|1.Maximal disks found | 46.53| 31512|3 2019-06-25 09:04:18,433|FF|app-20190625090006-0157|15|4|START|252.51|2.Join done | 0.00| 0|3 2019-06-25 09:04:27,837|FF|app-20190625090006-0157|15|4| END|261.92|2.Join done | 9.40|134798|3 2019-06-25 09:04:27,837|FF|app-20190625090006-0157|15|4|START|261.92|3.Flocks to report | 0.00| 0|3 2019-06-25 09:04:30,255|FF|app-20190625090006-0157|15|4| END|264.34|3.Flocks to report | 2.42|115131|3 2019-06-25 09:04:30,255|FF|app-20190625090006-0157|15|4|START|264.34|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:04:30,333|FF|app-20190625090006-0157|15|4|START|264.41|4a.Making expansions | 0.00| 0|3 2019-06-25 09:04:31,351|FF|app-20190625090006-0157|15|4| END|265.43|4a.Making expansions | 1.02|143251|3 2019-06-25 09:04:31,351|FF|app-20190625090006-0157|15|4|START|265.43|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:05:45,173|FF|app-20190625090006-0157|15|4| END|339.25|4b.Finding maximals | 73.82| 20007|3 2019-06-25 09:05:45,642|FF|app-20190625090006-0157|15|4| END|339.72|4.Flocks prunned by expansion | 75.39| 20007|3 2019-06-25 09:05:45,642|FF|app-20190625090006-0157|15|4|START|339.72|5.Flocks reported | 0.00| 0|3 2019-06-25 09:05:46,242|FF|app-20190625090006-0157|15|4| END|340.32|5.Flocks reported | 0.60| 20007|3 2019-06-25 09:05:46,242|FF|app-20190625090006-0157|15|4|START|340.32|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:05:48,386|FF|app-20190625090006-0157|15|4| END|342.47|6.Candidates indexed | 2.14| 41642|3 2019-06-25 09:05:49,708|Number of flocks: 39810 2019-06-25 09:05:50,640|PFLOCK|app-20190625090006-0157|4|15|110.0|3|3|337.05|39810 2019-06-25 09:05:51,575|FF|app-20190625090006-0157|15|4| END|345.66|Flock Finder run |338.92| 39810|3 2019-06-25 09:05:51,575|FF|app-20190625090006-0157|15|4|START|345.66|Session closed | 0.00| 0|3 2019-06-25 09:05:59,136|FF|app-20190625090006-0157|15|4| END|353.22|Session closed | 7.56| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:06:01,150|FF|app-00000000000000-0000|10|4|START| 0.13|Session start | 0.00| 0|-1 2019-06-25 09:06:02,226|FF|app-20190625090601-0158|10|4| END| 1.06|Session start | 1.08| 0|-1 2019-06-25 09:06:02,226|FF|app-20190625090601-0158|10|4|START| 1.06|Data read | 0.00| 0|-1 2019-06-25 09:06:06,189|FF|app-20190625090601-0158|10|4| END| 5.02|Data read | 3.96|220752|-1 2019-06-25 09:06:06,189|FF|app-20190625090601-0158|10|4|START| 5.02|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:06:06,586|FF|app-20190625090601-0158|10|4| END| 5.42|KDBTree partitioner | 0.40| 544|-1 2019-06-25 09:06:06,587|FF|app-20190625090601-0158|10|4|START| 5.42|MF partitioner | 0.00| 0|-1 2019-06-25 09:06:06,617|FF|app-20190625090601-0158|10|4| END| 5.45|MF partitioner | 0.03| 900|-1 2019-06-25 09:06:06,617|FF|app-20190625090601-0158|10|4|START| 5.45|Pointset done | 0.00| 0|-1 2019-06-25 09:06:07,557|FF|app-20190625090601-0158|10|4| END| 6.39|Pointset done | 0.94| 4|-1 2019-06-25 09:06:07,557|FF|app-20190625090601-0158|10|4|START| 6.39|Flock Finder run | 0.00| 0|-1 2019-06-25 09:06:07,574|FF|app-20190625090601-0158|10|4|START| 6.41|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:06:07,576|MF|app-20190625090601-0158|10|4|START| 6.41|A.Points indexed | 0.00| 0|0 2019-06-25 09:06:07,746|MF|app-20190625090601-0158|10|4| END| 6.58|A.Points indexed | 0.17| 36186|0 2019-06-25 09:06:07,746|MF|app-20190625090601-0158|10|4|START| 6.58|B.Pairs found | 0.00| 0|0 2019-06-25 09:06:10,044|MF|app-20190625090601-0158|10|4| END| 8.88|B.Pairs found | 2.30| 78808|0 2019-06-25 09:06:10,044|MF|app-20190625090601-0158|10|4|START| 8.88|C.Centers found | 0.00| 0|0 2019-06-25 09:06:11,834|MF|app-20190625090601-0158|10|4| END| 10.67|C.Centers found | 1.79|157616|0 2019-06-25 09:06:11,834|MF|app-20190625090601-0158|10|4|START| 10.67|D.Disks found | 0.00| 0|0 2019-06-25 09:06:20,553|MF|app-20190625090601-0158|10|4| END| 19.39|D.Disks found | 8.72| 70458|0 2019-06-25 09:06:20,554|MF|app-20190625090601-0158|10|4|START| 19.39|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:06:25,218|MF|app-20190625090601-0158|10|4| END| 24.05|E.Disks partitioned | 4.67|103004|0 2019-06-25 09:06:25,218|MF|app-20190625090601-0158|10|4|START| 24.05|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:06:25,220|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:06:25,220|Cell area: 1055533.7681000116 2019-06-25 09:06:54,415|MF|app-20190625090601-0158|10|4| END| 53.25|F.Maximal disks found | 29.20| 20001|0 2019-06-25 09:06:54,415|MAXIMALS|app-20190625090601-0158|4|10|110.0|3|900|46.839|20001 2019-06-25 09:06:56,000|FF|app-20190625090601-0158|10|4| END| 54.83|1.Maximal disks found | 48.43| 20001|0 2019-06-25 09:06:56,000|FF|app-20190625090601-0158|10|4|START| 54.83|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:06:56,000|MF|app-20190625090601-0158|10|4|START| 54.83|A.Points indexed | 0.00| 0|1 2019-06-25 09:06:56,105|MF|app-20190625090601-0158|10|4| END| 54.94|A.Points indexed | 0.11| 36490|1 2019-06-25 09:06:56,105|MF|app-20190625090601-0158|10|4|START| 54.94|B.Pairs found | 0.00| 0|1 2019-06-25 09:06:57,139|MF|app-20190625090601-0158|10|4| END| 55.97|B.Pairs found | 1.03| 79998|1 2019-06-25 09:06:57,139|MF|app-20190625090601-0158|10|4|START| 55.97|C.Centers found | 0.00| 0|1 2019-06-25 09:06:58,792|MF|app-20190625090601-0158|10|4| END| 57.63|C.Centers found | 1.65|159996|1 2019-06-25 09:06:58,793|MF|app-20190625090601-0158|10|4|START| 57.63|D.Disks found | 0.00| 0|1 2019-06-25 09:07:05,207|MF|app-20190625090601-0158|10|4| END| 64.04|D.Disks found | 6.41| 71698|1 2019-06-25 09:07:05,207|MF|app-20190625090601-0158|10|4|START| 64.04|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:07:07,843|MF|app-20190625090601-0158|10|4| END| 66.68|E.Disks partitioned | 2.64|104758|1 2019-06-25 09:07:07,843|MF|app-20190625090601-0158|10|4|START| 66.68|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:07:07,844|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:07:07,844|Cell area: 1055533.7681000116 2019-06-25 09:07:34,540|MF|app-20190625090601-0158|10|4| END| 93.37|F.Maximal disks found | 26.70| 20222|1 2019-06-25 09:07:34,540|MAXIMALS|app-20190625090601-0158|4|10|110.0|3|900|38.54|20222 2019-06-25 09:07:35,486|FF|app-20190625090601-0158|10|4| END| 94.32|1.Maximal disks found | 39.49| 20222|1 2019-06-25 09:07:35,487|FF|app-20190625090601-0158|10|4|START| 94.32|2.Join done | 0.00| 0|1 2019-06-25 09:07:41,868|FF|app-20190625090601-0158|10|4| END|100.70|2.Join done | 6.38| 43837|1 2019-06-25 09:07:41,869|FF|app-20190625090601-0158|10|4|START|100.70|3.Flocks to report | 0.00| 0|1 2019-06-25 09:07:43,093|FF|app-20190625090601-0158|10|4| END|101.93|3.Flocks to report | 1.22| 0|1 2019-06-25 09:07:43,093|FF|app-20190625090601-0158|10|4|START|101.93|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:07:43,153|FF|app-20190625090601-0158|10|4| END|101.99|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 09:07:43,153|FF|app-20190625090601-0158|10|4|START|101.99|5.Flocks reported | 0.00| 0|1 2019-06-25 09:07:43,157|FF|app-20190625090601-0158|10|4| END|101.99|5.Flocks reported | 0.00| 0|1 2019-06-25 09:07:43,158|FF|app-20190625090601-0158|10|4|START|101.99|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:07:45,772|FF|app-20190625090601-0158|10|4| END|104.61|6.Candidates indexed | 2.61| 45047|1 2019-06-25 09:07:45,773|FF|app-20190625090601-0158|10|4|START|104.61|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:07:45,773|MF|app-20190625090601-0158|10|4|START|104.61|A.Points indexed | 0.00| 0|2 2019-06-25 09:07:45,887|MF|app-20190625090601-0158|10|4| END|104.72|A.Points indexed | 0.11| 36788|2 2019-06-25 09:07:45,887|MF|app-20190625090601-0158|10|4|START|104.72|B.Pairs found | 0.00| 0|2 2019-06-25 09:07:46,700|MF|app-20190625090601-0158|10|4| END|105.53|B.Pairs found | 0.81| 81132|2 2019-06-25 09:07:46,700|MF|app-20190625090601-0158|10|4|START|105.53|C.Centers found | 0.00| 0|2 2019-06-25 09:07:47,376|MF|app-20190625090601-0158|10|4| END|106.21|C.Centers found | 0.68|162264|2 2019-06-25 09:07:47,377|MF|app-20190625090601-0158|10|4|START|106.21|D.Disks found | 0.00| 0|2 2019-06-25 09:07:51,851|MF|app-20190625090601-0158|10|4| END|110.68|D.Disks found | 4.48| 72706|2 2019-06-25 09:07:51,851|MF|app-20190625090601-0158|10|4|START|110.68|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:07:54,472|MF|app-20190625090601-0158|10|4| END|113.31|E.Disks partitioned | 2.62|106347|2 2019-06-25 09:07:54,473|MF|app-20190625090601-0158|10|4|START|113.31|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:07:54,473|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:07:54,473|Cell area: 1055533.7681000116 2019-06-25 09:08:21,399|MF|app-20190625090601-0158|10|4| END|140.23|F.Maximal disks found | 26.93| 20682|2 2019-06-25 09:08:21,399|MAXIMALS|app-20190625090601-0158|4|10|110.0|3|900|35.626|20682 2019-06-25 09:08:22,431|FF|app-20190625090601-0158|10|4| END|141.26|1.Maximal disks found | 36.66| 20682|2 2019-06-25 09:08:22,431|FF|app-20190625090601-0158|10|4|START|141.26|2.Join done | 0.00| 0|2 2019-06-25 09:08:43,743|FF|app-20190625090601-0158|10|4| END|162.58|2.Join done | 21.31| 89740|2 2019-06-25 09:08:43,743|FF|app-20190625090601-0158|10|4|START|162.58|3.Flocks to report | 0.00| 0|2 2019-06-25 09:08:46,047|FF|app-20190625090601-0158|10|4| END|164.88|3.Flocks to report | 2.30| 76643|2 2019-06-25 09:08:46,047|FF|app-20190625090601-0158|10|4|START|164.88|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:08:46,107|FF|app-20190625090601-0158|10|4|START|164.94|4a.Making expansions | 0.00| 0|2 2019-06-25 09:08:47,513|FF|app-20190625090601-0158|10|4| END|166.35|4a.Making expansions | 1.41| 95580|2 2019-06-25 09:08:47,513|FF|app-20190625090601-0158|10|4|START|166.35|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:09:34,625|FF|app-20190625090601-0158|10|4| END|213.46|4b.Finding maximals | 47.11| 13202|2 2019-06-25 09:09:35,064|FF|app-20190625090601-0158|10|4| END|213.90|4.Flocks prunned by expansion | 49.02| 13202|2 2019-06-25 09:09:35,064|FF|app-20190625090601-0158|10|4|START|213.90|5.Flocks reported | 0.00| 0|2 2019-06-25 09:09:35,702|FF|app-20190625090601-0158|10|4| END|214.54|5.Flocks reported | 0.64| 13202|2 2019-06-25 09:09:35,702|FF|app-20190625090601-0158|10|4|START|214.54|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:09:38,349|FF|app-20190625090601-0158|10|4| END|217.18|6.Candidates indexed | 2.65| 27595|2 2019-06-25 09:09:38,349|FF|app-20190625090601-0158|10|4|START|217.18|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:09:38,349|MF|app-20190625090601-0158|10|4|START|217.18|A.Points indexed | 0.00| 0|3 2019-06-25 09:09:38,439|MF|app-20190625090601-0158|10|4| END|217.27|A.Points indexed | 0.09| 37096|3 2019-06-25 09:09:38,439|MF|app-20190625090601-0158|10|4|START|217.27|B.Pairs found | 0.00| 0|3 2019-06-25 09:09:39,190|MF|app-20190625090601-0158|10|4| END|218.02|B.Pairs found | 0.75| 82514|3 2019-06-25 09:09:39,190|MF|app-20190625090601-0158|10|4|START|218.02|C.Centers found | 0.00| 0|3 2019-06-25 09:09:40,383|MF|app-20190625090601-0158|10|4| END|219.22|C.Centers found | 1.19|165028|3 2019-06-25 09:09:40,384|MF|app-20190625090601-0158|10|4|START|219.22|D.Disks found | 0.00| 0|3 2019-06-25 09:09:44,883|MF|app-20190625090601-0158|10|4| END|223.72|D.Disks found | 4.50| 74174|3 2019-06-25 09:09:44,884|MF|app-20190625090601-0158|10|4|START|223.72|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:09:47,026|MF|app-20190625090601-0158|10|4| END|225.86|E.Disks partitioned | 2.14|108468|3 2019-06-25 09:09:47,026|MF|app-20190625090601-0158|10|4|START|225.86|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:09:47,026|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:09:47,026|Cell area: 1055533.7681000116 2019-06-25 09:10:22,065|MF|app-20190625090601-0158|10|4| END|260.90|F.Maximal disks found | 35.04| 21009|3 2019-06-25 09:10:22,066|MAXIMALS|app-20190625090601-0158|4|10|110.0|3|900|43.717|21009 2019-06-25 09:10:22,845|FF|app-20190625090601-0158|10|4| END|261.68|1.Maximal disks found | 44.50| 21009|3 2019-06-25 09:10:22,845|FF|app-20190625090601-0158|10|4|START|261.68|2.Join done | 0.00| 0|3 2019-06-25 09:10:42,741|FF|app-20190625090601-0158|10|4| END|281.57|2.Join done | 19.90| 90003|3 2019-06-25 09:10:42,741|FF|app-20190625090601-0158|10|4|START|281.57|3.Flocks to report | 0.00| 0|3 2019-06-25 09:10:47,710|FF|app-20190625090601-0158|10|4| END|286.54|3.Flocks to report | 4.97| 76861|3 2019-06-25 09:10:47,710|FF|app-20190625090601-0158|10|4|START|286.54|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:10:47,815|FF|app-20190625090601-0158|10|4|START|286.65|4a.Making expansions | 0.00| 0|3 2019-06-25 09:10:50,600|FF|app-20190625090601-0158|10|4| END|289.43|4a.Making expansions | 2.79| 95872|3 2019-06-25 09:10:50,600|FF|app-20190625090601-0158|10|4|START|289.43|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:11:55,683|FF|app-20190625090601-0158|10|4| END|354.52|4b.Finding maximals | 65.08| 13338|3 2019-06-25 09:11:56,335|FF|app-20190625090601-0158|10|4| END|355.17|4.Flocks prunned by expansion | 68.63| 13338|3 2019-06-25 09:11:56,335|FF|app-20190625090601-0158|10|4|START|355.17|5.Flocks reported | 0.00| 0|3 2019-06-25 09:11:57,403|FF|app-20190625090601-0158|10|4| END|356.24|5.Flocks reported | 1.07| 13338|3 2019-06-25 09:11:57,403|FF|app-20190625090601-0158|10|4|START|356.24|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:12:00,648|FF|app-20190625090601-0158|10|4| END|359.48|6.Candidates indexed | 3.25| 27789|3 2019-06-25 09:12:01,953|Number of flocks: 26540 2019-06-25 09:12:02,792|PFLOCK|app-20190625090601-0158|4|10|110.0|3|3|354.40|26540 2019-06-25 09:12:03,614|FF|app-20190625090601-0158|10|4| END|362.45|Flock Finder run |356.06| 26540|3 2019-06-25 09:12:03,614|FF|app-20190625090601-0158|10|4|START|362.45|Session closed | 0.00| 0|3 2019-06-25 09:12:10,329|FF|app-20190625090601-0158|10|4| END|369.16|Session closed | 6.72| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:12:12,268|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 09:12:13,384|FF|app-20190625091213-0159|5|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 09:12:13,384|FF|app-20190625091213-0159|5|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 09:12:17,124|FF|app-20190625091213-0159|5|4| END| 4.84|Data read | 3.74|110376|-1 2019-06-25 09:12:17,125|FF|app-20190625091213-0159|5|4|START| 4.84|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:12:17,251|FF|app-20190625091213-0159|5|4| END| 4.97|KDBTree partitioner | 0.13| 272|-1 2019-06-25 09:12:17,252|FF|app-20190625091213-0159|5|4|START| 4.97|MF partitioner | 0.00| 0|-1 2019-06-25 09:12:17,262|FF|app-20190625091213-0159|5|4| END| 4.98|MF partitioner | 0.01| 450|-1 2019-06-25 09:12:17,262|FF|app-20190625091213-0159|5|4|START| 4.98|Pointset done | 0.00| 0|-1 2019-06-25 09:12:18,202|FF|app-20190625091213-0159|5|4| END| 5.92|Pointset done | 0.94| 4|-1 2019-06-25 09:12:18,202|FF|app-20190625091213-0159|5|4|START| 5.92|Flock Finder run | 0.00| 0|-1 2019-06-25 09:12:18,221|FF|app-20190625091213-0159|5|4|START| 5.94|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:12:18,224|MF|app-20190625091213-0159|5|4|START| 5.94|A.Points indexed | 0.00| 0|0 2019-06-25 09:12:18,366|MF|app-20190625091213-0159|5|4| END| 6.08|A.Points indexed | 0.14| 18093|0 2019-06-25 09:12:18,366|MF|app-20190625091213-0159|5|4|START| 6.08|B.Pairs found | 0.00| 0|0 2019-06-25 09:12:19,566|MF|app-20190625091213-0159|5|4| END| 7.28|B.Pairs found | 1.20| 39404|0 2019-06-25 09:12:19,566|MF|app-20190625091213-0159|5|4|START| 7.28|C.Centers found | 0.00| 0|0 2019-06-25 09:12:20,332|MF|app-20190625091213-0159|5|4| END| 8.05|C.Centers found | 0.77| 78808|0 2019-06-25 09:12:20,332|MF|app-20190625091213-0159|5|4|START| 8.05|D.Disks found | 0.00| 0|0 2019-06-25 09:12:23,518|MF|app-20190625091213-0159|5|4| END| 11.23|D.Disks found | 3.19| 35229|0 2019-06-25 09:12:23,518|MF|app-20190625091213-0159|5|4|START| 11.23|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:12:24,673|MF|app-20190625091213-0159|5|4| END| 12.39|E.Disks partitioned | 1.16| 51442|0 2019-06-25 09:12:24,674|MF|app-20190625091213-0159|5|4|START| 12.39|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:12:24,675|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:12:24,675|Cell area: 1055533.7681000116 2019-06-25 09:12:48,976|MF|app-20190625091213-0159|5|4| END| 36.69|F.Maximal disks found | 24.30| 10001|0 2019-06-25 09:12:48,976|MAXIMALS|app-20190625091213-0159|4|5|110.0|3|450|30.753|10001 2019-06-25 09:12:49,479|FF|app-20190625091213-0159|5|4| END| 37.20|1.Maximal disks found | 31.26| 10001|0 2019-06-25 09:12:49,479|FF|app-20190625091213-0159|5|4|START| 37.20|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:12:49,480|MF|app-20190625091213-0159|5|4|START| 37.20|A.Points indexed | 0.00| 0|1 2019-06-25 09:12:49,564|MF|app-20190625091213-0159|5|4| END| 37.28|A.Points indexed | 0.09| 18245|1 2019-06-25 09:12:49,564|MF|app-20190625091213-0159|5|4|START| 37.28|B.Pairs found | 0.00| 0|1 2019-06-25 09:12:50,042|MF|app-20190625091213-0159|5|4| END| 37.76|B.Pairs found | 0.48| 39999|1 2019-06-25 09:12:50,042|MF|app-20190625091213-0159|5|4|START| 37.76|C.Centers found | 0.00| 0|1 2019-06-25 09:12:50,423|MF|app-20190625091213-0159|5|4| END| 38.14|C.Centers found | 0.38| 79998|1 2019-06-25 09:12:50,423|MF|app-20190625091213-0159|5|4|START| 38.14|D.Disks found | 0.00| 0|1 2019-06-25 09:12:52,605|MF|app-20190625091213-0159|5|4| END| 40.32|D.Disks found | 2.18| 35849|1 2019-06-25 09:12:52,605|MF|app-20190625091213-0159|5|4|START| 40.32|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:12:53,747|MF|app-20190625091213-0159|5|4| END| 41.46|E.Disks partitioned | 1.14| 52317|1 2019-06-25 09:12:53,747|MF|app-20190625091213-0159|5|4|START| 41.46|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:12:53,747|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:12:53,747|Cell area: 1055533.7681000116 2019-06-25 09:13:19,639|MF|app-20190625091213-0159|5|4| END| 67.36|F.Maximal disks found | 25.89| 10110|1 2019-06-25 09:13:19,639|MAXIMALS|app-20190625091213-0159|4|5|110.0|3|450|30.16|10110 2019-06-25 09:13:20,072|FF|app-20190625091213-0159|5|4| END| 67.79|1.Maximal disks found | 30.59| 10110|1 2019-06-25 09:13:20,072|FF|app-20190625091213-0159|5|4|START| 67.79|2.Join done | 0.00| 0|1 2019-06-25 09:13:22,615|FF|app-20190625091213-0159|5|4| END| 70.33|2.Join done | 2.54| 21993|1 2019-06-25 09:13:22,615|FF|app-20190625091213-0159|5|4|START| 70.33|3.Flocks to report | 0.00| 0|1 2019-06-25 09:13:23,152|FF|app-20190625091213-0159|5|4| END| 70.87|3.Flocks to report | 0.54| 0|1 2019-06-25 09:13:23,152|FF|app-20190625091213-0159|5|4|START| 70.87|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:13:23,188|FF|app-20190625091213-0159|5|4| END| 70.90|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 09:13:23,188|FF|app-20190625091213-0159|5|4|START| 70.90|5.Flocks reported | 0.00| 0|1 2019-06-25 09:13:23,192|FF|app-20190625091213-0159|5|4| END| 70.91|5.Flocks reported | 0.00| 0|1 2019-06-25 09:13:23,193|FF|app-20190625091213-0159|5|4|START| 70.91|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:13:25,073|FF|app-20190625091213-0159|5|4| END| 72.79|6.Candidates indexed | 1.88| 22599|1 2019-06-25 09:13:25,074|FF|app-20190625091213-0159|5|4|START| 72.79|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:13:25,074|MF|app-20190625091213-0159|5|4|START| 72.79|A.Points indexed | 0.00| 0|2 2019-06-25 09:13:25,134|MF|app-20190625091213-0159|5|4| END| 72.85|A.Points indexed | 0.06| 18394|2 2019-06-25 09:13:25,134|MF|app-20190625091213-0159|5|4|START| 72.85|B.Pairs found | 0.00| 0|2 2019-06-25 09:13:25,562|MF|app-20190625091213-0159|5|4| END| 73.28|B.Pairs found | 0.43| 40566|2 2019-06-25 09:13:25,562|MF|app-20190625091213-0159|5|4|START| 73.28|C.Centers found | 0.00| 0|2 2019-06-25 09:13:25,969|MF|app-20190625091213-0159|5|4| END| 73.69|C.Centers found | 0.41| 81132|2 2019-06-25 09:13:25,969|MF|app-20190625091213-0159|5|4|START| 73.69|D.Disks found | 0.00| 0|2 2019-06-25 09:13:27,994|MF|app-20190625091213-0159|5|4| END| 75.71|D.Disks found | 2.03| 36353|2 2019-06-25 09:13:27,995|MF|app-20190625091213-0159|5|4|START| 75.71|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:13:28,845|MF|app-20190625091213-0159|5|4| END| 76.56|E.Disks partitioned | 0.85| 53134|2 2019-06-25 09:13:28,845|MF|app-20190625091213-0159|5|4|START| 76.56|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:13:28,845|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:13:28,845|Cell area: 1055533.7681000116 2019-06-25 09:13:54,049|MF|app-20190625091213-0159|5|4| END|101.77|F.Maximal disks found | 25.20| 10342|2 2019-06-25 09:13:54,049|MAXIMALS|app-20190625091213-0159|4|5|110.0|3|450|28.975|10342 2019-06-25 09:13:54,431|FF|app-20190625091213-0159|5|4| END|102.15|1.Maximal disks found | 29.36| 10342|2 2019-06-25 09:13:54,431|FF|app-20190625091213-0159|5|4|START|102.15|2.Join done | 0.00| 0|2 2019-06-25 09:14:09,761|FF|app-20190625091213-0159|5|4| END|117.48|2.Join done | 15.33| 45000|2 2019-06-25 09:14:09,761|FF|app-20190625091213-0159|5|4|START|117.48|3.Flocks to report | 0.00| 0|2 2019-06-25 09:14:12,141|FF|app-20190625091213-0159|5|4| END|119.86|3.Flocks to report | 2.38| 38432|2 2019-06-25 09:14:12,142|FF|app-20190625091213-0159|5|4|START|119.86|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:14:12,202|FF|app-20190625091213-0159|5|4|START|119.92|4a.Making expansions | 0.00| 0|2 2019-06-25 09:14:13,444|FF|app-20190625091213-0159|5|4| END|121.16|4a.Making expansions | 1.24| 47766|2 2019-06-25 09:14:13,444|FF|app-20190625091213-0159|5|4|START|121.16|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:14:58,507|FF|app-20190625091213-0159|5|4| END|166.22|4b.Finding maximals | 45.06| 6601|2 2019-06-25 09:14:58,797|FF|app-20190625091213-0159|5|4| END|166.51|4.Flocks prunned by expansion | 46.66| 6601|2 2019-06-25 09:14:58,797|FF|app-20190625091213-0159|5|4|START|166.51|5.Flocks reported | 0.00| 0|2 2019-06-25 09:14:59,333|FF|app-20190625091213-0159|5|4| END|167.05|5.Flocks reported | 0.54| 6601|2 2019-06-25 09:14:59,334|FF|app-20190625091213-0159|5|4|START|167.05|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:15:03,158|FF|app-20190625091213-0159|5|4| END|170.87|6.Candidates indexed | 3.82| 13819|2 2019-06-25 09:15:03,159|FF|app-20190625091213-0159|5|4|START|170.88|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:15:03,159|MF|app-20190625091213-0159|5|4|START|170.88|A.Points indexed | 0.00| 0|3 2019-06-25 09:15:03,236|MF|app-20190625091213-0159|5|4| END|170.95|A.Points indexed | 0.08| 18548|3 2019-06-25 09:15:03,237|MF|app-20190625091213-0159|5|4|START|170.95|B.Pairs found | 0.00| 0|3 2019-06-25 09:15:03,796|MF|app-20190625091213-0159|5|4| END|171.51|B.Pairs found | 0.56| 41257|3 2019-06-25 09:15:03,796|MF|app-20190625091213-0159|5|4|START|171.51|C.Centers found | 0.00| 0|3 2019-06-25 09:15:04,429|MF|app-20190625091213-0159|5|4| END|172.15|C.Centers found | 0.63| 82514|3 2019-06-25 09:15:04,430|MF|app-20190625091213-0159|5|4|START|172.15|D.Disks found | 0.00| 0|3 2019-06-25 09:15:07,796|MF|app-20190625091213-0159|5|4| END|175.51|D.Disks found | 3.37| 37087|3 2019-06-25 09:15:07,796|MF|app-20190625091213-0159|5|4|START|175.51|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:15:09,008|MF|app-20190625091213-0159|5|4| END|176.72|E.Disks partitioned | 1.21| 54196|3 2019-06-25 09:15:09,008|MF|app-20190625091213-0159|5|4|START|176.72|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:15:09,008|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:15:09,008|Cell area: 1055533.7681000116 2019-06-25 09:15:41,337|MF|app-20190625091213-0159|5|4| END|209.05|F.Maximal disks found | 32.33| 10503|3 2019-06-25 09:15:41,337|MAXIMALS|app-20190625091213-0159|4|5|110.0|3|450|38.178|10503 2019-06-25 09:15:41,789|FF|app-20190625091213-0159|5|4| END|209.51|1.Maximal disks found | 38.63| 10503|3 2019-06-25 09:15:41,790|FF|app-20190625091213-0159|5|4|START|209.51|2.Join done | 0.00| 0|3 2019-06-25 09:15:49,689|FF|app-20190625091213-0159|5|4| END|217.41|2.Join done | 7.90| 45190|3 2019-06-25 09:15:49,690|FF|app-20190625091213-0159|5|4|START|217.41|3.Flocks to report | 0.00| 0|3 2019-06-25 09:15:51,024|FF|app-20190625091213-0159|5|4| END|218.74|3.Flocks to report | 1.33| 38589|3 2019-06-25 09:15:51,024|FF|app-20190625091213-0159|5|4|START|218.74|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:15:51,064|FF|app-20190625091213-0159|5|4|START|218.78|4a.Making expansions | 0.00| 0|3 2019-06-25 09:15:51,815|FF|app-20190625091213-0159|5|4| END|219.53|4a.Making expansions | 0.75| 47816|3 2019-06-25 09:15:51,815|FF|app-20190625091213-0159|5|4|START|219.53|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:16:56,256|FF|app-20190625091213-0159|5|4| END|283.97|4b.Finding maximals | 64.44| 6669|3 2019-06-25 09:16:56,476|FF|app-20190625091213-0159|5|4| END|284.19|4.Flocks prunned by expansion | 65.45| 6669|3 2019-06-25 09:16:56,476|FF|app-20190625091213-0159|5|4|START|284.19|5.Flocks reported | 0.00| 0|3 2019-06-25 09:16:56,793|FF|app-20190625091213-0159|5|4| END|284.51|5.Flocks reported | 0.32| 6669|3 2019-06-25 09:16:56,793|FF|app-20190625091213-0159|5|4|START|284.51|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:16:59,228|FF|app-20190625091213-0159|5|4| END|286.94|6.Candidates indexed | 2.44| 13927|3 2019-06-25 09:17:00,017|Number of flocks: 13270 2019-06-25 09:17:00,417|PFLOCK|app-20190625091213-0159|4|5|110.0|3|3|281.81|13270 2019-06-25 09:17:00,806|FF|app-20190625091213-0159|5|4| END|288.52|Flock Finder run |282.60| 13270|3 2019-06-25 09:17:00,806|FF|app-20190625091213-0159|5|4|START|288.52|Session closed | 0.00| 0|3 2019-06-25 09:17:07,761|FF|app-20190625091213-0159|5|4| END|295.48|Session closed | 6.96| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:17:09,703|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 09:17:10,804|FF|app-20190625091710-0160|15|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 09:17:10,804|FF|app-20190625091710-0160|15|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 09:17:15,244|FF|app-20190625091710-0160|15|4| END| 5.52|Data read | 4.44|331128|-1 2019-06-25 09:17:15,245|FF|app-20190625091710-0160|15|4|START| 5.52|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:17:15,421|FF|app-20190625091710-0160|15|4| END| 5.70|KDBTree partitioner | 0.18| 816|-1 2019-06-25 09:17:15,421|FF|app-20190625091710-0160|15|4|START| 5.70|MF partitioner | 0.00| 0|-1 2019-06-25 09:17:15,444|FF|app-20190625091710-0160|15|4| END| 5.72|MF partitioner | 0.02| 1350|-1 2019-06-25 09:17:15,444|FF|app-20190625091710-0160|15|4|START| 5.72|Pointset done | 0.00| 0|-1 2019-06-25 09:17:16,492|FF|app-20190625091710-0160|15|4| END| 6.77|Pointset done | 1.05| 4|-1 2019-06-25 09:17:16,492|FF|app-20190625091710-0160|15|4|START| 6.77|Flock Finder run | 0.00| 0|-1 2019-06-25 09:17:16,513|FF|app-20190625091710-0160|15|4|START| 6.79|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:17:16,516|MF|app-20190625091710-0160|15|4|START| 6.80|A.Points indexed | 0.00| 0|0 2019-06-25 09:17:16,788|MF|app-20190625091710-0160|15|4| END| 7.07|A.Points indexed | 0.27| 54279|0 2019-06-25 09:17:16,788|MF|app-20190625091710-0160|15|4|START| 7.07|B.Pairs found | 0.00| 0|0 2019-06-25 09:17:19,149|MF|app-20190625091710-0160|15|4| END| 9.43|B.Pairs found | 2.36| 71679|0 2019-06-25 09:17:19,149|MF|app-20190625091710-0160|15|4|START| 9.43|C.Centers found | 0.00| 0|0 2019-06-25 09:17:21,648|MF|app-20190625091710-0160|15|4| END| 11.93|C.Centers found | 2.50|143358|0 2019-06-25 09:17:21,648|MF|app-20190625091710-0160|15|4|START| 11.93|D.Disks found | 0.00| 0|0 2019-06-25 09:17:28,858|MF|app-20190625091710-0160|15|4| END| 19.14|D.Disks found | 7.21| 52353|0 2019-06-25 09:17:28,859|MF|app-20190625091710-0160|15|4|START| 19.14|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:17:30,460|MF|app-20190625091710-0160|15|4| END| 20.74|E.Disks partitioned | 1.60| 69681|0 2019-06-25 09:17:30,460|MF|app-20190625091710-0160|15|4|START| 20.74|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:17:30,462|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:17:30,462|Cell area: 1055533.7681000116 2019-06-25 09:17:32,610|MF|app-20190625091710-0160|15|4| END| 22.89|F.Maximal disks found | 2.15| 17026|0 2019-06-25 09:17:32,610|MAXIMALS|app-20190625091710-0160|4|15|80.0|3|1350|16.094|17026 2019-06-25 09:17:33,656|FF|app-20190625091710-0160|15|4| END| 23.94|1.Maximal disks found | 17.14| 17026|0 2019-06-25 09:17:33,656|FF|app-20190625091710-0160|15|4|START| 23.94|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:17:33,656|MF|app-20190625091710-0160|15|4|START| 23.94|A.Points indexed | 0.00| 0|1 2019-06-25 09:17:33,804|MF|app-20190625091710-0160|15|4| END| 24.08|A.Points indexed | 0.15| 54735|1 2019-06-25 09:17:33,805|MF|app-20190625091710-0160|15|4|START| 24.08|B.Pairs found | 0.00| 0|1 2019-06-25 09:17:34,876|MF|app-20190625091710-0160|15|4| END| 25.16|B.Pairs found | 1.07| 72729|1 2019-06-25 09:17:34,877|MF|app-20190625091710-0160|15|4|START| 25.16|C.Centers found | 0.00| 0|1 2019-06-25 09:17:36,363|MF|app-20190625091710-0160|15|4| END| 26.64|C.Centers found | 1.49|145458|1 2019-06-25 09:17:36,363|MF|app-20190625091710-0160|15|4|START| 26.64|D.Disks found | 0.00| 0|1 2019-06-25 09:17:41,259|MF|app-20190625091710-0160|15|4| END| 31.54|D.Disks found | 4.90| 53289|1 2019-06-25 09:17:41,259|MF|app-20190625091710-0160|15|4|START| 31.54|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:17:42,302|MF|app-20190625091710-0160|15|4| END| 32.58|E.Disks partitioned | 1.04| 70836|1 2019-06-25 09:17:42,302|MF|app-20190625091710-0160|15|4|START| 32.58|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:17:42,303|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:17:42,303|Cell area: 1055533.7681000116 2019-06-25 09:17:44,409|MF|app-20190625091710-0160|15|4| END| 34.69|F.Maximal disks found | 2.11| 17245|1 2019-06-25 09:17:44,409|MAXIMALS|app-20190625091710-0160|4|15|80.0|3|1350|10.753|17245 2019-06-25 09:17:45,443|FF|app-20190625091710-0160|15|4| END| 35.72|1.Maximal disks found | 11.79| 17245|1 2019-06-25 09:17:45,443|FF|app-20190625091710-0160|15|4|START| 35.72|2.Join done | 0.00| 0|1 2019-06-25 09:17:47,899|FF|app-20190625091710-0160|15|4| END| 38.18|2.Join done | 2.46| 27004|1 2019-06-25 09:17:47,899|FF|app-20190625091710-0160|15|4|START| 38.18|3.Flocks to report | 0.00| 0|1 2019-06-25 09:17:48,351|FF|app-20190625091710-0160|15|4| END| 38.63|3.Flocks to report | 0.45| 0|1 2019-06-25 09:17:48,351|FF|app-20190625091710-0160|15|4|START| 38.63|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:17:48,424|FF|app-20190625091710-0160|15|4| END| 38.70|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 09:17:48,424|FF|app-20190625091710-0160|15|4|START| 38.70|5.Flocks reported | 0.00| 0|1 2019-06-25 09:17:48,429|FF|app-20190625091710-0160|15|4| END| 38.71|5.Flocks reported | 0.01| 0|1 2019-06-25 09:17:48,429|FF|app-20190625091710-0160|15|4|START| 38.71|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:17:49,662|FF|app-20190625091710-0160|15|4| END| 39.94|6.Candidates indexed | 1.23| 28069|1 2019-06-25 09:17:49,662|FF|app-20190625091710-0160|15|4|START| 39.94|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:17:49,662|MF|app-20190625091710-0160|15|4|START| 39.94|A.Points indexed | 0.00| 0|2 2019-06-25 09:17:49,781|MF|app-20190625091710-0160|15|4| END| 40.06|A.Points indexed | 0.12| 55182|2 2019-06-25 09:17:49,781|MF|app-20190625091710-0160|15|4|START| 40.06|B.Pairs found | 0.00| 0|2 2019-06-25 09:17:50,517|MF|app-20190625091710-0160|15|4| END| 40.80|B.Pairs found | 0.74| 73710|2 2019-06-25 09:17:50,517|MF|app-20190625091710-0160|15|4|START| 40.80|C.Centers found | 0.00| 0|2 2019-06-25 09:17:52,035|MF|app-20190625091710-0160|15|4| END| 42.32|C.Centers found | 1.52|147420|2 2019-06-25 09:17:52,036|MF|app-20190625091710-0160|15|4|START| 42.32|D.Disks found | 0.00| 0|2 2019-06-25 09:17:55,391|MF|app-20190625091710-0160|15|4| END| 45.67|D.Disks found | 3.36| 54024|2 2019-06-25 09:17:55,391|MF|app-20190625091710-0160|15|4|START| 45.67|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:17:56,243|MF|app-20190625091710-0160|15|4| END| 46.52|E.Disks partitioned | 0.85| 71877|2 2019-06-25 09:17:56,244|MF|app-20190625091710-0160|15|4|START| 46.52|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:17:56,244|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:17:56,244|Cell area: 1055533.7681000116 2019-06-25 09:17:58,156|MF|app-20190625091710-0160|15|4| END| 48.44|F.Maximal disks found | 1.91| 17462|2 2019-06-25 09:17:58,156|MAXIMALS|app-20190625091710-0160|4|15|80.0|3|1350|8.494|17462 2019-06-25 09:17:59,179|FF|app-20190625091710-0160|15|4| END| 49.46|1.Maximal disks found | 9.52| 17462|2 2019-06-25 09:17:59,180|FF|app-20190625091710-0160|15|4|START| 49.46|2.Join done | 0.00| 0|2 2019-06-25 09:18:04,003|FF|app-20190625091710-0160|15|4| END| 54.28|2.Join done | 4.82| 38332|2 2019-06-25 09:18:04,003|FF|app-20190625091710-0160|15|4|START| 54.28|3.Flocks to report | 0.00| 0|2 2019-06-25 09:18:04,917|FF|app-20190625091710-0160|15|4| END| 55.20|3.Flocks to report | 0.91| 33043|2 2019-06-25 09:18:04,917|FF|app-20190625091710-0160|15|4|START| 55.20|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:18:05,017|FF|app-20190625091710-0160|15|4|START| 55.30|4a.Making expansions | 0.00| 0|2 2019-06-25 09:18:05,943|FF|app-20190625091710-0160|15|4| END| 56.22|4a.Making expansions | 0.93| 41702|2 2019-06-25 09:18:05,943|FF|app-20190625091710-0160|15|4|START| 56.22|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:18:07,036|FF|app-20190625091710-0160|15|4| END| 57.32|4b.Finding maximals | 1.09| 12225|2 2019-06-25 09:18:07,477|FF|app-20190625091710-0160|15|4| END| 57.76|4.Flocks prunned by expansion | 2.56| 12225|2 2019-06-25 09:18:07,477|FF|app-20190625091710-0160|15|4|START| 57.76|5.Flocks reported | 0.00| 0|2 2019-06-25 09:18:08,068|FF|app-20190625091710-0160|15|4| END| 58.35|5.Flocks reported | 0.59| 12225|2 2019-06-25 09:18:08,068|FF|app-20190625091710-0160|15|4|START| 58.35|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:18:09,597|FF|app-20190625091710-0160|15|4| END| 59.88|6.Candidates indexed | 1.53| 18597|2 2019-06-25 09:18:09,597|FF|app-20190625091710-0160|15|4|START| 59.88|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:18:09,597|MF|app-20190625091710-0160|15|4|START| 59.88|A.Points indexed | 0.00| 0|3 2019-06-25 09:18:09,706|MF|app-20190625091710-0160|15|4| END| 59.99|A.Points indexed | 0.11| 55644|3 2019-06-25 09:18:09,706|MF|app-20190625091710-0160|15|4|START| 59.99|B.Pairs found | 0.00| 0|3 2019-06-25 09:18:10,526|MF|app-20190625091710-0160|15|4| END| 60.81|B.Pairs found | 0.82| 74871|3 2019-06-25 09:18:10,526|MF|app-20190625091710-0160|15|4|START| 60.81|C.Centers found | 0.00| 0|3 2019-06-25 09:18:11,294|MF|app-20190625091710-0160|15|4| END| 61.57|C.Centers found | 0.77|149742|3 2019-06-25 09:18:11,294|MF|app-20190625091710-0160|15|4|START| 61.57|D.Disks found | 0.00| 0|3 2019-06-25 09:18:17,890|MF|app-20190625091710-0160|15|4| END| 68.17|D.Disks found | 6.60| 54930|3 2019-06-25 09:18:17,890|MF|app-20190625091710-0160|15|4|START| 68.17|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:18:20,131|MF|app-20190625091710-0160|15|4| END| 70.41|E.Disks partitioned | 2.24| 73112|3 2019-06-25 09:18:20,131|MF|app-20190625091710-0160|15|4|START| 70.41|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:18:20,131|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:18:20,132|Cell area: 1055533.7681000116 2019-06-25 09:18:22,479|MF|app-20190625091710-0160|15|4| END| 72.76|F.Maximal disks found | 2.35| 17782|3 2019-06-25 09:18:22,479|MAXIMALS|app-20190625091710-0160|4|15|80.0|3|1350|12.882|17782 2019-06-25 09:18:23,518|FF|app-20190625091710-0160|15|4| END| 73.80|1.Maximal disks found | 13.92| 17782|3 2019-06-25 09:18:23,518|FF|app-20190625091710-0160|15|4|START| 73.80|2.Join done | 0.00| 0|3 2019-06-25 09:18:28,348|FF|app-20190625091710-0160|15|4| END| 78.63|2.Join done | 4.83| 37059|3 2019-06-25 09:18:28,348|FF|app-20190625091710-0160|15|4|START| 78.63|3.Flocks to report | 0.00| 0|3 2019-06-25 09:18:29,608|FF|app-20190625091710-0160|15|4| END| 79.89|3.Flocks to report | 1.26| 31049|3 2019-06-25 09:18:29,608|FF|app-20190625091710-0160|15|4|START| 79.89|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:18:29,701|FF|app-20190625091710-0160|15|4|START| 79.98|4a.Making expansions | 0.00| 0|3 2019-06-25 09:18:30,783|FF|app-20190625091710-0160|15|4| END| 81.06|4a.Making expansions | 1.08| 39881|3 2019-06-25 09:18:30,783|FF|app-20190625091710-0160|15|4|START| 81.06|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:18:31,734|FF|app-20190625091710-0160|15|4| END| 82.01|4b.Finding maximals | 0.95| 12384|3 2019-06-25 09:18:32,194|FF|app-20190625091710-0160|15|4| END| 82.47|4.Flocks prunned by expansion | 2.59| 12384|3 2019-06-25 09:18:32,194|FF|app-20190625091710-0160|15|4|START| 82.47|5.Flocks reported | 0.00| 0|3 2019-06-25 09:18:32,832|FF|app-20190625091710-0160|15|4| END| 83.11|5.Flocks reported | 0.64| 12384|3 2019-06-25 09:18:32,832|FF|app-20190625091710-0160|15|4|START| 83.11|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:18:34,515|FF|app-20190625091710-0160|15|4| END| 84.80|6.Candidates indexed | 1.68| 19484|3 2019-06-25 09:18:35,822|Number of flocks: 24609 2019-06-25 09:18:36,759|PFLOCK|app-20190625091710-0160|4|15|80.0|3|3|79.33|24609 2019-06-25 09:18:37,681|FF|app-20190625091710-0160|15|4| END| 87.96|Flock Finder run | 81.19| 24609|3 2019-06-25 09:18:37,681|FF|app-20190625091710-0160|15|4|START| 87.96|Session closed | 0.00| 0|3 2019-06-25 09:18:47,860|FF|app-20190625091710-0160|15|4| END| 98.14|Session closed | 10.18| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:18:49,833|FF|app-00000000000000-0000|10|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 09:18:50,934|FF|app-20190625091850-0161|10|4| END| 1.09|Session start | 1.10| 0|-1 2019-06-25 09:18:50,935|FF|app-20190625091850-0161|10|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 09:18:54,969|FF|app-20190625091850-0161|10|4| END| 5.12|Data read | 4.03|220752|-1 2019-06-25 09:18:54,969|FF|app-20190625091850-0161|10|4|START| 5.12|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:18:55,311|FF|app-20190625091850-0161|10|4| END| 5.46|KDBTree partitioner | 0.34| 544|-1 2019-06-25 09:18:55,312|FF|app-20190625091850-0161|10|4|START| 5.46|MF partitioner | 0.00| 0|-1 2019-06-25 09:18:55,332|FF|app-20190625091850-0161|10|4| END| 5.48|MF partitioner | 0.02| 900|-1 2019-06-25 09:18:55,332|FF|app-20190625091850-0161|10|4|START| 5.48|Pointset done | 0.00| 0|-1 2019-06-25 09:18:56,206|FF|app-20190625091850-0161|10|4| END| 6.36|Pointset done | 0.87| 4|-1 2019-06-25 09:18:56,206|FF|app-20190625091850-0161|10|4|START| 6.36|Flock Finder run | 0.00| 0|-1 2019-06-25 09:18:56,223|FF|app-20190625091850-0161|10|4|START| 6.37|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:18:56,225|MF|app-20190625091850-0161|10|4|START| 6.38|A.Points indexed | 0.00| 0|0 2019-06-25 09:18:56,394|MF|app-20190625091850-0161|10|4| END| 6.55|A.Points indexed | 0.17| 36186|0 2019-06-25 09:18:56,394|MF|app-20190625091850-0161|10|4|START| 6.55|B.Pairs found | 0.00| 0|0 2019-06-25 09:18:58,784|MF|app-20190625091850-0161|10|4| END| 8.93|B.Pairs found | 2.39| 47786|0 2019-06-25 09:18:58,784|MF|app-20190625091850-0161|10|4|START| 8.94|C.Centers found | 0.00| 0|0 2019-06-25 09:19:00,590|MF|app-20190625091850-0161|10|4| END| 10.74|C.Centers found | 1.81| 95572|0 2019-06-25 09:19:00,591|MF|app-20190625091850-0161|10|4|START| 10.74|D.Disks found | 0.00| 0|0 2019-06-25 09:19:07,850|MF|app-20190625091850-0161|10|4| END| 18.00|D.Disks found | 7.26| 34902|0 2019-06-25 09:19:07,850|MF|app-20190625091850-0161|10|4|START| 18.00|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:19:10,913|MF|app-20190625091850-0161|10|4| END| 21.06|E.Disks partitioned | 3.06| 46456|0 2019-06-25 09:19:10,913|MF|app-20190625091850-0161|10|4|START| 21.06|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:19:10,914|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:19:10,914|Cell area: 1055533.7681000116 2019-06-25 09:19:13,997|MF|app-20190625091850-0161|10|4| END| 24.15|F.Maximal disks found | 3.08| 11354|0 2019-06-25 09:19:13,997|MAXIMALS|app-20190625091850-0161|4|10|80.0|3|900|17.772|11354 2019-06-25 09:19:15,541|FF|app-20190625091850-0161|10|4| END| 25.69|1.Maximal disks found | 19.32| 11354|0 2019-06-25 09:19:15,541|FF|app-20190625091850-0161|10|4|START| 25.69|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:19:15,541|MF|app-20190625091850-0161|10|4|START| 25.69|A.Points indexed | 0.00| 0|1 2019-06-25 09:19:15,640|MF|app-20190625091850-0161|10|4| END| 25.79|A.Points indexed | 0.10| 36490|1 2019-06-25 09:19:15,641|MF|app-20190625091850-0161|10|4|START| 25.79|B.Pairs found | 0.00| 0|1 2019-06-25 09:19:16,560|MF|app-20190625091850-0161|10|4| END| 26.71|B.Pairs found | 0.92| 48486|1 2019-06-25 09:19:16,560|MF|app-20190625091850-0161|10|4|START| 26.71|C.Centers found | 0.00| 0|1 2019-06-25 09:19:17,916|MF|app-20190625091850-0161|10|4| END| 28.07|C.Centers found | 1.36| 96972|1 2019-06-25 09:19:17,916|MF|app-20190625091850-0161|10|4|START| 28.07|D.Disks found | 0.00| 0|1 2019-06-25 09:19:22,832|MF|app-20190625091850-0161|10|4| END| 32.98|D.Disks found | 4.92| 35526|1 2019-06-25 09:19:22,832|MF|app-20190625091850-0161|10|4|START| 32.98|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:19:24,581|MF|app-20190625091850-0161|10|4| END| 34.73|E.Disks partitioned | 1.75| 47221|1 2019-06-25 09:19:24,581|MF|app-20190625091850-0161|10|4|START| 34.73|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:19:24,582|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:19:24,582|Cell area: 1055533.7681000116 2019-06-25 09:19:26,805|MF|app-20190625091850-0161|10|4| END| 36.96|F.Maximal disks found | 2.22| 11499|1 2019-06-25 09:19:26,805|MAXIMALS|app-20190625091850-0161|4|10|80.0|3|900|11.264|11499 2019-06-25 09:19:27,742|FF|app-20190625091850-0161|10|4| END| 37.89|1.Maximal disks found | 12.20| 11499|1 2019-06-25 09:19:27,742|FF|app-20190625091850-0161|10|4|START| 37.89|2.Join done | 0.00| 0|1 2019-06-25 09:19:32,163|FF|app-20190625091850-0161|10|4| END| 42.31|2.Join done | 4.42| 17993|1 2019-06-25 09:19:32,163|FF|app-20190625091850-0161|10|4|START| 42.31|3.Flocks to report | 0.00| 0|1 2019-06-25 09:19:32,803|FF|app-20190625091850-0161|10|4| END| 42.95|3.Flocks to report | 0.64| 0|1 2019-06-25 09:19:32,803|FF|app-20190625091850-0161|10|4|START| 42.95|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:19:32,864|FF|app-20190625091850-0161|10|4| END| 43.02|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 09:19:32,864|FF|app-20190625091850-0161|10|4|START| 43.02|5.Flocks reported | 0.00| 0|1 2019-06-25 09:19:32,870|FF|app-20190625091850-0161|10|4| END| 43.02|5.Flocks reported | 0.01| 0|1 2019-06-25 09:19:32,870|FF|app-20190625091850-0161|10|4|START| 43.02|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:19:34,447|FF|app-20190625091850-0161|10|4| END| 44.60|6.Candidates indexed | 1.58| 18703|1 2019-06-25 09:19:34,447|FF|app-20190625091850-0161|10|4|START| 44.60|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:19:34,447|MF|app-20190625091850-0161|10|4|START| 44.60|A.Points indexed | 0.00| 0|2 2019-06-25 09:19:34,537|MF|app-20190625091850-0161|10|4| END| 44.69|A.Points indexed | 0.09| 36788|2 2019-06-25 09:19:34,537|MF|app-20190625091850-0161|10|4|START| 44.69|B.Pairs found | 0.00| 0|2 2019-06-25 09:19:35,338|MF|app-20190625091850-0161|10|4| END| 45.49|B.Pairs found | 0.80| 49140|2 2019-06-25 09:19:35,338|MF|app-20190625091850-0161|10|4|START| 45.49|C.Centers found | 0.00| 0|2 2019-06-25 09:19:36,132|MF|app-20190625091850-0161|10|4| END| 46.28|C.Centers found | 0.79| 98280|2 2019-06-25 09:19:36,132|MF|app-20190625091850-0161|10|4|START| 46.28|D.Disks found | 0.00| 0|2 2019-06-25 09:19:40,003|MF|app-20190625091850-0161|10|4| END| 50.15|D.Disks found | 3.87| 36016|2 2019-06-25 09:19:40,003|MF|app-20190625091850-0161|10|4|START| 50.15|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:19:41,235|MF|app-20190625091850-0161|10|4| END| 51.39|E.Disks partitioned | 1.23| 47918|2 2019-06-25 09:19:41,236|MF|app-20190625091850-0161|10|4|START| 51.39|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:19:41,236|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:19:41,236|Cell area: 1055533.7681000116 2019-06-25 09:19:43,251|MF|app-20190625091850-0161|10|4| END| 53.40|F.Maximal disks found | 2.02| 11642|2 2019-06-25 09:19:43,251|MAXIMALS|app-20190625091850-0161|4|10|80.0|3|900|8.804|11642 2019-06-25 09:19:43,973|FF|app-20190625091850-0161|10|4| END| 54.12|1.Maximal disks found | 9.53| 11642|2 2019-06-25 09:19:43,973|FF|app-20190625091850-0161|10|4|START| 54.12|2.Join done | 0.00| 0|2 2019-06-25 09:19:48,411|FF|app-20190625091850-0161|10|4| END| 58.56|2.Join done | 4.44| 25538|2 2019-06-25 09:19:48,411|FF|app-20190625091850-0161|10|4|START| 58.56|3.Flocks to report | 0.00| 0|2 2019-06-25 09:19:49,095|FF|app-20190625091850-0161|10|4| END| 59.25|3.Flocks to report | 0.68| 22013|2 2019-06-25 09:19:49,096|FF|app-20190625091850-0161|10|4|START| 59.25|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:19:49,152|FF|app-20190625091850-0161|10|4|START| 59.30|4a.Making expansions | 0.00| 0|2 2019-06-25 09:19:49,966|FF|app-20190625091850-0161|10|4| END| 60.12|4a.Making expansions | 0.81| 27766|2 2019-06-25 09:19:49,966|FF|app-20190625091850-0161|10|4|START| 60.12|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:19:50,980|FF|app-20190625091850-0161|10|4| END| 61.13|4b.Finding maximals | 1.01| 8150|2 2019-06-25 09:19:51,328|FF|app-20190625091850-0161|10|4| END| 61.48|4.Flocks prunned by expansion | 2.23| 8150|2 2019-06-25 09:19:51,328|FF|app-20190625091850-0161|10|4|START| 61.48|5.Flocks reported | 0.00| 0|2 2019-06-25 09:19:51,755|FF|app-20190625091850-0161|10|4| END| 61.91|5.Flocks reported | 0.43| 8150|2 2019-06-25 09:19:51,755|FF|app-20190625091850-0161|10|4|START| 61.91|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:19:53,167|FF|app-20190625091850-0161|10|4| END| 63.32|6.Candidates indexed | 1.41| 12396|2 2019-06-25 09:19:53,167|FF|app-20190625091850-0161|10|4|START| 63.32|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:19:53,168|MF|app-20190625091850-0161|10|4|START| 63.32|A.Points indexed | 0.00| 0|3 2019-06-25 09:19:53,263|MF|app-20190625091850-0161|10|4| END| 63.41|A.Points indexed | 0.10| 37096|3 2019-06-25 09:19:53,263|MF|app-20190625091850-0161|10|4|START| 63.41|B.Pairs found | 0.00| 0|3 2019-06-25 09:19:53,825|MF|app-20190625091850-0161|10|4| END| 63.98|B.Pairs found | 0.56| 49914|3 2019-06-25 09:19:53,825|MF|app-20190625091850-0161|10|4|START| 63.98|C.Centers found | 0.00| 0|3 2019-06-25 09:19:55,052|MF|app-20190625091850-0161|10|4| END| 65.20|C.Centers found | 1.23| 99828|3 2019-06-25 09:19:55,052|MF|app-20190625091850-0161|10|4|START| 65.20|D.Disks found | 0.00| 0|3 2019-06-25 09:19:59,488|MF|app-20190625091850-0161|10|4| END| 69.64|D.Disks found | 4.44| 36620|3 2019-06-25 09:19:59,488|MF|app-20190625091850-0161|10|4|START| 69.64|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:20:02,388|MF|app-20190625091850-0161|10|4| END| 72.54|E.Disks partitioned | 2.90| 48737|3 2019-06-25 09:20:02,388|MF|app-20190625091850-0161|10|4|START| 72.54|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:20:02,389|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:20:02,389|Cell area: 1055533.7681000116 2019-06-25 09:20:05,262|MF|app-20190625091850-0161|10|4| END| 75.41|F.Maximal disks found | 2.87| 11852|3 2019-06-25 09:20:05,262|MAXIMALS|app-20190625091850-0161|4|10|80.0|3|900|12.094|11852 2019-06-25 09:20:06,646|FF|app-20190625091850-0161|10|4| END| 76.80|1.Maximal disks found | 13.48| 11852|3 2019-06-25 09:20:06,646|FF|app-20190625091850-0161|10|4|START| 76.80|2.Join done | 0.00| 0|3 2019-06-25 09:20:13,982|FF|app-20190625091850-0161|10|4| END| 84.13|2.Join done | 7.34| 24689|3 2019-06-25 09:20:13,982|FF|app-20190625091850-0161|10|4|START| 84.13|3.Flocks to report | 0.00| 0|3 2019-06-25 09:20:15,513|FF|app-20190625091850-0161|10|4| END| 85.66|3.Flocks to report | 1.53| 20688|3 2019-06-25 09:20:15,514|FF|app-20190625091850-0161|10|4|START| 85.67|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:20:15,604|FF|app-20190625091850-0161|10|4|START| 85.76|4a.Making expansions | 0.00| 0|3 2019-06-25 09:20:17,469|FF|app-20190625091850-0161|10|4| END| 87.62|4a.Making expansions | 1.87| 26563|3 2019-06-25 09:20:17,469|FF|app-20190625091850-0161|10|4|START| 87.62|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:20:18,749|FF|app-20190625091850-0161|10|4| END| 88.90|4b.Finding maximals | 1.28| 8256|3 2019-06-25 09:20:19,323|FF|app-20190625091850-0161|10|4| END| 89.47|4.Flocks prunned by expansion | 3.81| 8256|3 2019-06-25 09:20:19,323|FF|app-20190625091850-0161|10|4|START| 89.47|5.Flocks reported | 0.00| 0|3 2019-06-25 09:20:20,259|FF|app-20190625091850-0161|10|4| END| 90.41|5.Flocks reported | 0.94| 8256|3 2019-06-25 09:20:20,260|FF|app-20190625091850-0161|10|4|START| 90.41|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:20:23,065|FF|app-20190625091850-0161|10|4| END| 93.22|6.Candidates indexed | 2.81| 12984|3 2019-06-25 09:20:24,581|Number of flocks: 16406 2019-06-25 09:20:25,563|PFLOCK|app-20190625091850-0161|4|10|80.0|3|3|88.38|16406 2019-06-25 09:20:26,483|FF|app-20190625091850-0161|10|4| END| 96.63|Flock Finder run | 90.28| 16406|3 2019-06-25 09:20:26,483|FF|app-20190625091850-0161|10|4|START| 96.63|Session closed | 0.00| 0|3 2019-06-25 09:20:33,274|FF|app-20190625091850-0161|10|4| END|103.43|Session closed | 6.79| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 80 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:20:35,292|FF|app-00000000000000-0000|5|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 09:20:36,378|FF|app-20190625092036-0162|5|4| END| 1.07|Session start | 1.09| 0|-1 2019-06-25 09:20:36,378|FF|app-20190625092036-0162|5|4|START| 1.07|Data read | 0.00| 0|-1 2019-06-25 09:20:40,214|FF|app-20190625092036-0162|5|4| END| 4.91|Data read | 3.84|110376|-1 2019-06-25 09:20:40,215|FF|app-20190625092036-0162|5|4|START| 4.91|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:20:40,350|FF|app-20190625092036-0162|5|4| END| 5.04|KDBTree partitioner | 0.14| 272|-1 2019-06-25 09:20:40,350|FF|app-20190625092036-0162|5|4|START| 5.04|MF partitioner | 0.00| 0|-1 2019-06-25 09:20:40,359|FF|app-20190625092036-0162|5|4| END| 5.05|MF partitioner | 0.01| 450|-1 2019-06-25 09:20:40,359|FF|app-20190625092036-0162|5|4|START| 5.05|Pointset done | 0.00| 0|-1 2019-06-25 09:20:41,094|FF|app-20190625092036-0162|5|4| END| 5.79|Pointset done | 0.74| 4|-1 2019-06-25 09:20:41,094|FF|app-20190625092036-0162|5|4|START| 5.79|Flock Finder run | 0.00| 0|-1 2019-06-25 09:20:41,248|FF|app-20190625092036-0162|5|4|START| 5.94|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:20:41,251|MF|app-20190625092036-0162|5|4|START| 5.94|A.Points indexed | 0.00| 0|0 2019-06-25 09:20:41,432|MF|app-20190625092036-0162|5|4| END| 6.12|A.Points indexed | 0.18| 18093|0 2019-06-25 09:20:41,432|MF|app-20190625092036-0162|5|4|START| 6.12|B.Pairs found | 0.00| 0|0 2019-06-25 09:20:42,718|MF|app-20190625092036-0162|5|4| END| 7.41|B.Pairs found | 1.29| 23893|0 2019-06-25 09:20:42,718|MF|app-20190625092036-0162|5|4|START| 7.41|C.Centers found | 0.00| 0|0 2019-06-25 09:20:43,493|MF|app-20190625092036-0162|5|4| END| 8.18|C.Centers found | 0.78| 47786|0 2019-06-25 09:20:43,493|MF|app-20190625092036-0162|5|4|START| 8.18|D.Disks found | 0.00| 0|0 2019-06-25 09:20:46,155|MF|app-20190625092036-0162|5|4| END| 10.85|D.Disks found | 2.66| 17451|0 2019-06-25 09:20:46,155|MF|app-20190625092036-0162|5|4|START| 10.85|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:20:46,943|MF|app-20190625092036-0162|5|4| END| 11.63|E.Disks partitioned | 0.79| 23231|0 2019-06-25 09:20:46,943|MF|app-20190625092036-0162|5|4|START| 11.63|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:20:46,945|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:20:46,945|Cell area: 1055533.7681000116 2019-06-25 09:20:48,846|MF|app-20190625092036-0162|5|4| END| 13.54|F.Maximal disks found | 1.90| 5681|0 2019-06-25 09:20:48,846|MAXIMALS|app-20190625092036-0162|4|5|80.0|3|450|7.595|5681 2019-06-25 09:20:49,329|FF|app-20190625092036-0162|5|4| END| 14.02|1.Maximal disks found | 8.08| 5681|0 2019-06-25 09:20:49,329|FF|app-20190625092036-0162|5|4|START| 14.02|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:20:49,329|MF|app-20190625092036-0162|5|4|START| 14.02|A.Points indexed | 0.00| 0|1 2019-06-25 09:20:49,406|MF|app-20190625092036-0162|5|4| END| 14.10|A.Points indexed | 0.08| 18245|1 2019-06-25 09:20:49,407|MF|app-20190625092036-0162|5|4|START| 14.10|B.Pairs found | 0.00| 0|1 2019-06-25 09:20:49,833|MF|app-20190625092036-0162|5|4| END| 14.52|B.Pairs found | 0.43| 24243|1 2019-06-25 09:20:49,833|MF|app-20190625092036-0162|5|4|START| 14.52|C.Centers found | 0.00| 0|1 2019-06-25 09:20:50,233|MF|app-20190625092036-0162|5|4| END| 14.92|C.Centers found | 0.40| 48486|1 2019-06-25 09:20:50,233|MF|app-20190625092036-0162|5|4|START| 14.92|D.Disks found | 0.00| 0|1 2019-06-25 09:20:52,011|MF|app-20190625092036-0162|5|4| END| 16.70|D.Disks found | 1.78| 17763|1 2019-06-25 09:20:52,012|MF|app-20190625092036-0162|5|4|START| 16.70|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:20:52,714|MF|app-20190625092036-0162|5|4| END| 17.41|E.Disks partitioned | 0.70| 23611|1 2019-06-25 09:20:52,714|MF|app-20190625092036-0162|5|4|START| 17.41|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:20:52,715|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:20:52,715|Cell area: 1055533.7681000116 2019-06-25 09:20:54,345|MF|app-20190625092036-0162|5|4| END| 19.04|F.Maximal disks found | 1.63| 5752|1 2019-06-25 09:20:54,345|MAXIMALS|app-20190625092036-0162|4|5|80.0|3|450|5.016|5752 2019-06-25 09:20:54,775|FF|app-20190625092036-0162|5|4| END| 19.47|1.Maximal disks found | 5.45| 5752|1 2019-06-25 09:20:54,776|FF|app-20190625092036-0162|5|4|START| 19.47|2.Join done | 0.00| 0|1 2019-06-25 09:20:56,605|FF|app-20190625092036-0162|5|4| END| 21.30|2.Join done | 1.83| 8996|1 2019-06-25 09:20:56,605|FF|app-20190625092036-0162|5|4|START| 21.30|3.Flocks to report | 0.00| 0|1 2019-06-25 09:20:56,914|FF|app-20190625092036-0162|5|4| END| 21.61|3.Flocks to report | 0.31| 0|1 2019-06-25 09:20:56,915|FF|app-20190625092036-0162|5|4|START| 21.61|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:20:56,952|FF|app-20190625092036-0162|5|4| END| 21.64|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 09:20:56,952|FF|app-20190625092036-0162|5|4|START| 21.64|5.Flocks reported | 0.00| 0|1 2019-06-25 09:20:56,957|FF|app-20190625092036-0162|5|4| END| 21.65|5.Flocks reported | 0.01| 0|1 2019-06-25 09:20:56,957|FF|app-20190625092036-0162|5|4|START| 21.65|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:20:57,993|FF|app-20190625092036-0162|5|4| END| 22.68|6.Candidates indexed | 1.04| 9351|1 2019-06-25 09:20:57,993|FF|app-20190625092036-0162|5|4|START| 22.68|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:20:57,993|MF|app-20190625092036-0162|5|4|START| 22.68|A.Points indexed | 0.00| 0|2 2019-06-25 09:20:58,060|MF|app-20190625092036-0162|5|4| END| 22.75|A.Points indexed | 0.07| 18394|2 2019-06-25 09:20:58,060|MF|app-20190625092036-0162|5|4|START| 22.75|B.Pairs found | 0.00| 0|2 2019-06-25 09:20:58,466|MF|app-20190625092036-0162|5|4| END| 23.16|B.Pairs found | 0.41| 24570|2 2019-06-25 09:20:58,466|MF|app-20190625092036-0162|5|4|START| 23.16|C.Centers found | 0.00| 0|2 2019-06-25 09:20:58,874|MF|app-20190625092036-0162|5|4| END| 23.57|C.Centers found | 0.41| 49140|2 2019-06-25 09:20:58,874|MF|app-20190625092036-0162|5|4|START| 23.57|D.Disks found | 0.00| 0|2 2019-06-25 09:21:00,764|MF|app-20190625092036-0162|5|4| END| 25.46|D.Disks found | 1.89| 18008|2 2019-06-25 09:21:00,764|MF|app-20190625092036-0162|5|4|START| 25.46|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:21:01,368|MF|app-20190625092036-0162|5|4| END| 26.06|E.Disks partitioned | 0.60| 23955|2 2019-06-25 09:21:01,369|MF|app-20190625092036-0162|5|4|START| 26.06|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:21:01,369|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:21:01,369|Cell area: 1055533.7681000116 2019-06-25 09:21:03,100|MF|app-20190625092036-0162|5|4| END| 27.79|F.Maximal disks found | 1.73| 5821|2 2019-06-25 09:21:03,100|MAXIMALS|app-20190625092036-0162|4|5|80.0|3|450|5.107|5821 2019-06-25 09:21:03,534|FF|app-20190625092036-0162|5|4| END| 28.23|1.Maximal disks found | 5.54| 5821|2 2019-06-25 09:21:03,534|FF|app-20190625092036-0162|5|4|START| 28.23|2.Join done | 0.00| 0|2 2019-06-25 09:21:08,251|FF|app-20190625092036-0162|5|4| END| 32.94|2.Join done | 4.72| 12766|2 2019-06-25 09:21:08,252|FF|app-20190625092036-0162|5|4|START| 32.94|3.Flocks to report | 0.00| 0|2 2019-06-25 09:21:09,115|FF|app-20190625092036-0162|5|4| END| 33.81|3.Flocks to report | 0.86| 11004|2 2019-06-25 09:21:09,115|FF|app-20190625092036-0162|5|4|START| 33.81|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:21:09,174|FF|app-20190625092036-0162|5|4|START| 33.87|4a.Making expansions | 0.00| 0|2 2019-06-25 09:21:10,063|FF|app-20190625092036-0162|5|4| END| 34.75|4a.Making expansions | 0.89| 13852|2 2019-06-25 09:21:10,063|FF|app-20190625092036-0162|5|4|START| 34.75|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:21:11,022|FF|app-20190625092036-0162|5|4| END| 35.71|4b.Finding maximals | 0.96| 4075|2 2019-06-25 09:21:11,334|FF|app-20190625092036-0162|5|4| END| 36.03|4.Flocks prunned by expansion | 2.22| 4075|2 2019-06-25 09:21:11,334|FF|app-20190625092036-0162|5|4|START| 36.03|5.Flocks reported | 0.00| 0|2 2019-06-25 09:21:11,813|FF|app-20190625092036-0162|5|4| END| 36.50|5.Flocks reported | 0.48| 4075|2 2019-06-25 09:21:11,813|FF|app-20190625092036-0162|5|4|START| 36.50|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:21:13,835|FF|app-20190625092036-0162|5|4| END| 38.53|6.Candidates indexed | 2.02| 6197|2 2019-06-25 09:21:13,836|FF|app-20190625092036-0162|5|4|START| 38.53|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:21:13,836|MF|app-20190625092036-0162|5|4|START| 38.53|A.Points indexed | 0.00| 0|3 2019-06-25 09:21:13,898|MF|app-20190625092036-0162|5|4| END| 38.59|A.Points indexed | 0.06| 18548|3 2019-06-25 09:21:13,898|MF|app-20190625092036-0162|5|4|START| 38.59|B.Pairs found | 0.00| 0|3 2019-06-25 09:21:14,488|MF|app-20190625092036-0162|5|4| END| 39.18|B.Pairs found | 0.59| 24957|3 2019-06-25 09:21:14,488|MF|app-20190625092036-0162|5|4|START| 39.18|C.Centers found | 0.00| 0|3 2019-06-25 09:21:15,092|MF|app-20190625092036-0162|5|4| END| 39.78|C.Centers found | 0.60| 49914|3 2019-06-25 09:21:15,093|MF|app-20190625092036-0162|5|4|START| 39.78|D.Disks found | 0.00| 0|3 2019-06-25 09:21:17,865|MF|app-20190625092036-0162|5|4| END| 42.56|D.Disks found | 2.77| 18310|3 2019-06-25 09:21:17,865|MF|app-20190625092036-0162|5|4|START| 42.56|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:21:18,666|MF|app-20190625092036-0162|5|4| END| 43.36|E.Disks partitioned | 0.80| 24367|3 2019-06-25 09:21:18,666|MF|app-20190625092036-0162|5|4|START| 43.36|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:21:18,667|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:21:18,667|Cell area: 1055533.7681000116 2019-06-25 09:21:20,656|MF|app-20190625092036-0162|5|4| END| 45.35|F.Maximal disks found | 1.99| 5926|3 2019-06-25 09:21:20,656|MAXIMALS|app-20190625092036-0162|4|5|80.0|3|450|6.82|5926 2019-06-25 09:21:21,074|FF|app-20190625092036-0162|5|4| END| 45.77|1.Maximal disks found | 7.24| 5926|3 2019-06-25 09:21:21,074|FF|app-20190625092036-0162|5|4|START| 45.77|2.Join done | 0.00| 0|3 2019-06-25 09:21:23,486|FF|app-20190625092036-0162|5|4| END| 48.18|2.Join done | 2.41| 12337|3 2019-06-25 09:21:23,486|FF|app-20190625092036-0162|5|4|START| 48.18|3.Flocks to report | 0.00| 0|3 2019-06-25 09:21:24,020|FF|app-20190625092036-0162|5|4| END| 48.71|3.Flocks to report | 0.53| 10340|3 2019-06-25 09:21:24,020|FF|app-20190625092036-0162|5|4|START| 48.71|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:21:24,060|FF|app-20190625092036-0162|5|4|START| 48.75|4a.Making expansions | 0.00| 0|3 2019-06-25 09:21:24,562|FF|app-20190625092036-0162|5|4| END| 49.25|4a.Making expansions | 0.50| 13279|3 2019-06-25 09:21:24,562|FF|app-20190625092036-0162|5|4|START| 49.25|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:21:25,189|FF|app-20190625092036-0162|5|4| END| 49.88|4b.Finding maximals | 0.63| 4128|3 2019-06-25 09:21:25,369|FF|app-20190625092036-0162|5|4| END| 50.06|4.Flocks prunned by expansion | 1.35| 4128|3 2019-06-25 09:21:25,369|FF|app-20190625092036-0162|5|4|START| 50.06|5.Flocks reported | 0.00| 0|3 2019-06-25 09:21:25,672|FF|app-20190625092036-0162|5|4| END| 50.36|5.Flocks reported | 0.30| 4128|3 2019-06-25 09:21:25,672|FF|app-20190625092036-0162|5|4|START| 50.36|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:21:27,039|FF|app-20190625092036-0162|5|4| END| 51.73|6.Candidates indexed | 1.37| 6487|3 2019-06-25 09:21:27,743|Number of flocks: 8203 2019-06-25 09:21:28,163|PFLOCK|app-20190625092036-0162|4|5|80.0|3|3|46.65|8203 2019-06-25 09:21:28,555|FF|app-20190625092036-0162|5|4| END| 53.25|Flock Finder run | 47.46| 8203|3 2019-06-25 09:21:28,555|FF|app-20190625092036-0162|5|4|START| 53.25|Session closed | 0.00| 0|3 2019-06-25 09:21:35,479|FF|app-20190625092036-0162|5|4| END| 60.17|Session closed | 6.92| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:21:37,434|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 09:21:38,541|FF|app-20190625092138-0163|15|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 09:21:38,542|FF|app-20190625092138-0163|15|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 09:21:42,818|FF|app-20190625092138-0163|15|4| END| 5.37|Data read | 4.28|331128|-1 2019-06-25 09:21:42,819|FF|app-20190625092138-0163|15|4|START| 5.37|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:21:43,136|FF|app-20190625092138-0163|15|4| END| 5.68|KDBTree partitioner | 0.32| 816|-1 2019-06-25 09:21:43,136|FF|app-20190625092138-0163|15|4|START| 5.69|MF partitioner | 0.00| 0|-1 2019-06-25 09:21:43,161|FF|app-20190625092138-0163|15|4| END| 5.71|MF partitioner | 0.03| 1350|-1 2019-06-25 09:21:43,162|FF|app-20190625092138-0163|15|4|START| 5.71|Pointset done | 0.00| 0|-1 2019-06-25 09:21:44,269|FF|app-20190625092138-0163|15|4| END| 6.82|Pointset done | 1.11| 4|-1 2019-06-25 09:21:44,269|FF|app-20190625092138-0163|15|4|START| 6.82|Flock Finder run | 0.00| 0|-1 2019-06-25 09:21:44,288|FF|app-20190625092138-0163|15|4|START| 6.84|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:21:44,291|MF|app-20190625092138-0163|15|4|START| 6.84|A.Points indexed | 0.00| 0|0 2019-06-25 09:21:44,514|MF|app-20190625092138-0163|15|4| END| 7.06|A.Points indexed | 0.22| 54279|0 2019-06-25 09:21:44,514|MF|app-20190625092138-0163|15|4|START| 7.06|B.Pairs found | 0.00| 0|0 2019-06-25 09:21:46,630|MF|app-20190625092138-0163|15|4| END| 9.18|B.Pairs found | 2.12| 86157|0 2019-06-25 09:21:46,631|MF|app-20190625092138-0163|15|4|START| 9.18|C.Centers found | 0.00| 0|0 2019-06-25 09:21:48,291|MF|app-20190625092138-0163|15|4| END| 10.84|C.Centers found | 1.66|172314|0 2019-06-25 09:21:48,291|MF|app-20190625092138-0163|15|4|START| 10.84|D.Disks found | 0.00| 0|0 2019-06-25 09:21:56,617|MF|app-20190625092138-0163|15|4| END| 19.17|D.Disks found | 8.33| 67818|0 2019-06-25 09:21:56,617|MF|app-20190625092138-0163|15|4|START| 19.17|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:21:59,355|MF|app-20190625092138-0163|15|4| END| 21.90|E.Disks partitioned | 2.74| 93058|0 2019-06-25 09:21:59,356|MF|app-20190625092138-0163|15|4|START| 21.91|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:21:59,358|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:21:59,358|Cell area: 1055533.7681000116 2019-06-25 09:22:04,085|MF|app-20190625092138-0163|15|4| END| 26.63|F.Maximal disks found | 4.73| 20937|0 2019-06-25 09:22:04,085|MAXIMALS|app-20190625092138-0163|4|15|90.0|3|1350|19.794|20937 2019-06-25 09:22:05,142|FF|app-20190625092138-0163|15|4| END| 27.69|1.Maximal disks found | 20.85| 20937|0 2019-06-25 09:22:05,142|FF|app-20190625092138-0163|15|4|START| 27.69|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:22:05,142|MF|app-20190625092138-0163|15|4|START| 27.69|A.Points indexed | 0.00| 0|1 2019-06-25 09:22:05,270|MF|app-20190625092138-0163|15|4| END| 27.82|A.Points indexed | 0.13| 54735|1 2019-06-25 09:22:05,270|MF|app-20190625092138-0163|15|4|START| 27.82|B.Pairs found | 0.00| 0|1 2019-06-25 09:22:06,299|MF|app-20190625092138-0163|15|4| END| 28.85|B.Pairs found | 1.03| 87324|1 2019-06-25 09:22:06,300|MF|app-20190625092138-0163|15|4|START| 28.85|C.Centers found | 0.00| 0|1 2019-06-25 09:22:07,937|MF|app-20190625092138-0163|15|4| END| 30.49|C.Centers found | 1.64|174648|1 2019-06-25 09:22:07,938|MF|app-20190625092138-0163|15|4|START| 30.49|D.Disks found | 0.00| 0|1 2019-06-25 09:22:12,809|MF|app-20190625092138-0163|15|4| END| 35.36|D.Disks found | 4.87| 68973|1 2019-06-25 09:22:12,809|MF|app-20190625092138-0163|15|4|START| 35.36|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:22:13,833|MF|app-20190625092138-0163|15|4| END| 36.38|E.Disks partitioned | 1.02| 94410|1 2019-06-25 09:22:13,833|MF|app-20190625092138-0163|15|4|START| 36.38|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:22:13,833|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:22:13,833|Cell area: 1055533.7681000116 2019-06-25 09:22:18,037|MF|app-20190625092138-0163|15|4| END| 40.59|F.Maximal disks found | 4.20| 21134|1 2019-06-25 09:22:18,037|MAXIMALS|app-20190625092138-0163|4|15|90.0|3|1350|12.895|21134 2019-06-25 09:22:19,090|FF|app-20190625092138-0163|15|4| END| 41.64|1.Maximal disks found | 13.95| 21134|1 2019-06-25 09:22:19,091|FF|app-20190625092138-0163|15|4|START| 41.64|2.Join done | 0.00| 0|1 2019-06-25 09:22:21,695|FF|app-20190625092138-0163|15|4| END| 44.24|2.Join done | 2.61| 37959|1 2019-06-25 09:22:21,695|FF|app-20190625092138-0163|15|4|START| 44.24|3.Flocks to report | 0.00| 0|1 2019-06-25 09:22:22,183|FF|app-20190625092138-0163|15|4| END| 44.73|3.Flocks to report | 0.49| 0|1 2019-06-25 09:22:22,183|FF|app-20190625092138-0163|15|4|START| 44.73|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:22:22,255|FF|app-20190625092138-0163|15|4| END| 44.80|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 09:22:22,255|FF|app-20190625092138-0163|15|4|START| 44.80|5.Flocks reported | 0.00| 0|1 2019-06-25 09:22:22,259|FF|app-20190625092138-0163|15|4| END| 44.81|5.Flocks reported | 0.00| 0|1 2019-06-25 09:22:22,259|FF|app-20190625092138-0163|15|4|START| 44.81|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:22:23,706|FF|app-20190625092138-0163|15|4| END| 46.26|6.Candidates indexed | 1.45| 39178|1 2019-06-25 09:22:23,706|FF|app-20190625092138-0163|15|4|START| 46.26|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:22:23,706|MF|app-20190625092138-0163|15|4|START| 46.26|A.Points indexed | 0.00| 0|2 2019-06-25 09:22:23,831|MF|app-20190625092138-0163|15|4| END| 46.38|A.Points indexed | 0.13| 55182|2 2019-06-25 09:22:23,831|MF|app-20190625092138-0163|15|4|START| 46.38|B.Pairs found | 0.00| 0|2 2019-06-25 09:22:24,667|MF|app-20190625092138-0163|15|4| END| 47.22|B.Pairs found | 0.84| 88509|2 2019-06-25 09:22:24,667|MF|app-20190625092138-0163|15|4|START| 47.22|C.Centers found | 0.00| 0|2 2019-06-25 09:22:25,863|MF|app-20190625092138-0163|15|4| END| 48.41|C.Centers found | 1.20|177018|2 2019-06-25 09:22:25,863|MF|app-20190625092138-0163|15|4|START| 48.41|D.Disks found | 0.00| 0|2 2019-06-25 09:22:30,405|MF|app-20190625092138-0163|15|4| END| 52.95|D.Disks found | 4.54| 69927|2 2019-06-25 09:22:30,405|MF|app-20190625092138-0163|15|4|START| 52.95|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:22:31,687|MF|app-20190625092138-0163|15|4| END| 54.24|E.Disks partitioned | 1.28| 95823|2 2019-06-25 09:22:31,687|MF|app-20190625092138-0163|15|4|START| 54.24|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:22:31,688|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:22:31,688|Cell area: 1055533.7681000116 2019-06-25 09:22:35,953|MF|app-20190625092138-0163|15|4| END| 58.50|F.Maximal disks found | 4.27| 21483|2 2019-06-25 09:22:35,953|MAXIMALS|app-20190625092138-0163|4|15|90.0|3|1350|12.247|21483 2019-06-25 09:22:36,978|FF|app-20190625092138-0163|15|4| END| 59.53|1.Maximal disks found | 13.27| 21483|2 2019-06-25 09:22:36,978|FF|app-20190625092138-0163|15|4|START| 59.53|2.Join done | 0.00| 0|2 2019-06-25 09:22:45,427|FF|app-20190625092138-0163|15|4| END| 67.98|2.Join done | 8.45| 60752|2 2019-06-25 09:22:45,427|FF|app-20190625092138-0163|15|4|START| 67.98|3.Flocks to report | 0.00| 0|2 2019-06-25 09:22:47,457|FF|app-20190625092138-0163|15|4| END| 70.01|3.Flocks to report | 2.03| 52714|2 2019-06-25 09:22:47,457|FF|app-20190625092138-0163|15|4|START| 70.01|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:22:47,544|FF|app-20190625092138-0163|15|4|START| 70.09|4a.Making expansions | 0.00| 0|2 2019-06-25 09:22:48,521|FF|app-20190625092138-0163|15|4| END| 71.07|4a.Making expansions | 0.98| 65786|2 2019-06-25 09:22:48,521|FF|app-20190625092138-0163|15|4|START| 71.07|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:22:51,814|FF|app-20190625092138-0163|15|4| END| 74.36|4b.Finding maximals | 3.29| 14592|2 2019-06-25 09:22:52,259|FF|app-20190625092138-0163|15|4| END| 74.81|4.Flocks prunned by expansion | 4.80| 14592|2 2019-06-25 09:22:52,259|FF|app-20190625092138-0163|15|4|START| 74.81|5.Flocks reported | 0.00| 0|2 2019-06-25 09:22:52,836|FF|app-20190625092138-0163|15|4| END| 75.39|5.Flocks reported | 0.58| 14592|2 2019-06-25 09:22:52,837|FF|app-20190625092138-0163|15|4|START| 75.39|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:22:54,531|FF|app-20190625092138-0163|15|4| END| 77.08|6.Candidates indexed | 1.70| 23966|2 2019-06-25 09:22:54,532|FF|app-20190625092138-0163|15|4|START| 77.08|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:22:54,532|MF|app-20190625092138-0163|15|4|START| 77.08|A.Points indexed | 0.00| 0|3 2019-06-25 09:22:54,643|MF|app-20190625092138-0163|15|4| END| 77.19|A.Points indexed | 0.11| 55644|3 2019-06-25 09:22:54,643|MF|app-20190625092138-0163|15|4|START| 77.19|B.Pairs found | 0.00| 0|3 2019-06-25 09:22:55,351|MF|app-20190625092138-0163|15|4| END| 77.90|B.Pairs found | 0.71| 90000|3 2019-06-25 09:22:55,352|MF|app-20190625092138-0163|15|4|START| 77.90|C.Centers found | 0.00| 0|3 2019-06-25 09:22:56,852|MF|app-20190625092138-0163|15|4| END| 79.40|C.Centers found | 1.50|180000|3 2019-06-25 09:22:56,852|MF|app-20190625092138-0163|15|4|START| 79.40|D.Disks found | 0.00| 0|3 2019-06-25 09:23:00,302|MF|app-20190625092138-0163|15|4| END| 82.85|D.Disks found | 3.45| 71127|3 2019-06-25 09:23:00,302|MF|app-20190625092138-0163|15|4|START| 82.85|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:23:01,206|MF|app-20190625092138-0163|15|4| END| 83.76|E.Disks partitioned | 0.90| 97462|3 2019-06-25 09:23:01,206|MF|app-20190625092138-0163|15|4|START| 83.76|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:23:01,206|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:23:01,206|Cell area: 1055533.7681000116 2019-06-25 09:23:05,867|MF|app-20190625092138-0163|15|4| END| 88.42|F.Maximal disks found | 4.66| 21988|3 2019-06-25 09:23:05,867|MAXIMALS|app-20190625092138-0163|4|15|90.0|3|1350|11.335|21988 2019-06-25 09:23:06,866|FF|app-20190625092138-0163|15|4| END| 89.42|1.Maximal disks found | 12.34| 21988|3 2019-06-25 09:23:06,866|FF|app-20190625092138-0163|15|4|START| 89.42|2.Join done | 0.00| 0|3 2019-06-25 09:23:13,805|FF|app-20190625092138-0163|15|4| END| 96.35|2.Join done | 6.94| 56920|3 2019-06-25 09:23:13,805|FF|app-20190625092138-0163|15|4|START| 96.35|3.Flocks to report | 0.00| 0|3 2019-06-25 09:23:16,899|FF|app-20190625092138-0163|15|4| END| 99.45|3.Flocks to report | 3.09| 48322|3 2019-06-25 09:23:16,899|FF|app-20190625092138-0163|15|4|START| 99.45|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:23:17,040|FF|app-20190625092138-0163|15|4|START| 99.59|4a.Making expansions | 0.00| 0|3 2019-06-25 09:23:18,244|FF|app-20190625092138-0163|15|4| END|100.79|4a.Making expansions | 1.20| 61638|3 2019-06-25 09:23:18,244|FF|app-20190625092138-0163|15|4|START|100.79|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:23:20,444|FF|app-20190625092138-0163|15|4| END|102.99|4b.Finding maximals | 2.20| 14847|3 2019-06-25 09:23:20,923|FF|app-20190625092138-0163|15|4| END|103.47|4.Flocks prunned by expansion | 4.02| 14847|3 2019-06-25 09:23:20,924|FF|app-20190625092138-0163|15|4|START|103.47|5.Flocks reported | 0.00| 0|3 2019-06-25 09:23:21,519|FF|app-20190625092138-0163|15|4| END|104.07|5.Flocks reported | 0.60| 14847|3 2019-06-25 09:23:21,520|FF|app-20190625092138-0163|15|4|START|104.07|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:23:23,577|FF|app-20190625092138-0163|15|4| END|106.13|6.Candidates indexed | 2.06| 24850|3 2019-06-25 09:23:24,927|Number of flocks: 29439 2019-06-25 09:23:25,868|PFLOCK|app-20190625092138-0163|4|15|90.0|3|3|100.66|29439 2019-06-25 09:23:26,800|FF|app-20190625092138-0163|15|4| END|109.35|Flock Finder run |102.53| 29439|3 2019-06-25 09:23:26,800|FF|app-20190625092138-0163|15|4|START|109.35|Session closed | 0.00| 0|3 2019-06-25 09:23:34,345|FF|app-20190625092138-0163|15|4| END|116.89|Session closed | 7.55| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:23:36,341|FF|app-00000000000000-0000|10|4|START| 0.13|Session start | 0.00| 0|-1 2019-06-25 09:23:37,430|FF|app-20190625092337-0164|10|4| END| 1.07|Session start | 1.09| 0|-1 2019-06-25 09:23:37,431|FF|app-20190625092337-0164|10|4|START| 1.07|Data read | 0.00| 0|-1 2019-06-25 09:23:41,604|FF|app-20190625092337-0164|10|4| END| 5.25|Data read | 4.17|220752|-1 2019-06-25 09:23:41,604|FF|app-20190625092337-0164|10|4|START| 5.25|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:23:41,745|FF|app-20190625092337-0164|10|4| END| 5.39|KDBTree partitioner | 0.14| 544|-1 2019-06-25 09:23:41,745|FF|app-20190625092337-0164|10|4|START| 5.39|MF partitioner | 0.00| 0|-1 2019-06-25 09:23:41,763|FF|app-20190625092337-0164|10|4| END| 5.40|MF partitioner | 0.02| 900|-1 2019-06-25 09:23:41,763|FF|app-20190625092337-0164|10|4|START| 5.41|Pointset done | 0.00| 0|-1 2019-06-25 09:23:42,668|FF|app-20190625092337-0164|10|4| END| 6.31|Pointset done | 0.91| 4|-1 2019-06-25 09:23:42,668|FF|app-20190625092337-0164|10|4|START| 6.31|Flock Finder run | 0.00| 0|-1 2019-06-25 09:23:42,690|FF|app-20190625092337-0164|10|4|START| 6.33|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:23:42,692|MF|app-20190625092337-0164|10|4|START| 6.33|A.Points indexed | 0.00| 0|0 2019-06-25 09:23:42,859|MF|app-20190625092337-0164|10|4| END| 6.50|A.Points indexed | 0.17| 36186|0 2019-06-25 09:23:42,860|MF|app-20190625092337-0164|10|4|START| 6.50|B.Pairs found | 0.00| 0|0 2019-06-25 09:23:44,570|MF|app-20190625092337-0164|10|4| END| 8.21|B.Pairs found | 1.71| 57438|0 2019-06-25 09:23:44,570|MF|app-20190625092337-0164|10|4|START| 8.21|C.Centers found | 0.00| 0|0 2019-06-25 09:23:45,954|MF|app-20190625092337-0164|10|4| END| 9.60|C.Centers found | 1.38|114876|0 2019-06-25 09:23:45,954|MF|app-20190625092337-0164|10|4|START| 9.60|D.Disks found | 0.00| 0|0 2019-06-25 09:23:51,695|MF|app-20190625092337-0164|10|4| END| 15.34|D.Disks found | 5.74| 45212|0 2019-06-25 09:23:51,695|MF|app-20190625092337-0164|10|4|START| 15.34|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:23:53,936|MF|app-20190625092337-0164|10|4| END| 17.58|E.Disks partitioned | 2.24| 62040|0 2019-06-25 09:23:53,936|MF|app-20190625092337-0164|10|4|START| 17.58|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:23:53,938|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:23:53,938|Cell area: 1055533.7681000116 2019-06-25 09:23:58,974|MF|app-20190625092337-0164|10|4| END| 22.62|F.Maximal disks found | 5.04| 13955|0 2019-06-25 09:23:58,974|MAXIMALS|app-20190625092337-0164|4|10|90.0|3|900|16.282|13955 2019-06-25 09:23:59,976|FF|app-20190625092337-0164|10|4| END| 23.62|1.Maximal disks found | 17.29| 13955|0 2019-06-25 09:23:59,976|FF|app-20190625092337-0164|10|4|START| 23.62|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:23:59,976|MF|app-20190625092337-0164|10|4|START| 23.62|A.Points indexed | 0.00| 0|1 2019-06-25 09:24:00,077|MF|app-20190625092337-0164|10|4| END| 23.72|A.Points indexed | 0.10| 36490|1 2019-06-25 09:24:00,077|MF|app-20190625092337-0164|10|4|START| 23.72|B.Pairs found | 0.00| 0|1 2019-06-25 09:24:00,837|MF|app-20190625092337-0164|10|4| END| 24.48|B.Pairs found | 0.76| 58216|1 2019-06-25 09:24:00,837|MF|app-20190625092337-0164|10|4|START| 24.48|C.Centers found | 0.00| 0|1 2019-06-25 09:24:01,653|MF|app-20190625092337-0164|10|4| END| 25.29|C.Centers found | 0.82|116432|1 2019-06-25 09:24:01,653|MF|app-20190625092337-0164|10|4|START| 25.30|D.Disks found | 0.00| 0|1 2019-06-25 09:24:05,573|MF|app-20190625092337-0164|10|4| END| 29.22|D.Disks found | 3.92| 45982|1 2019-06-25 09:24:05,573|MF|app-20190625092337-0164|10|4|START| 29.22|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:24:07,063|MF|app-20190625092337-0164|10|4| END| 30.71|E.Disks partitioned | 1.49| 62923|1 2019-06-25 09:24:07,063|MF|app-20190625092337-0164|10|4|START| 30.71|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:24:07,063|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:24:07,063|Cell area: 1055533.7681000116 2019-06-25 09:24:11,458|MF|app-20190625092337-0164|10|4| END| 35.10|F.Maximal disks found | 4.40| 14084|1 2019-06-25 09:24:11,458|MAXIMALS|app-20190625092337-0164|4|10|90.0|3|900|11.482|14084 2019-06-25 09:24:12,199|FF|app-20190625092337-0164|10|4| END| 35.84|1.Maximal disks found | 12.22| 14084|1 2019-06-25 09:24:12,199|FF|app-20190625092337-0164|10|4|START| 35.84|2.Join done | 0.00| 0|1 2019-06-25 09:24:15,804|FF|app-20190625092337-0164|10|4| END| 39.45|2.Join done | 3.61| 25295|1 2019-06-25 09:24:15,804|FF|app-20190625092337-0164|10|4|START| 39.45|3.Flocks to report | 0.00| 0|1 2019-06-25 09:24:16,421|FF|app-20190625092337-0164|10|4| END| 40.06|3.Flocks to report | 0.62| 0|1 2019-06-25 09:24:16,421|FF|app-20190625092337-0164|10|4|START| 40.06|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:24:16,476|FF|app-20190625092337-0164|10|4| END| 40.12|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 09:24:16,476|FF|app-20190625092337-0164|10|4|START| 40.12|5.Flocks reported | 0.00| 0|1 2019-06-25 09:24:16,480|FF|app-20190625092337-0164|10|4| END| 40.12|5.Flocks reported | 0.00| 0|1 2019-06-25 09:24:16,480|FF|app-20190625092337-0164|10|4|START| 40.12|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:24:18,116|FF|app-20190625092337-0164|10|4| END| 41.76|6.Candidates indexed | 1.64| 26108|1 2019-06-25 09:24:18,116|FF|app-20190625092337-0164|10|4|START| 41.76|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:24:18,116|MF|app-20190625092337-0164|10|4|START| 41.76|A.Points indexed | 0.00| 0|2 2019-06-25 09:24:18,209|MF|app-20190625092337-0164|10|4| END| 41.85|A.Points indexed | 0.09| 36788|2 2019-06-25 09:24:18,209|MF|app-20190625092337-0164|10|4|START| 41.85|B.Pairs found | 0.00| 0|2 2019-06-25 09:24:18,939|MF|app-20190625092337-0164|10|4| END| 42.58|B.Pairs found | 0.73| 59006|2 2019-06-25 09:24:18,939|MF|app-20190625092337-0164|10|4|START| 42.58|C.Centers found | 0.00| 0|2 2019-06-25 09:24:19,592|MF|app-20190625092337-0164|10|4| END| 43.23|C.Centers found | 0.65|118012|2 2019-06-25 09:24:19,592|MF|app-20190625092337-0164|10|4|START| 43.23|D.Disks found | 0.00| 0|2 2019-06-25 09:24:24,125|MF|app-20190625092337-0164|10|4| END| 47.77|D.Disks found | 4.53| 46618|2 2019-06-25 09:24:24,125|MF|app-20190625092337-0164|10|4|START| 47.77|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:24:27,322|MF|app-20190625092337-0164|10|4| END| 50.96|E.Disks partitioned | 3.20| 63871|2 2019-06-25 09:24:27,322|MF|app-20190625092337-0164|10|4|START| 50.96|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:24:27,323|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:24:27,323|Cell area: 1055533.7681000116 2019-06-25 09:24:33,146|MF|app-20190625092337-0164|10|4| END| 56.79|F.Maximal disks found | 5.82| 14320|2 2019-06-25 09:24:33,146|MAXIMALS|app-20190625092337-0164|4|10|90.0|3|900|15.03|14320 2019-06-25 09:24:34,570|FF|app-20190625092337-0164|10|4| END| 58.21|1.Maximal disks found | 16.45| 14320|2 2019-06-25 09:24:34,570|FF|app-20190625092337-0164|10|4|START| 58.21|2.Join done | 0.00| 0|2 2019-06-25 09:24:47,694|FF|app-20190625092337-0164|10|4| END| 71.34|2.Join done | 13.12| 40483|2 2019-06-25 09:24:47,694|FF|app-20190625092337-0164|10|4|START| 71.34|3.Flocks to report | 0.00| 0|2 2019-06-25 09:24:49,972|FF|app-20190625092337-0164|10|4| END| 73.61|3.Flocks to report | 2.28| 35129|2 2019-06-25 09:24:49,972|FF|app-20190625092337-0164|10|4|START| 73.61|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:24:50,059|FF|app-20190625092337-0164|10|4|START| 73.70|4a.Making expansions | 0.00| 0|2 2019-06-25 09:24:52,442|FF|app-20190625092337-0164|10|4| END| 76.08|4a.Making expansions | 2.38| 43808|2 2019-06-25 09:24:52,442|FF|app-20190625092337-0164|10|4|START| 76.08|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:24:56,485|FF|app-20190625092337-0164|10|4| END| 80.13|4b.Finding maximals | 4.04| 9728|2 2019-06-25 09:24:57,167|FF|app-20190625092337-0164|10|4| END| 80.81|4.Flocks prunned by expansion | 7.20| 9728|2 2019-06-25 09:24:57,167|FF|app-20190625092337-0164|10|4|START| 80.81|5.Flocks reported | 0.00| 0|2 2019-06-25 09:24:58,086|FF|app-20190625092337-0164|10|4| END| 81.73|5.Flocks reported | 0.92| 9728|2 2019-06-25 09:24:58,086|FF|app-20190625092337-0164|10|4|START| 81.73|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:25:01,161|FF|app-20190625092337-0164|10|4| END| 84.80|6.Candidates indexed | 3.07| 15972|2 2019-06-25 09:25:01,161|FF|app-20190625092337-0164|10|4|START| 84.80|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:25:01,161|MF|app-20190625092337-0164|10|4|START| 84.80|A.Points indexed | 0.00| 0|3 2019-06-25 09:25:01,246|MF|app-20190625092337-0164|10|4| END| 84.89|A.Points indexed | 0.09| 37096|3 2019-06-25 09:25:01,246|MF|app-20190625092337-0164|10|4|START| 84.89|B.Pairs found | 0.00| 0|3 2019-06-25 09:25:01,968|MF|app-20190625092337-0164|10|4| END| 85.61|B.Pairs found | 0.72| 60000|3 2019-06-25 09:25:01,969|MF|app-20190625092337-0164|10|4|START| 85.61|C.Centers found | 0.00| 0|3 2019-06-25 09:25:02,717|MF|app-20190625092337-0164|10|4| END| 86.36|C.Centers found | 0.75|120000|3 2019-06-25 09:25:02,717|MF|app-20190625092337-0164|10|4|START| 86.36|D.Disks found | 0.00| 0|3 2019-06-25 09:25:07,272|MF|app-20190625092337-0164|10|4| END| 90.91|D.Disks found | 4.56| 47418|3 2019-06-25 09:25:07,273|MF|app-20190625092337-0164|10|4|START| 90.91|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:25:09,456|MF|app-20190625092337-0164|10|4| END| 93.10|E.Disks partitioned | 2.18| 64956|3 2019-06-25 09:25:09,456|MF|app-20190625092337-0164|10|4|START| 93.10|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:25:09,456|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:25:09,456|Cell area: 1055533.7681000116 2019-06-25 09:25:14,172|MF|app-20190625092337-0164|10|4| END| 97.81|F.Maximal disks found | 4.72| 14656|3 2019-06-25 09:25:14,172|MAXIMALS|app-20190625092337-0164|4|10|90.0|3|900|13.011|14656 2019-06-25 09:25:15,053|FF|app-20190625092337-0164|10|4| END| 98.70|1.Maximal disks found | 13.89| 14656|3 2019-06-25 09:25:15,053|FF|app-20190625092337-0164|10|4|START| 98.70|2.Join done | 0.00| 0|3 2019-06-25 09:25:20,633|FF|app-20190625092337-0164|10|4| END|104.28|2.Join done | 5.58| 37923|3 2019-06-25 09:25:20,633|FF|app-20190625092337-0164|10|4|START|104.28|3.Flocks to report | 0.00| 0|3 2019-06-25 09:25:21,882|FF|app-20190625092337-0164|10|4| END|105.52|3.Flocks to report | 1.25| 32203|3 2019-06-25 09:25:21,882|FF|app-20190625092337-0164|10|4|START|105.52|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:25:21,944|FF|app-20190625092337-0164|10|4|START|105.59|4a.Making expansions | 0.00| 0|3 2019-06-25 09:25:23,293|FF|app-20190625092337-0164|10|4| END|106.94|4a.Making expansions | 1.35| 41017|3 2019-06-25 09:25:23,293|FF|app-20190625092337-0164|10|4|START|106.94|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:25:25,655|FF|app-20190625092337-0164|10|4| END|109.30|4b.Finding maximals | 2.36| 9898|3 2019-06-25 09:25:26,040|FF|app-20190625092337-0164|10|4| END|109.68|4.Flocks prunned by expansion | 4.16| 9898|3 2019-06-25 09:25:26,040|FF|app-20190625092337-0164|10|4|START|109.68|5.Flocks reported | 0.00| 0|3 2019-06-25 09:25:26,672|FF|app-20190625092337-0164|10|4| END|110.31|5.Flocks reported | 0.63| 9898|3 2019-06-25 09:25:26,672|FF|app-20190625092337-0164|10|4|START|110.31|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:25:28,684|FF|app-20190625092337-0164|10|4| END|112.33|6.Candidates indexed | 2.01| 16555|3 2019-06-25 09:25:30,151|Number of flocks: 19626 2019-06-25 09:25:30,955|PFLOCK|app-20190625092337-0164|4|10|90.0|3|3|107.48|19626 2019-06-25 09:25:31,715|FF|app-20190625092337-0164|10|4| END|115.36|Flock Finder run |109.05| 19626|3 2019-06-25 09:25:31,715|FF|app-20190625092337-0164|10|4|START|115.36|Session closed | 0.00| 0|3 2019-06-25 09:25:38,424|FF|app-20190625092337-0164|10|4| END|122.07|Session closed | 6.71| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 90 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:25:40,396|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 09:25:41,522|FF|app-20190625092541-0165|5|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 09:25:41,522|FF|app-20190625092541-0165|5|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 09:25:45,229|FF|app-20190625092541-0165|5|4| END| 4.82|Data read | 3.71|110376|-1 2019-06-25 09:25:45,229|FF|app-20190625092541-0165|5|4|START| 4.82|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:25:45,332|FF|app-20190625092541-0165|5|4| END| 4.92|KDBTree partitioner | 0.10| 272|-1 2019-06-25 09:25:45,333|FF|app-20190625092541-0165|5|4|START| 4.92|MF partitioner | 0.00| 0|-1 2019-06-25 09:25:45,342|FF|app-20190625092541-0165|5|4| END| 4.93|MF partitioner | 0.01| 450|-1 2019-06-25 09:25:45,342|FF|app-20190625092541-0165|5|4|START| 4.93|Pointset done | 0.00| 0|-1 2019-06-25 09:25:46,108|FF|app-20190625092541-0165|5|4| END| 5.70|Pointset done | 0.77| 4|-1 2019-06-25 09:25:46,108|FF|app-20190625092541-0165|5|4|START| 5.70|Flock Finder run | 0.00| 0|-1 2019-06-25 09:25:46,258|FF|app-20190625092541-0165|5|4|START| 5.85|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:25:46,260|MF|app-20190625092541-0165|5|4|START| 5.85|A.Points indexed | 0.00| 0|0 2019-06-25 09:25:46,437|MF|app-20190625092541-0165|5|4| END| 6.02|A.Points indexed | 0.18| 18093|0 2019-06-25 09:25:46,437|MF|app-20190625092541-0165|5|4|START| 6.02|B.Pairs found | 0.00| 0|0 2019-06-25 09:25:47,783|MF|app-20190625092541-0165|5|4| END| 7.37|B.Pairs found | 1.35| 28719|0 2019-06-25 09:25:47,783|MF|app-20190625092541-0165|5|4|START| 7.37|C.Centers found | 0.00| 0|0 2019-06-25 09:25:48,547|MF|app-20190625092541-0165|5|4| END| 8.13|C.Centers found | 0.76| 57438|0 2019-06-25 09:25:48,547|MF|app-20190625092541-0165|5|4|START| 8.13|D.Disks found | 0.00| 0|0 2019-06-25 09:25:51,247|MF|app-20190625092541-0165|5|4| END| 10.83|D.Disks found | 2.70| 22606|0 2019-06-25 09:25:51,247|MF|app-20190625092541-0165|5|4|START| 10.83|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:25:52,276|MF|app-20190625092541-0165|5|4| END| 11.86|E.Disks partitioned | 1.03| 31017|0 2019-06-25 09:25:52,276|MF|app-20190625092541-0165|5|4|START| 11.86|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:25:52,277|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:25:52,277|Cell area: 1055533.7681000116 2019-06-25 09:25:56,560|MF|app-20190625092541-0165|5|4| END| 16.15|F.Maximal disks found | 4.28| 6974|0 2019-06-25 09:25:56,560|MAXIMALS|app-20190625092541-0165|4|5|90.0|3|450|10.3|6974 2019-06-25 09:25:57,077|FF|app-20190625092541-0165|5|4| END| 16.66|1.Maximal disks found | 10.82| 6974|0 2019-06-25 09:25:57,078|FF|app-20190625092541-0165|5|4|START| 16.67|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:25:57,078|MF|app-20190625092541-0165|5|4|START| 16.67|A.Points indexed | 0.00| 0|1 2019-06-25 09:25:57,164|MF|app-20190625092541-0165|5|4| END| 16.75|A.Points indexed | 0.09| 18245|1 2019-06-25 09:25:57,165|MF|app-20190625092541-0165|5|4|START| 16.75|B.Pairs found | 0.00| 0|1 2019-06-25 09:25:57,742|MF|app-20190625092541-0165|5|4| END| 17.33|B.Pairs found | 0.58| 29108|1 2019-06-25 09:25:57,742|MF|app-20190625092541-0165|5|4|START| 17.33|C.Centers found | 0.00| 0|1 2019-06-25 09:25:58,113|MF|app-20190625092541-0165|5|4| END| 17.70|C.Centers found | 0.37| 58216|1 2019-06-25 09:25:58,113|MF|app-20190625092541-0165|5|4|START| 17.70|D.Disks found | 0.00| 0|1 2019-06-25 09:26:00,067|MF|app-20190625092541-0165|5|4| END| 19.65|D.Disks found | 1.95| 22991|1 2019-06-25 09:26:00,067|MF|app-20190625092541-0165|5|4|START| 19.65|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:26:00,794|MF|app-20190625092541-0165|5|4| END| 20.38|E.Disks partitioned | 0.73| 31459|1 2019-06-25 09:26:00,794|MF|app-20190625092541-0165|5|4|START| 20.38|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:26:00,795|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:26:00,795|Cell area: 1055533.7681000116 2019-06-25 09:26:04,777|MF|app-20190625092541-0165|5|4| END| 24.36|F.Maximal disks found | 3.98| 7040|1 2019-06-25 09:26:04,777|MAXIMALS|app-20190625092541-0165|4|5|90.0|3|450|7.699|7040 2019-06-25 09:26:05,217|FF|app-20190625092541-0165|5|4| END| 24.80|1.Maximal disks found | 8.14| 7040|1 2019-06-25 09:26:05,218|FF|app-20190625092541-0165|5|4|START| 24.81|2.Join done | 0.00| 0|1 2019-06-25 09:26:07,134|FF|app-20190625092541-0165|5|4| END| 26.72|2.Join done | 1.92| 12653|1 2019-06-25 09:26:07,134|FF|app-20190625092541-0165|5|4|START| 26.72|3.Flocks to report | 0.00| 0|1 2019-06-25 09:26:07,518|FF|app-20190625092541-0165|5|4| END| 27.11|3.Flocks to report | 0.38| 0|1 2019-06-25 09:26:07,518|FF|app-20190625092541-0165|5|4|START| 27.11|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:26:07,572|FF|app-20190625092541-0165|5|4| END| 27.16|4.Flocks prunned by expansion | 0.05| 0|1 2019-06-25 09:26:07,572|FF|app-20190625092541-0165|5|4|START| 27.16|5.Flocks reported | 0.00| 0|1 2019-06-25 09:26:07,578|FF|app-20190625092541-0165|5|4| END| 27.17|5.Flocks reported | 0.01| 0|1 2019-06-25 09:26:07,578|FF|app-20190625092541-0165|5|4|START| 27.17|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:26:08,868|FF|app-20190625092541-0165|5|4| END| 28.46|6.Candidates indexed | 1.29| 13060|1 2019-06-25 09:26:08,868|FF|app-20190625092541-0165|5|4|START| 28.46|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:26:08,868|MF|app-20190625092541-0165|5|4|START| 28.46|A.Points indexed | 0.00| 0|2 2019-06-25 09:26:08,933|MF|app-20190625092541-0165|5|4| END| 28.52|A.Points indexed | 0.07| 18394|2 2019-06-25 09:26:08,934|MF|app-20190625092541-0165|5|4|START| 28.52|B.Pairs found | 0.00| 0|2 2019-06-25 09:26:09,371|MF|app-20190625092541-0165|5|4| END| 28.96|B.Pairs found | 0.44| 29503|2 2019-06-25 09:26:09,372|MF|app-20190625092541-0165|5|4|START| 28.96|C.Centers found | 0.00| 0|2 2019-06-25 09:26:09,799|MF|app-20190625092541-0165|5|4| END| 29.39|C.Centers found | 0.43| 59006|2 2019-06-25 09:26:09,799|MF|app-20190625092541-0165|5|4|START| 29.39|D.Disks found | 0.00| 0|2 2019-06-25 09:26:11,782|MF|app-20190625092541-0165|5|4| END| 31.37|D.Disks found | 1.98| 23309|2 2019-06-25 09:26:11,782|MF|app-20190625092541-0165|5|4|START| 31.37|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:26:12,467|MF|app-20190625092541-0165|5|4| END| 32.05|E.Disks partitioned | 0.69| 31937|2 2019-06-25 09:26:12,467|MF|app-20190625092541-0165|5|4|START| 32.05|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:26:12,467|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:26:12,467|Cell area: 1055533.7681000116 2019-06-25 09:26:16,394|MF|app-20190625092541-0165|5|4| END| 35.98|F.Maximal disks found | 3.93| 7158|2 2019-06-25 09:26:16,394|MAXIMALS|app-20190625092541-0165|4|5|90.0|3|450|7.526|7158 2019-06-25 09:26:16,794|FF|app-20190625092541-0165|5|4| END| 36.38|1.Maximal disks found | 7.93| 7158|2 2019-06-25 09:26:16,794|FF|app-20190625092541-0165|5|4|START| 36.38|2.Join done | 0.00| 0|2 2019-06-25 09:26:20,900|FF|app-20190625092541-0165|5|4| END| 40.49|2.Join done | 4.11| 20251|2 2019-06-25 09:26:20,900|FF|app-20190625092541-0165|5|4|START| 40.49|3.Flocks to report | 0.00| 0|2 2019-06-25 09:26:21,688|FF|app-20190625092541-0165|5|4| END| 41.28|3.Flocks to report | 0.79| 17573|2 2019-06-25 09:26:21,689|FF|app-20190625092541-0165|5|4|START| 41.28|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:26:21,730|FF|app-20190625092541-0165|5|4|START| 41.32|4a.Making expansions | 0.00| 0|2 2019-06-25 09:26:22,474|FF|app-20190625092541-0165|5|4| END| 42.06|4a.Making expansions | 0.74| 21951|2 2019-06-25 09:26:22,474|FF|app-20190625092541-0165|5|4|START| 42.06|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:26:25,503|FF|app-20190625092541-0165|5|4| END| 45.09|4b.Finding maximals | 3.03| 4864|2 2019-06-25 09:26:25,699|FF|app-20190625092541-0165|5|4| END| 45.29|4.Flocks prunned by expansion | 4.01| 4864|2 2019-06-25 09:26:25,699|FF|app-20190625092541-0165|5|4|START| 45.29|5.Flocks reported | 0.00| 0|2 2019-06-25 09:26:25,985|FF|app-20190625092541-0165|5|4| END| 45.57|5.Flocks reported | 0.29| 4864|2 2019-06-25 09:26:25,986|FF|app-20190625092541-0165|5|4|START| 45.57|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:26:27,450|FF|app-20190625092541-0165|5|4| END| 47.04|6.Candidates indexed | 1.47| 7987|2 2019-06-25 09:26:27,450|FF|app-20190625092541-0165|5|4|START| 47.04|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:26:27,450|MF|app-20190625092541-0165|5|4|START| 47.04|A.Points indexed | 0.00| 0|3 2019-06-25 09:26:27,508|MF|app-20190625092541-0165|5|4| END| 47.10|A.Points indexed | 0.06| 18548|3 2019-06-25 09:26:27,508|MF|app-20190625092541-0165|5|4|START| 47.10|B.Pairs found | 0.00| 0|3 2019-06-25 09:26:28,053|MF|app-20190625092541-0165|5|4| END| 47.64|B.Pairs found | 0.55| 30000|3 2019-06-25 09:26:28,054|MF|app-20190625092541-0165|5|4|START| 47.64|C.Centers found | 0.00| 0|3 2019-06-25 09:26:28,752|MF|app-20190625092541-0165|5|4| END| 48.34|C.Centers found | 0.70| 60000|3 2019-06-25 09:26:28,752|MF|app-20190625092541-0165|5|4|START| 48.34|D.Disks found | 0.00| 0|3 2019-06-25 09:26:31,784|MF|app-20190625092541-0165|5|4| END| 51.37|D.Disks found | 3.03| 23709|3 2019-06-25 09:26:31,784|MF|app-20190625092541-0165|5|4|START| 51.37|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:26:32,687|MF|app-20190625092541-0165|5|4| END| 52.27|E.Disks partitioned | 0.90| 32468|3 2019-06-25 09:26:32,687|MF|app-20190625092541-0165|5|4|START| 52.27|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:26:32,687|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:26:32,687|Cell area: 1055533.7681000116 2019-06-25 09:26:36,944|MF|app-20190625092541-0165|5|4| END| 56.53|F.Maximal disks found | 4.26| 7325|3 2019-06-25 09:26:36,944|MAXIMALS|app-20190625092541-0165|4|5|90.0|3|450|9.494|7325 2019-06-25 09:26:37,383|FF|app-20190625092541-0165|5|4| END| 56.97|1.Maximal disks found | 9.93| 7325|3 2019-06-25 09:26:37,384|FF|app-20190625092541-0165|5|4|START| 56.97|2.Join done | 0.00| 0|3 2019-06-25 09:26:40,531|FF|app-20190625092541-0165|5|4| END| 60.12|2.Join done | 3.15| 18964|3 2019-06-25 09:26:40,531|FF|app-20190625092541-0165|5|4|START| 60.12|3.Flocks to report | 0.00| 0|3 2019-06-25 09:26:41,201|FF|app-20190625092541-0165|5|4| END| 60.79|3.Flocks to report | 0.67| 16099|3 2019-06-25 09:26:41,201|FF|app-20190625092541-0165|5|4|START| 60.79|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:26:41,245|FF|app-20190625092541-0165|5|4|START| 60.83|4a.Making expansions | 0.00| 0|3 2019-06-25 09:26:41,815|FF|app-20190625092541-0165|5|4| END| 61.40|4a.Making expansions | 0.57| 20546|3 2019-06-25 09:26:41,815|FF|app-20190625092541-0165|5|4|START| 61.40|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:26:43,717|FF|app-20190625092541-0165|5|4| END| 63.30|4b.Finding maximals | 1.90| 4949|3 2019-06-25 09:26:43,932|FF|app-20190625092541-0165|5|4| END| 63.52|4.Flocks prunned by expansion | 2.73| 4949|3 2019-06-25 09:26:43,932|FF|app-20190625092541-0165|5|4|START| 63.52|5.Flocks reported | 0.00| 0|3 2019-06-25 09:26:44,227|FF|app-20190625092541-0165|5|4| END| 63.81|5.Flocks reported | 0.30| 4949|3 2019-06-25 09:26:44,227|FF|app-20190625092541-0165|5|4|START| 63.81|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:26:45,794|FF|app-20190625092541-0165|5|4| END| 65.38|6.Candidates indexed | 1.57| 8283|3 2019-06-25 09:26:46,456|Number of flocks: 9813 2019-06-25 09:26:46,800|PFLOCK|app-20190625092541-0165|4|5|90.0|3|3|60.35|9813 2019-06-25 09:26:47,145|FF|app-20190625092541-0165|5|4| END| 66.73|Flock Finder run | 61.04| 9813|3 2019-06-25 09:26:47,145|FF|app-20190625092541-0165|5|4|START| 66.73|Session closed | 0.00| 0|3 2019-06-25 09:26:53,445|FF|app-20190625092541-0165|5|4| END| 73.03|Session closed | 6.30| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:26:55,372|FF|app-00000000000000-0000|15|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 09:26:56,458|FF|app-20190625092656-0166|15|4| END| 1.07|Session start | 1.09| 0|-1 2019-06-25 09:26:56,458|FF|app-20190625092656-0166|15|4|START| 1.07|Data read | 0.00| 0|-1 2019-06-25 09:27:00,672|FF|app-20190625092656-0166|15|4| END| 5.28|Data read | 4.21|331128|-1 2019-06-25 09:27:00,672|FF|app-20190625092656-0166|15|4|START| 5.28|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:27:00,853|FF|app-20190625092656-0166|15|4| END| 5.46|KDBTree partitioner | 0.18| 816|-1 2019-06-25 09:27:00,853|FF|app-20190625092656-0166|15|4|START| 5.47|MF partitioner | 0.00| 0|-1 2019-06-25 09:27:00,871|FF|app-20190625092656-0166|15|4| END| 5.48|MF partitioner | 0.02| 1350|-1 2019-06-25 09:27:00,871|FF|app-20190625092656-0166|15|4|START| 5.48|Pointset done | 0.00| 0|-1 2019-06-25 09:27:02,039|FF|app-20190625092656-0166|15|4| END| 6.65|Pointset done | 1.17| 4|-1 2019-06-25 09:27:02,040|FF|app-20190625092656-0166|15|4|START| 6.65|Flock Finder run | 0.00| 0|-1 2019-06-25 09:27:02,059|FF|app-20190625092656-0166|15|4|START| 6.67|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:27:02,062|MF|app-20190625092656-0166|15|4|START| 6.67|A.Points indexed | 0.00| 0|0 2019-06-25 09:27:02,280|MF|app-20190625092656-0166|15|4| END| 6.89|A.Points indexed | 0.22| 54279|0 2019-06-25 09:27:02,280|MF|app-20190625092656-0166|15|4|START| 6.89|B.Pairs found | 0.00| 0|0 2019-06-25 09:27:04,315|MF|app-20190625092656-0166|15|4| END| 8.93|B.Pairs found | 2.03|101871|0 2019-06-25 09:27:04,315|MF|app-20190625092656-0166|15|4|START| 8.93|C.Centers found | 0.00| 0|0 2019-06-25 09:27:06,247|MF|app-20190625092656-0166|15|4| END| 10.86|C.Centers found | 1.93|203742|0 2019-06-25 09:27:06,247|MF|app-20190625092656-0166|15|4|START| 10.86|D.Disks found | 0.00| 0|0 2019-06-25 09:27:15,473|MF|app-20190625092656-0166|15|4| END| 20.09|D.Disks found | 9.23| 85998|0 2019-06-25 09:27:15,473|MF|app-20190625092656-0166|15|4|START| 20.09|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:27:18,533|MF|app-20190625092656-0166|15|4| END| 23.15|E.Disks partitioned | 3.06|121693|0 2019-06-25 09:27:18,533|MF|app-20190625092656-0166|15|4|START| 23.15|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:27:18,536|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:27:18,536|Cell area: 1055533.7681000116 2019-06-25 09:27:28,947|MF|app-20190625092656-0166|15|4| END| 33.56|F.Maximal disks found | 10.41| 25114|0 2019-06-25 09:27:28,947|MAXIMALS|app-20190625092656-0166|4|15|100.0|3|1350|26.885|25114 2019-06-25 09:27:30,014|FF|app-20190625092656-0166|15|4| END| 34.63|1.Maximal disks found | 27.96| 25114|0 2019-06-25 09:27:30,014|FF|app-20190625092656-0166|15|4|START| 34.63|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:27:30,014|MF|app-20190625092656-0166|15|4|START| 34.63|A.Points indexed | 0.00| 0|1 2019-06-25 09:27:30,137|MF|app-20190625092656-0166|15|4| END| 34.75|A.Points indexed | 0.12| 54735|1 2019-06-25 09:27:30,137|MF|app-20190625092656-0166|15|4|START| 34.75|B.Pairs found | 0.00| 0|1 2019-06-25 09:27:31,135|MF|app-20190625092656-0166|15|4| END| 35.75|B.Pairs found | 1.00|103386|1 2019-06-25 09:27:31,136|MF|app-20190625092656-0166|15|4|START| 35.75|C.Centers found | 0.00| 0|1 2019-06-25 09:27:32,989|MF|app-20190625092656-0166|15|4| END| 37.60|C.Centers found | 1.85|206772|1 2019-06-25 09:27:32,989|MF|app-20190625092656-0166|15|4|START| 37.60|D.Disks found | 0.00| 0|1 2019-06-25 09:27:41,709|MF|app-20190625092656-0166|15|4| END| 46.32|D.Disks found | 8.72| 87348|1 2019-06-25 09:27:41,709|MF|app-20190625092656-0166|15|4|START| 46.32|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:27:44,607|MF|app-20190625092656-0166|15|4| END| 49.22|E.Disks partitioned | 2.90|123553|1 2019-06-25 09:27:44,607|MF|app-20190625092656-0166|15|4|START| 49.22|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:27:44,607|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:27:44,607|Cell area: 1055533.7681000116 2019-06-25 09:27:53,994|MF|app-20190625092656-0166|15|4| END| 58.61|F.Maximal disks found | 9.39| 25640|1 2019-06-25 09:27:53,995|MAXIMALS|app-20190625092656-0166|4|15|100.0|3|1350|23.981|25640 2019-06-25 09:27:55,062|FF|app-20190625092656-0166|15|4| END| 59.67|1.Maximal disks found | 25.05| 25640|1 2019-06-25 09:27:55,063|FF|app-20190625092656-0166|15|4|START| 59.67|2.Join done | 0.00| 0|1 2019-06-25 09:27:58,250|FF|app-20190625092656-0166|15|4| END| 62.86|2.Join done | 3.19| 51443|1 2019-06-25 09:27:58,250|FF|app-20190625092656-0166|15|4|START| 62.86|3.Flocks to report | 0.00| 0|1 2019-06-25 09:27:58,813|FF|app-20190625092656-0166|15|4| END| 63.43|3.Flocks to report | 0.56| 0|1 2019-06-25 09:27:58,813|FF|app-20190625092656-0166|15|4|START| 63.43|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:27:58,885|FF|app-20190625092656-0166|15|4| END| 63.50|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 09:27:58,885|FF|app-20190625092656-0166|15|4|START| 63.50|5.Flocks reported | 0.00| 0|1 2019-06-25 09:27:58,889|FF|app-20190625092656-0166|15|4| END| 63.50|5.Flocks reported | 0.00| 0|1 2019-06-25 09:27:58,890|FF|app-20190625092656-0166|15|4|START| 63.50|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:28:00,552|FF|app-20190625092656-0166|15|4| END| 65.16|6.Candidates indexed | 1.66| 52931|1 2019-06-25 09:28:00,553|FF|app-20190625092656-0166|15|4|START| 65.16|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:28:00,553|MF|app-20190625092656-0166|15|4|START| 65.17|A.Points indexed | 0.00| 0|2 2019-06-25 09:28:00,677|MF|app-20190625092656-0166|15|4| END| 65.29|A.Points indexed | 0.12| 55182|2 2019-06-25 09:28:00,677|MF|app-20190625092656-0166|15|4|START| 65.29|B.Pairs found | 0.00| 0|2 2019-06-25 09:28:01,556|MF|app-20190625092656-0166|15|4| END| 66.17|B.Pairs found | 0.88|104754|2 2019-06-25 09:28:01,556|MF|app-20190625092656-0166|15|4|START| 66.17|C.Centers found | 0.00| 0|2 2019-06-25 09:28:02,789|MF|app-20190625092656-0166|15|4| END| 67.40|C.Centers found | 1.23|209508|2 2019-06-25 09:28:02,789|MF|app-20190625092656-0166|15|4|START| 67.40|D.Disks found | 0.00| 0|2 2019-06-25 09:28:06,568|MF|app-20190625092656-0166|15|4| END| 71.18|D.Disks found | 3.78| 88647|2 2019-06-25 09:28:06,568|MF|app-20190625092656-0166|15|4|START| 71.18|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:28:07,470|MF|app-20190625092656-0166|15|4| END| 72.08|E.Disks partitioned | 0.90|125639|2 2019-06-25 09:28:07,470|MF|app-20190625092656-0166|15|4|START| 72.08|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:28:07,471|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:28:07,471|Cell area: 1055533.7681000116 2019-06-25 09:28:17,199|MF|app-20190625092656-0166|15|4| END| 81.81|F.Maximal disks found | 9.73| 26055|2 2019-06-25 09:28:17,199|MAXIMALS|app-20190625092656-0166|4|15|100.0|3|1350|16.646|26055 2019-06-25 09:28:18,214|FF|app-20190625092656-0166|15|4| END| 82.83|1.Maximal disks found | 17.66| 26055|2 2019-06-25 09:28:18,214|FF|app-20190625092656-0166|15|4|START| 82.83|2.Join done | 0.00| 0|2 2019-06-25 09:28:28,505|FF|app-20190625092656-0166|15|4| END| 93.12|2.Join done | 10.29| 98057|2 2019-06-25 09:28:28,505|FF|app-20190625092656-0166|15|4|START| 93.12|3.Flocks to report | 0.00| 0|2 2019-06-25 09:28:30,333|FF|app-20190625092656-0166|15|4| END| 94.95|3.Flocks to report | 1.83| 83676|2 2019-06-25 09:28:30,333|FF|app-20190625092656-0166|15|4|START| 94.95|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:28:30,407|FF|app-20190625092656-0166|15|4|START| 95.02|4a.Making expansions | 0.00| 0|2 2019-06-25 09:28:31,245|FF|app-20190625092656-0166|15|4| END| 95.86|4a.Making expansions | 0.84|103852|2 2019-06-25 09:28:31,245|FF|app-20190625092656-0166|15|4|START| 95.86|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:28:45,755|FF|app-20190625092656-0166|15|4| END|110.37|4b.Finding maximals | 14.51| 17091|2 2019-06-25 09:28:46,196|FF|app-20190625092656-0166|15|4| END|110.81|4.Flocks prunned by expansion | 15.86| 17091|2 2019-06-25 09:28:46,196|FF|app-20190625092656-0166|15|4|START|110.81|5.Flocks reported | 0.00| 0|2 2019-06-25 09:28:46,756|FF|app-20190625092656-0166|15|4| END|111.37|5.Flocks reported | 0.56| 17091|2 2019-06-25 09:28:46,756|FF|app-20190625092656-0166|15|4|START|111.37|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:28:48,608|FF|app-20190625092656-0166|15|4| END|113.22|6.Candidates indexed | 1.85| 33209|2 2019-06-25 09:28:48,608|FF|app-20190625092656-0166|15|4|START|113.22|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:28:48,608|MF|app-20190625092656-0166|15|4|START|113.22|A.Points indexed | 0.00| 0|3 2019-06-25 09:28:48,717|MF|app-20190625092656-0166|15|4| END|113.33|A.Points indexed | 0.11| 55644|3 2019-06-25 09:28:48,717|MF|app-20190625092656-0166|15|4|START|113.33|B.Pairs found | 0.00| 0|3 2019-06-25 09:28:49,681|MF|app-20190625092656-0166|15|4| END|114.29|B.Pairs found | 0.96|106545|3 2019-06-25 09:28:49,681|MF|app-20190625092656-0166|15|4|START|114.29|C.Centers found | 0.00| 0|3 2019-06-25 09:28:50,746|MF|app-20190625092656-0166|15|4| END|115.36|C.Centers found | 1.07|213090|3 2019-06-25 09:28:50,746|MF|app-20190625092656-0166|15|4|START|115.36|D.Disks found | 0.00| 0|3 2019-06-25 09:28:58,707|MF|app-20190625092656-0166|15|4| END|123.32|D.Disks found | 7.96| 90426|3 2019-06-25 09:28:58,707|MF|app-20190625092656-0166|15|4|START|123.32|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:29:01,371|MF|app-20190625092656-0166|15|4| END|125.98|E.Disks partitioned | 2.66|128174|3 2019-06-25 09:29:01,371|MF|app-20190625092656-0166|15|4|START|125.98|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:29:01,372|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:29:01,372|Cell area: 1055533.7681000116 2019-06-25 09:29:13,300|MF|app-20190625092656-0166|15|4| END|137.91|F.Maximal disks found | 11.93| 26538|3 2019-06-25 09:29:13,300|MAXIMALS|app-20190625092656-0166|4|15|100.0|3|1350|24.692|26538 2019-06-25 09:29:14,292|FF|app-20190625092656-0166|15|4| END|138.90|1.Maximal disks found | 25.68| 26538|3 2019-06-25 09:29:14,292|FF|app-20190625092656-0166|15|4|START|138.90|2.Join done | 0.00| 0|3 2019-06-25 09:29:20,851|FF|app-20190625092656-0166|15|4| END|145.46|2.Join done | 6.56| 90379|3 2019-06-25 09:29:20,851|FF|app-20190625092656-0166|15|4|START|145.46|3.Flocks to report | 0.00| 0|3 2019-06-25 09:29:22,617|FF|app-20190625092656-0166|15|4| END|147.23|3.Flocks to report | 1.77| 75867|3 2019-06-25 09:29:22,617|FF|app-20190625092656-0166|15|4|START|147.23|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:29:22,702|FF|app-20190625092656-0166|15|4|START|147.31|4a.Making expansions | 0.00| 0|3 2019-06-25 09:29:24,010|FF|app-20190625092656-0166|15|4| END|148.62|4a.Making expansions | 1.31| 96532|3 2019-06-25 09:29:24,010|FF|app-20190625092656-0166|15|4|START|148.62|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:29:35,079|FF|app-20190625092656-0166|15|4| END|159.69|4b.Finding maximals | 11.07| 17301|3 2019-06-25 09:29:35,553|FF|app-20190625092656-0166|15|4| END|160.17|4.Flocks prunned by expansion | 12.94| 17301|3 2019-06-25 09:29:35,553|FF|app-20190625092656-0166|15|4|START|160.17|5.Flocks reported | 0.00| 0|3 2019-06-25 09:29:36,156|FF|app-20190625092656-0166|15|4| END|160.77|5.Flocks reported | 0.60| 17301|3 2019-06-25 09:29:36,156|FF|app-20190625092656-0166|15|4|START|160.77|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:29:38,006|FF|app-20190625092656-0166|15|4| END|162.62|6.Candidates indexed | 1.85| 33436|3 2019-06-25 09:29:39,366|Number of flocks: 34392 2019-06-25 09:29:40,256|PFLOCK|app-20190625092656-0166|4|15|100.0|3|3|157.33|34392 2019-06-25 09:29:41,168|FF|app-20190625092656-0166|15|4| END|165.78|Flock Finder run |159.13| 34392|3 2019-06-25 09:29:41,168|FF|app-20190625092656-0166|15|4|START|165.78|Session closed | 0.00| 0|3 2019-06-25 09:29:48,464|FF|app-20190625092656-0166|15|4| END|173.08|Session closed | 7.30| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:29:50,413|FF|app-00000000000000-0000|10|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 09:29:51,539|FF|app-20190625092951-0167|10|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 09:29:51,539|FF|app-20190625092951-0167|10|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 09:29:55,593|FF|app-20190625092951-0167|10|4| END| 5.16|Data read | 4.05|220752|-1 2019-06-25 09:29:55,593|FF|app-20190625092951-0167|10|4|START| 5.16|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:29:55,800|FF|app-20190625092951-0167|10|4| END| 5.37|KDBTree partitioner | 0.21| 544|-1 2019-06-25 09:29:55,800|FF|app-20190625092951-0167|10|4|START| 5.37|MF partitioner | 0.00| 0|-1 2019-06-25 09:29:55,822|FF|app-20190625092951-0167|10|4| END| 5.39|MF partitioner | 0.02| 900|-1 2019-06-25 09:29:55,822|FF|app-20190625092951-0167|10|4|START| 5.39|Pointset done | 0.00| 0|-1 2019-06-25 09:29:56,899|FF|app-20190625092951-0167|10|4| END| 6.47|Pointset done | 1.08| 4|-1 2019-06-25 09:29:56,900|FF|app-20190625092951-0167|10|4|START| 6.47|Flock Finder run | 0.00| 0|-1 2019-06-25 09:29:56,917|FF|app-20190625092951-0167|10|4|START| 6.49|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:29:56,919|MF|app-20190625092951-0167|10|4|START| 6.49|A.Points indexed | 0.00| 0|0 2019-06-25 09:29:57,093|MF|app-20190625092951-0167|10|4| END| 6.66|A.Points indexed | 0.17| 36186|0 2019-06-25 09:29:57,093|MF|app-20190625092951-0167|10|4|START| 6.66|B.Pairs found | 0.00| 0|0 2019-06-25 09:29:59,038|MF|app-20190625092951-0167|10|4| END| 8.61|B.Pairs found | 1.95| 67914|0 2019-06-25 09:29:59,038|MF|app-20190625092951-0167|10|4|START| 8.61|C.Centers found | 0.00| 0|0 2019-06-25 09:30:01,119|MF|app-20190625092951-0167|10|4| END| 10.69|C.Centers found | 2.08|135828|0 2019-06-25 09:30:01,119|MF|app-20190625092951-0167|10|4|START| 10.69|D.Disks found | 0.00| 0|0 2019-06-25 09:30:09,132|MF|app-20190625092951-0167|10|4| END| 18.70|D.Disks found | 8.01| 57332|0 2019-06-25 09:30:09,132|MF|app-20190625092951-0167|10|4|START| 18.70|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:30:13,118|MF|app-20190625092951-0167|10|4| END| 22.69|E.Disks partitioned | 3.99| 81114|0 2019-06-25 09:30:13,118|MF|app-20190625092951-0167|10|4|START| 22.69|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:30:13,120|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:30:13,120|Cell area: 1055533.7681000116 2019-06-25 09:30:26,137|MF|app-20190625092951-0167|10|4| END| 35.71|F.Maximal disks found | 13.02| 16742|0 2019-06-25 09:30:26,137|MAXIMALS|app-20190625092951-0167|4|10|100.0|3|900|29.218|16742 2019-06-25 09:30:27,744|FF|app-20190625092951-0167|10|4| END| 37.32|1.Maximal disks found | 30.83| 16742|0 2019-06-25 09:30:27,745|FF|app-20190625092951-0167|10|4|START| 37.32|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:30:27,745|MF|app-20190625092951-0167|10|4|START| 37.32|A.Points indexed | 0.00| 0|1 2019-06-25 09:30:27,837|MF|app-20190625092951-0167|10|4| END| 37.41|A.Points indexed | 0.09| 36490|1 2019-06-25 09:30:27,837|MF|app-20190625092951-0167|10|4|START| 37.41|B.Pairs found | 0.00| 0|1 2019-06-25 09:30:28,838|MF|app-20190625092951-0167|10|4| END| 38.41|B.Pairs found | 1.00| 68924|1 2019-06-25 09:30:28,838|MF|app-20190625092951-0167|10|4|START| 38.41|C.Centers found | 0.00| 0|1 2019-06-25 09:30:29,862|MF|app-20190625092951-0167|10|4| END| 39.43|C.Centers found | 1.02|137848|1 2019-06-25 09:30:29,862|MF|app-20190625092951-0167|10|4|START| 39.43|D.Disks found | 0.00| 0|1 2019-06-25 09:30:35,041|MF|app-20190625092951-0167|10|4| END| 44.61|D.Disks found | 5.18| 58232|1 2019-06-25 09:30:35,041|MF|app-20190625092951-0167|10|4|START| 44.61|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:30:37,493|MF|app-20190625092951-0167|10|4| END| 47.06|E.Disks partitioned | 2.45| 82341|1 2019-06-25 09:30:37,493|MF|app-20190625092951-0167|10|4|START| 47.06|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:30:37,494|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:30:37,494|Cell area: 1055533.7681000116 2019-06-25 09:30:47,268|MF|app-20190625092951-0167|10|4| END| 56.84|F.Maximal disks found | 9.78| 17096|1 2019-06-25 09:30:47,269|MAXIMALS|app-20190625092951-0167|4|10|100.0|3|900|19.524|17096 2019-06-25 09:30:48,221|FF|app-20190625092951-0167|10|4| END| 57.79|1.Maximal disks found | 20.48| 17096|1 2019-06-25 09:30:48,221|FF|app-20190625092951-0167|10|4|START| 57.79|2.Join done | 0.00| 0|1 2019-06-25 09:30:53,784|FF|app-20190625092951-0167|10|4| END| 63.36|2.Join done | 5.56| 34283|1 2019-06-25 09:30:53,784|FF|app-20190625092951-0167|10|4|START| 63.36|3.Flocks to report | 0.00| 0|1 2019-06-25 09:30:54,854|FF|app-20190625092951-0167|10|4| END| 64.42|3.Flocks to report | 1.07| 0|1 2019-06-25 09:30:54,854|FF|app-20190625092951-0167|10|4|START| 64.43|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:30:54,917|FF|app-20190625092951-0167|10|4| END| 64.49|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 09:30:54,918|FF|app-20190625092951-0167|10|4|START| 64.49|5.Flocks reported | 0.00| 0|1 2019-06-25 09:30:54,923|FF|app-20190625092951-0167|10|4| END| 64.49|5.Flocks reported | 0.01| 0|1 2019-06-25 09:30:54,923|FF|app-20190625092951-0167|10|4|START| 64.49|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:30:57,218|FF|app-20190625092951-0167|10|4| END| 66.79|6.Candidates indexed | 2.30| 35275|1 2019-06-25 09:30:57,218|FF|app-20190625092951-0167|10|4|START| 66.79|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:30:57,218|MF|app-20190625092951-0167|10|4|START| 66.79|A.Points indexed | 0.00| 0|2 2019-06-25 09:30:57,313|MF|app-20190625092951-0167|10|4| END| 66.88|A.Points indexed | 0.10| 36788|2 2019-06-25 09:30:57,313|MF|app-20190625092951-0167|10|4|START| 66.88|B.Pairs found | 0.00| 0|2 2019-06-25 09:30:57,945|MF|app-20190625092951-0167|10|4| END| 67.52|B.Pairs found | 0.63| 69836|2 2019-06-25 09:30:57,945|MF|app-20190625092951-0167|10|4|START| 67.52|C.Centers found | 0.00| 0|2 2019-06-25 09:30:58,654|MF|app-20190625092951-0167|10|4| END| 68.23|C.Centers found | 0.71|139672|2 2019-06-25 09:30:58,654|MF|app-20190625092951-0167|10|4|START| 68.23|D.Disks found | 0.00| 0|2 2019-06-25 09:31:03,671|MF|app-20190625092951-0167|10|4| END| 73.24|D.Disks found | 5.02| 59098|2 2019-06-25 09:31:03,671|MF|app-20190625092951-0167|10|4|START| 73.24|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:31:07,863|MF|app-20190625092951-0167|10|4| END| 77.43|E.Disks partitioned | 4.19| 83724|2 2019-06-25 09:31:07,863|MF|app-20190625092951-0167|10|4|START| 77.43|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:31:07,864|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:31:07,864|Cell area: 1055533.7681000116 2019-06-25 09:31:20,237|MF|app-20190625092951-0167|10|4| END| 89.81|F.Maximal disks found | 12.37| 17376|2 2019-06-25 09:31:20,237|MAXIMALS|app-20190625092951-0167|4|10|100.0|3|900|23.019|17376 2019-06-25 09:31:21,747|FF|app-20190625092951-0167|10|4| END| 91.32|1.Maximal disks found | 24.53| 17376|2 2019-06-25 09:31:21,747|FF|app-20190625092951-0167|10|4|START| 91.32|2.Join done | 0.00| 0|2 2019-06-25 09:31:42,589|FF|app-20190625092951-0167|10|4| END|112.16|2.Join done | 20.84| 65354|2 2019-06-25 09:31:42,589|FF|app-20190625092951-0167|10|4|START|112.16|3.Flocks to report | 0.00| 0|2 2019-06-25 09:31:45,970|FF|app-20190625092951-0167|10|4| END|115.54|3.Flocks to report | 3.38| 55757|2 2019-06-25 09:31:45,970|FF|app-20190625092951-0167|10|4|START|115.54|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:31:46,066|FF|app-20190625092951-0167|10|4|START|115.64|4a.Making expansions | 0.00| 0|2 2019-06-25 09:31:48,281|FF|app-20190625092951-0167|10|4| END|117.85|4a.Making expansions | 2.22| 69245|2 2019-06-25 09:31:48,281|FF|app-20190625092951-0167|10|4|START|117.85|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:32:02,004|FF|app-20190625092951-0167|10|4| END|131.58|4b.Finding maximals | 13.72| 11394|2 2019-06-25 09:32:02,674|FF|app-20190625092951-0167|10|4| END|132.25|4.Flocks prunned by expansion | 16.70| 11394|2 2019-06-25 09:32:02,674|FF|app-20190625092951-0167|10|4|START|132.25|5.Flocks reported | 0.00| 0|2 2019-06-25 09:32:03,669|FF|app-20190625092951-0167|10|4| END|133.24|5.Flocks reported | 1.00| 11394|2 2019-06-25 09:32:03,669|FF|app-20190625092951-0167|10|4|START|133.24|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:32:07,306|FF|app-20190625092951-0167|10|4| END|136.88|6.Candidates indexed | 3.64| 22156|2 2019-06-25 09:32:07,306|FF|app-20190625092951-0167|10|4|START|136.88|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:32:07,306|MF|app-20190625092951-0167|10|4|START|136.88|A.Points indexed | 0.00| 0|3 2019-06-25 09:32:07,429|MF|app-20190625092951-0167|10|4| END|137.00|A.Points indexed | 0.12| 37096|3 2019-06-25 09:32:07,429|MF|app-20190625092951-0167|10|4|START|137.00|B.Pairs found | 0.00| 0|3 2019-06-25 09:32:08,141|MF|app-20190625092951-0167|10|4| END|137.71|B.Pairs found | 0.71| 71030|3 2019-06-25 09:32:08,141|MF|app-20190625092951-0167|10|4|START|137.71|C.Centers found | 0.00| 0|3 2019-06-25 09:32:09,675|MF|app-20190625092951-0167|10|4| END|139.25|C.Centers found | 1.53|142060|3 2019-06-25 09:32:09,675|MF|app-20190625092951-0167|10|4|START|139.25|D.Disks found | 0.00| 0|3 2019-06-25 09:32:13,963|MF|app-20190625092951-0167|10|4| END|143.53|D.Disks found | 4.29| 60284|3 2019-06-25 09:32:13,963|MF|app-20190625092951-0167|10|4|START|143.53|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:32:16,172|MF|app-20190625092951-0167|10|4| END|145.74|E.Disks partitioned | 2.21| 85409|3 2019-06-25 09:32:16,172|MF|app-20190625092951-0167|10|4|START|145.74|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:32:16,173|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:32:16,173|Cell area: 1055533.7681000116 2019-06-25 09:32:28,412|MF|app-20190625092951-0167|10|4| END|157.98|F.Maximal disks found | 12.24| 17693|3 2019-06-25 09:32:28,412|MAXIMALS|app-20190625092951-0167|4|10|100.0|3|900|21.106|17693 2019-06-25 09:32:29,326|FF|app-20190625092951-0167|10|4| END|158.90|1.Maximal disks found | 22.02| 17693|3 2019-06-25 09:32:29,326|FF|app-20190625092951-0167|10|4|START|158.90|2.Join done | 0.00| 0|3 2019-06-25 09:32:37,684|FF|app-20190625092951-0167|10|4| END|167.26|2.Join done | 8.36| 60349|3 2019-06-25 09:32:37,684|FF|app-20190625092951-0167|10|4|START|167.26|3.Flocks to report | 0.00| 0|3 2019-06-25 09:32:39,421|FF|app-20190625092951-0167|10|4| END|168.99|3.Flocks to report | 1.74| 50613|3 2019-06-25 09:32:39,421|FF|app-20190625092951-0167|10|4|START|168.99|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:32:39,486|FF|app-20190625092951-0167|10|4|START|169.06|4a.Making expansions | 0.00| 0|3 2019-06-25 09:32:40,882|FF|app-20190625092951-0167|10|4| END|170.45|4a.Making expansions | 1.40| 64365|3 2019-06-25 09:32:40,882|FF|app-20190625092951-0167|10|4|START|170.45|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:32:51,910|FF|app-20190625092951-0167|10|4| END|181.48|4b.Finding maximals | 11.03| 11534|3 2019-06-25 09:32:52,315|FF|app-20190625092951-0167|10|4| END|181.89|4.Flocks prunned by expansion | 12.89| 11534|3 2019-06-25 09:32:52,315|FF|app-20190625092951-0167|10|4|START|181.89|5.Flocks reported | 0.00| 0|3 2019-06-25 09:32:52,980|FF|app-20190625092951-0167|10|4| END|182.55|5.Flocks reported | 0.67| 11534|3 2019-06-25 09:32:52,980|FF|app-20190625092951-0167|10|4|START|182.55|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:32:55,209|FF|app-20190625092951-0167|10|4| END|184.78|6.Candidates indexed | 2.23| 22352|3 2019-06-25 09:32:57,199|Number of flocks: 22928 2019-06-25 09:32:58,267|PFLOCK|app-20190625092951-0167|4|10|100.0|3|3|180.30|22928 2019-06-25 09:32:59,830|FF|app-20190625092951-0167|10|4| END|189.40|Flock Finder run |182.93| 22928|3 2019-06-25 09:32:59,830|FF|app-20190625092951-0167|10|4|START|189.40|Session closed | 0.00| 0|3 2019-06-25 09:33:06,660|FF|app-20190625092951-0167|10|4| END|196.23|Session closed | 6.83| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:33:08,674|FF|app-00000000000000-0000|5|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 09:33:09,818|FF|app-20190625093309-0168|5|4| END| 1.13|Session start | 1.15| 0|-1 2019-06-25 09:33:09,818|FF|app-20190625093309-0168|5|4|START| 1.13|Data read | 0.00| 0|-1 2019-06-25 09:33:13,523|FF|app-20190625093309-0168|5|4| END| 4.83|Data read | 3.71|110376|-1 2019-06-25 09:33:13,523|FF|app-20190625093309-0168|5|4|START| 4.83|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:33:13,642|FF|app-20190625093309-0168|5|4| END| 4.95|KDBTree partitioner | 0.12| 272|-1 2019-06-25 09:33:13,643|FF|app-20190625093309-0168|5|4|START| 4.95|MF partitioner | 0.00| 0|-1 2019-06-25 09:33:13,654|FF|app-20190625093309-0168|5|4| END| 4.96|MF partitioner | 0.01| 450|-1 2019-06-25 09:33:13,655|FF|app-20190625093309-0168|5|4|START| 4.96|Pointset done | 0.00| 0|-1 2019-06-25 09:33:14,486|FF|app-20190625093309-0168|5|4| END| 5.80|Pointset done | 0.83| 4|-1 2019-06-25 09:33:14,486|FF|app-20190625093309-0168|5|4|START| 5.80|Flock Finder run | 0.00| 0|-1 2019-06-25 09:33:14,643|FF|app-20190625093309-0168|5|4|START| 5.95|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:33:14,646|MF|app-20190625093309-0168|5|4|START| 5.96|A.Points indexed | 0.00| 0|0 2019-06-25 09:33:14,806|MF|app-20190625093309-0168|5|4| END| 6.12|A.Points indexed | 0.16| 18093|0 2019-06-25 09:33:14,807|MF|app-20190625093309-0168|5|4|START| 6.12|B.Pairs found | 0.00| 0|0 2019-06-25 09:33:16,054|MF|app-20190625093309-0168|5|4| END| 7.36|B.Pairs found | 1.25| 33957|0 2019-06-25 09:33:16,055|MF|app-20190625093309-0168|5|4|START| 7.36|C.Centers found | 0.00| 0|0 2019-06-25 09:33:16,809|MF|app-20190625093309-0168|5|4| END| 8.12|C.Centers found | 0.76| 67914|0 2019-06-25 09:33:16,809|MF|app-20190625093309-0168|5|4|START| 8.12|D.Disks found | 0.00| 0|0 2019-06-25 09:33:20,051|MF|app-20190625093309-0168|5|4| END| 11.36|D.Disks found | 3.24| 28666|0 2019-06-25 09:33:20,051|MF|app-20190625093309-0168|5|4|START| 11.36|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:33:21,360|MF|app-20190625093309-0168|5|4| END| 12.67|E.Disks partitioned | 1.31| 40550|0 2019-06-25 09:33:21,360|MF|app-20190625093309-0168|5|4|START| 12.67|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:33:21,362|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:33:21,362|Cell area: 1055533.7681000116 2019-06-25 09:33:31,866|MF|app-20190625093309-0168|5|4| END| 23.18|F.Maximal disks found | 10.51| 8371|0 2019-06-25 09:33:31,866|MAXIMALS|app-20190625093309-0168|4|5|100.0|3|450|17.22|8371 2019-06-25 09:33:32,430|FF|app-20190625093309-0168|5|4| END| 23.74|1.Maximal disks found | 17.79| 8371|0 2019-06-25 09:33:32,430|FF|app-20190625093309-0168|5|4|START| 23.74|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:33:32,430|MF|app-20190625093309-0168|5|4|START| 23.74|A.Points indexed | 0.00| 0|1 2019-06-25 09:33:32,513|MF|app-20190625093309-0168|5|4| END| 23.82|A.Points indexed | 0.08| 18245|1 2019-06-25 09:33:32,513|MF|app-20190625093309-0168|5|4|START| 23.82|B.Pairs found | 0.00| 0|1 2019-06-25 09:33:32,965|MF|app-20190625093309-0168|5|4| END| 24.27|B.Pairs found | 0.45| 34462|1 2019-06-25 09:33:32,965|MF|app-20190625093309-0168|5|4|START| 24.27|C.Centers found | 0.00| 0|1 2019-06-25 09:33:33,370|MF|app-20190625093309-0168|5|4| END| 24.68|C.Centers found | 0.41| 68924|1 2019-06-25 09:33:33,371|MF|app-20190625093309-0168|5|4|START| 24.68|D.Disks found | 0.00| 0|1 2019-06-25 09:33:35,371|MF|app-20190625093309-0168|5|4| END| 26.68|D.Disks found | 2.00| 29116|1 2019-06-25 09:33:35,371|MF|app-20190625093309-0168|5|4|START| 26.68|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:33:36,182|MF|app-20190625093309-0168|5|4| END| 27.49|E.Disks partitioned | 0.81| 41162|1 2019-06-25 09:33:36,182|MF|app-20190625093309-0168|5|4|START| 27.49|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:33:36,182|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:33:36,182|Cell area: 1055533.7681000116 2019-06-25 09:33:45,474|MF|app-20190625093309-0168|5|4| END| 36.78|F.Maximal disks found | 9.29| 8547|1 2019-06-25 09:33:45,474|MAXIMALS|app-20190625093309-0168|4|5|100.0|3|450|13.044|8547 2019-06-25 09:33:45,908|FF|app-20190625093309-0168|5|4| END| 37.22|1.Maximal disks found | 13.48| 8547|1 2019-06-25 09:33:45,908|FF|app-20190625093309-0168|5|4|START| 37.22|2.Join done | 0.00| 0|1 2019-06-25 09:33:48,192|FF|app-20190625093309-0168|5|4| END| 39.50|2.Join done | 2.28| 17137|1 2019-06-25 09:33:48,192|FF|app-20190625093309-0168|5|4|START| 39.50|3.Flocks to report | 0.00| 0|1 2019-06-25 09:33:48,660|FF|app-20190625093309-0168|5|4| END| 39.97|3.Flocks to report | 0.47| 0|1 2019-06-25 09:33:48,660|FF|app-20190625093309-0168|5|4|START| 39.97|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:33:48,698|FF|app-20190625093309-0168|5|4| END| 40.01|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 09:33:48,698|FF|app-20190625093309-0168|5|4|START| 40.01|5.Flocks reported | 0.00| 0|1 2019-06-25 09:33:48,702|FF|app-20190625093309-0168|5|4| END| 40.01|5.Flocks reported | 0.00| 0|1 2019-06-25 09:33:48,702|FF|app-20190625093309-0168|5|4|START| 40.01|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:33:50,284|FF|app-20190625093309-0168|5|4| END| 41.59|6.Candidates indexed | 1.58| 17633|1 2019-06-25 09:33:50,284|FF|app-20190625093309-0168|5|4|START| 41.59|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:33:50,284|MF|app-20190625093309-0168|5|4|START| 41.59|A.Points indexed | 0.00| 0|2 2019-06-25 09:33:50,353|MF|app-20190625093309-0168|5|4| END| 41.66|A.Points indexed | 0.07| 18394|2 2019-06-25 09:33:50,353|MF|app-20190625093309-0168|5|4|START| 41.66|B.Pairs found | 0.00| 0|2 2019-06-25 09:33:50,808|MF|app-20190625093309-0168|5|4| END| 42.12|B.Pairs found | 0.46| 34918|2 2019-06-25 09:33:50,808|MF|app-20190625093309-0168|5|4|START| 42.12|C.Centers found | 0.00| 0|2 2019-06-25 09:33:51,283|MF|app-20190625093309-0168|5|4| END| 42.59|C.Centers found | 0.47| 69836|2 2019-06-25 09:33:51,283|MF|app-20190625093309-0168|5|4|START| 42.59|D.Disks found | 0.00| 0|2 2019-06-25 09:33:53,437|MF|app-20190625093309-0168|5|4| END| 44.75|D.Disks found | 2.15| 29549|2 2019-06-25 09:33:53,437|MF|app-20190625093309-0168|5|4|START| 44.75|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:33:54,192|MF|app-20190625093309-0168|5|4| END| 45.50|E.Disks partitioned | 0.76| 41840|2 2019-06-25 09:33:54,192|MF|app-20190625093309-0168|5|4|START| 45.50|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:33:54,193|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:33:54,193|Cell area: 1055533.7681000116 2019-06-25 09:34:03,810|MF|app-20190625093309-0168|5|4| END| 55.12|F.Maximal disks found | 9.62| 8685|2 2019-06-25 09:34:03,811|MAXIMALS|app-20190625093309-0168|4|5|100.0|3|450|13.527|8685 2019-06-25 09:34:04,244|FF|app-20190625093309-0168|5|4| END| 55.55|1.Maximal disks found | 13.96| 8685|2 2019-06-25 09:34:04,244|FF|app-20190625093309-0168|5|4|START| 55.55|2.Join done | 0.00| 0|2 2019-06-25 09:34:11,994|FF|app-20190625093309-0168|5|4| END| 63.30|2.Join done | 7.75| 32671|2 2019-06-25 09:34:11,994|FF|app-20190625093309-0168|5|4|START| 63.30|3.Flocks to report | 0.00| 0|2 2019-06-25 09:34:12,954|FF|app-20190625093309-0168|5|4| END| 64.26|3.Flocks to report | 0.96| 27872|2 2019-06-25 09:34:12,955|FF|app-20190625093309-0168|5|4|START| 64.26|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:34:12,994|FF|app-20190625093309-0168|5|4|START| 64.30|4a.Making expansions | 0.00| 0|2 2019-06-25 09:34:13,627|FF|app-20190625093309-0168|5|4| END| 64.94|4a.Making expansions | 0.63| 34681|2 2019-06-25 09:34:13,627|FF|app-20190625093309-0168|5|4|START| 64.94|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:34:25,645|FF|app-20190625093309-0168|5|4| END| 76.95|4b.Finding maximals | 12.02| 5697|2 2019-06-25 09:34:25,835|FF|app-20190625093309-0168|5|4| END| 77.14|4.Flocks prunned by expansion | 12.88| 5697|2 2019-06-25 09:34:25,835|FF|app-20190625093309-0168|5|4|START| 77.14|5.Flocks reported | 0.00| 0|2 2019-06-25 09:34:26,127|FF|app-20190625093309-0168|5|4| END| 77.44|5.Flocks reported | 0.29| 5697|2 2019-06-25 09:34:26,127|FF|app-20190625093309-0168|5|4|START| 77.44|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:34:27,989|FF|app-20190625093309-0168|5|4| END| 79.30|6.Candidates indexed | 1.86| 11079|2 2019-06-25 09:34:27,989|FF|app-20190625093309-0168|5|4|START| 79.30|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:34:27,989|MF|app-20190625093309-0168|5|4|START| 79.30|A.Points indexed | 0.00| 0|3 2019-06-25 09:34:28,048|MF|app-20190625093309-0168|5|4| END| 79.36|A.Points indexed | 0.06| 18548|3 2019-06-25 09:34:28,048|MF|app-20190625093309-0168|5|4|START| 79.36|B.Pairs found | 0.00| 0|3 2019-06-25 09:34:28,641|MF|app-20190625093309-0168|5|4| END| 79.95|B.Pairs found | 0.59| 35515|3 2019-06-25 09:34:28,641|MF|app-20190625093309-0168|5|4|START| 79.95|C.Centers found | 0.00| 0|3 2019-06-25 09:34:29,257|MF|app-20190625093309-0168|5|4| END| 80.57|C.Centers found | 0.62| 71030|3 2019-06-25 09:34:29,257|MF|app-20190625093309-0168|5|4|START| 80.57|D.Disks found | 0.00| 0|3 2019-06-25 09:34:32,382|MF|app-20190625093309-0168|5|4| END| 83.69|D.Disks found | 3.13| 30142|3 2019-06-25 09:34:32,382|MF|app-20190625093309-0168|5|4|START| 83.69|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:34:33,394|MF|app-20190625093309-0168|5|4| END| 84.70|E.Disks partitioned | 1.01| 42665|3 2019-06-25 09:34:33,394|MF|app-20190625093309-0168|5|4|START| 84.70|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:34:33,395|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:34:33,395|Cell area: 1055533.7681000116 2019-06-25 09:34:44,861|MF|app-20190625093309-0168|5|4| END| 96.17|F.Maximal disks found | 11.47| 8846|3 2019-06-25 09:34:44,862|MAXIMALS|app-20190625093309-0168|4|5|100.0|3|450|16.873|8846 2019-06-25 09:34:45,281|FF|app-20190625093309-0168|5|4| END| 96.59|1.Maximal disks found | 17.29| 8846|3 2019-06-25 09:34:45,281|FF|app-20190625093309-0168|5|4|START| 96.59|2.Join done | 0.00| 0|3 2019-06-25 09:34:51,685|FF|app-20190625093309-0168|5|4| END|102.99|2.Join done | 6.40| 30190|3 2019-06-25 09:34:51,685|FF|app-20190625093309-0168|5|4|START|102.99|3.Flocks to report | 0.00| 0|3 2019-06-25 09:34:53,318|FF|app-20190625093309-0168|5|4| END|104.63|3.Flocks to report | 1.63| 25328|3 2019-06-25 09:34:53,318|FF|app-20190625093309-0168|5|4|START|104.63|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:34:53,370|FF|app-20190625093309-0168|5|4|START|104.68|4a.Making expansions | 0.00| 0|3 2019-06-25 09:34:54,391|FF|app-20190625093309-0168|5|4| END|105.70|4a.Making expansions | 1.02| 32300|3 2019-06-25 09:34:54,391|FF|app-20190625093309-0168|5|4|START|105.70|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:35:05,501|FF|app-20190625093309-0168|5|4| END|116.81|4b.Finding maximals | 11.11| 5767|3 2019-06-25 09:35:05,839|FF|app-20190625093309-0168|5|4| END|117.15|4.Flocks prunned by expansion | 12.52| 5767|3 2019-06-25 09:35:05,840|FF|app-20190625093309-0168|5|4|START|117.15|5.Flocks reported | 0.00| 0|3 2019-06-25 09:35:06,320|FF|app-20190625093309-0168|5|4| END|117.63|5.Flocks reported | 0.48| 5767|3 2019-06-25 09:35:06,320|FF|app-20190625093309-0168|5|4|START|117.63|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:35:08,487|FF|app-20190625093309-0168|5|4| END|119.80|6.Candidates indexed | 2.17| 11171|3 2019-06-25 09:35:09,368|Number of flocks: 11464 2019-06-25 09:35:09,834|PFLOCK|app-20190625093309-0168|4|5|100.0|3|3|114.88|11464 2019-06-25 09:35:10,293|FF|app-20190625093309-0168|5|4| END|121.60|Flock Finder run |115.81| 11464|3 2019-06-25 09:35:10,293|FF|app-20190625093309-0168|5|4|START|121.60|Session closed | 0.00| 0|3 2019-06-25 09:35:17,234|FF|app-20190625093309-0168|5|4| END|128.54|Session closed | 6.94| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B3_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_grid-45x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B3_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 15 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:35:19,209|FF|app-00000000000000-0000|15|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 09:35:20,373|FF|app-20190625093520-0169|15|4| END| 1.15|Session start | 1.17| 0|-1 2019-06-25 09:35:20,373|FF|app-20190625093520-0169|15|4|START| 1.15|Data read | 0.00| 0|-1 2019-06-25 09:35:24,608|FF|app-20190625093520-0169|15|4| END| 5.38|Data read | 4.24|331128|-1 2019-06-25 09:35:24,608|FF|app-20190625093520-0169|15|4|START| 5.38|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:35:25,080|FF|app-20190625093520-0169|15|4| END| 5.85|KDBTree partitioner | 0.47| 816|-1 2019-06-25 09:35:25,080|FF|app-20190625093520-0169|15|4|START| 5.85|MF partitioner | 0.00| 0|-1 2019-06-25 09:35:25,095|FF|app-20190625093520-0169|15|4| END| 5.87|MF partitioner | 0.02| 1350|-1 2019-06-25 09:35:25,095|FF|app-20190625093520-0169|15|4|START| 5.87|Pointset done | 0.00| 0|-1 2019-06-25 09:35:26,173|FF|app-20190625093520-0169|15|4| END| 6.95|Pointset done | 1.08| 4|-1 2019-06-25 09:35:26,174|FF|app-20190625093520-0169|15|4|START| 6.95|Flock Finder run | 0.00| 0|-1 2019-06-25 09:35:26,192|FF|app-20190625093520-0169|15|4|START| 6.97|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:35:26,194|MF|app-20190625093520-0169|15|4|START| 6.97|A.Points indexed | 0.00| 0|0 2019-06-25 09:35:26,417|MF|app-20190625093520-0169|15|4| END| 7.19|A.Points indexed | 0.22| 54279|0 2019-06-25 09:35:26,417|MF|app-20190625093520-0169|15|4|START| 7.19|B.Pairs found | 0.00| 0|0 2019-06-25 09:35:28,484|MF|app-20190625093520-0169|15|4| END| 9.26|B.Pairs found | 2.07|118212|0 2019-06-25 09:35:28,484|MF|app-20190625093520-0169|15|4|START| 9.26|C.Centers found | 0.00| 0|0 2019-06-25 09:35:30,089|MF|app-20190625093520-0169|15|4| END| 10.86|C.Centers found | 1.60|236424|0 2019-06-25 09:35:30,089|MF|app-20190625093520-0169|15|4|START| 10.86|D.Disks found | 0.00| 0|0 2019-06-25 09:35:39,460|MF|app-20190625093520-0169|15|4| END| 20.23|D.Disks found | 9.37|105687|0 2019-06-25 09:35:39,460|MF|app-20190625093520-0169|15|4|START| 20.23|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:35:42,514|MF|app-20190625093520-0169|15|4| END| 23.29|E.Disks partitioned | 3.05|154597|0 2019-06-25 09:35:42,514|MF|app-20190625093520-0169|15|4|START| 23.29|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:35:42,516|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:35:42,516|Cell area: 1055533.7681000116 2019-06-25 09:36:09,572|MF|app-20190625093520-0169|15|4| END| 50.35|F.Maximal disks found | 27.06| 30002|0 2019-06-25 09:36:09,572|MAXIMALS|app-20190625093520-0169|4|15|110.0|3|1350|43.378|30002 2019-06-25 09:36:10,689|FF|app-20190625093520-0169|15|4| END| 51.46|1.Maximal disks found | 44.50| 30002|0 2019-06-25 09:36:10,689|FF|app-20190625093520-0169|15|4|START| 51.46|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:36:10,689|MF|app-20190625093520-0169|15|4|START| 51.46|A.Points indexed | 0.00| 0|1 2019-06-25 09:36:10,825|MF|app-20190625093520-0169|15|4| END| 51.60|A.Points indexed | 0.14| 54735|1 2019-06-25 09:36:10,825|MF|app-20190625093520-0169|15|4|START| 51.60|B.Pairs found | 0.00| 0|1 2019-06-25 09:36:11,888|MF|app-20190625093520-0169|15|4| END| 52.66|B.Pairs found | 1.06|119997|1 2019-06-25 09:36:11,888|MF|app-20190625093520-0169|15|4|START| 52.66|C.Centers found | 0.00| 0|1 2019-06-25 09:36:13,889|MF|app-20190625093520-0169|15|4| END| 54.66|C.Centers found | 2.00|239994|1 2019-06-25 09:36:13,889|MF|app-20190625093520-0169|15|4|START| 54.66|D.Disks found | 0.00| 0|1 2019-06-25 09:36:21,489|MF|app-20190625093520-0169|15|4| END| 62.26|D.Disks found | 7.60|107547|1 2019-06-25 09:36:21,489|MF|app-20190625093520-0169|15|4|START| 62.26|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:36:23,468|MF|app-20190625093520-0169|15|4| END| 64.24|E.Disks partitioned | 1.98|157199|1 2019-06-25 09:36:23,468|MF|app-20190625093520-0169|15|4|START| 64.24|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:36:23,469|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:36:23,469|Cell area: 1055533.7681000116 2019-06-25 09:36:49,927|MF|app-20190625093520-0169|15|4| END| 90.70|F.Maximal disks found | 26.46| 30329|1 2019-06-25 09:36:49,927|MAXIMALS|app-20190625093520-0169|4|15|110.0|3|1350|39.238|30329 2019-06-25 09:36:50,934|FF|app-20190625093520-0169|15|4| END| 91.71|1.Maximal disks found | 40.25| 30329|1 2019-06-25 09:36:50,934|FF|app-20190625093520-0169|15|4|START| 91.71|2.Join done | 0.00| 0|1 2019-06-25 09:36:54,124|FF|app-20190625093520-0169|15|4| END| 94.90|2.Join done | 3.19| 65661|1 2019-06-25 09:36:54,125|FF|app-20190625093520-0169|15|4|START| 94.90|3.Flocks to report | 0.00| 0|1 2019-06-25 09:36:54,772|FF|app-20190625093520-0169|15|4| END| 95.55|3.Flocks to report | 0.65| 0|1 2019-06-25 09:36:54,772|FF|app-20190625093520-0169|15|4|START| 95.55|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:36:54,842|FF|app-20190625093520-0169|15|4| END| 95.62|4.Flocks prunned by expansion | 0.07| 0|1 2019-06-25 09:36:54,842|FF|app-20190625093520-0169|15|4|START| 95.62|5.Flocks reported | 0.00| 0|1 2019-06-25 09:36:54,848|FF|app-20190625093520-0169|15|4| END| 95.62|5.Flocks reported | 0.01| 0|1 2019-06-25 09:36:54,848|FF|app-20190625093520-0169|15|4|START| 95.62|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:36:56,593|FF|app-20190625093520-0169|15|4| END| 97.37|6.Candidates indexed | 1.75| 67476|1 2019-06-25 09:36:56,594|FF|app-20190625093520-0169|15|4|START| 97.37|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:36:56,594|MF|app-20190625093520-0169|15|4|START| 97.37|A.Points indexed | 0.00| 0|2 2019-06-25 09:36:56,722|MF|app-20190625093520-0169|15|4| END| 97.50|A.Points indexed | 0.13| 55182|2 2019-06-25 09:36:56,722|MF|app-20190625093520-0169|15|4|START| 97.50|B.Pairs found | 0.00| 0|2 2019-06-25 09:36:57,520|MF|app-20190625093520-0169|15|4| END| 98.29|B.Pairs found | 0.80|121698|2 2019-06-25 09:36:57,520|MF|app-20190625093520-0169|15|4|START| 98.29|C.Centers found | 0.00| 0|2 2019-06-25 09:36:58,510|MF|app-20190625093520-0169|15|4| END| 99.28|C.Centers found | 0.99|243396|2 2019-06-25 09:36:58,510|MF|app-20190625093520-0169|15|4|START| 99.28|D.Disks found | 0.00| 0|2 2019-06-25 09:37:02,211|MF|app-20190625093520-0169|15|4| END|102.99|D.Disks found | 3.70|109059|2 2019-06-25 09:37:02,211|MF|app-20190625093520-0169|15|4|START|102.99|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:37:03,156|MF|app-20190625093520-0169|15|4| END|103.93|E.Disks partitioned | 0.95|159559|2 2019-06-25 09:37:03,156|MF|app-20190625093520-0169|15|4|START|103.93|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:37:03,157|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:37:03,157|Cell area: 1055533.7681000116 2019-06-25 09:37:31,257|MF|app-20190625093520-0169|15|4| END|132.03|F.Maximal disks found | 28.10| 31016|2 2019-06-25 09:37:31,257|MAXIMALS|app-20190625093520-0169|4|15|110.0|3|1350|34.663|31016 2019-06-25 09:37:32,324|FF|app-20190625093520-0169|15|4| END|133.10|1.Maximal disks found | 35.73| 31016|2 2019-06-25 09:37:32,324|FF|app-20190625093520-0169|15|4|START|133.10|2.Join done | 0.00| 0|2 2019-06-25 09:37:54,688|FF|app-20190625093520-0169|15|4| END|155.46|2.Join done | 22.36|134462|2 2019-06-25 09:37:54,688|FF|app-20190625093520-0169|15|4|START|155.46|3.Flocks to report | 0.00| 0|2 2019-06-25 09:37:58,383|FF|app-20190625093520-0169|15|4| END|159.16|3.Flocks to report | 3.70|114833|2 2019-06-25 09:37:58,384|FF|app-20190625093520-0169|15|4|START|159.16|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:37:58,473|FF|app-20190625093520-0169|15|4|START|159.25|4a.Making expansions | 0.00| 0|2 2019-06-25 09:37:59,967|FF|app-20190625093520-0169|15|4| END|160.74|4a.Making expansions | 1.49|143271|2 2019-06-25 09:37:59,967|FF|app-20190625093520-0169|15|4|START|160.74|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:38:49,892|FF|app-20190625093520-0169|15|4| END|210.67|4b.Finding maximals | 49.93| 19803|2 2019-06-25 09:38:50,339|FF|app-20190625093520-0169|15|4| END|211.11|4.Flocks prunned by expansion | 51.96| 19803|2 2019-06-25 09:38:50,339|FF|app-20190625093520-0169|15|4|START|211.11|5.Flocks reported | 0.00| 0|2 2019-06-25 09:38:50,950|FF|app-20190625093520-0169|15|4| END|211.72|5.Flocks reported | 0.61| 19803|2 2019-06-25 09:38:50,950|FF|app-20190625093520-0169|15|4|START|211.72|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:38:53,188|FF|app-20190625093520-0169|15|4| END|213.96|6.Candidates indexed | 2.24| 41368|2 2019-06-25 09:38:53,188|FF|app-20190625093520-0169|15|4|START|213.96|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:38:53,188|MF|app-20190625093520-0169|15|4|START|213.96|A.Points indexed | 0.00| 0|3 2019-06-25 09:38:53,303|MF|app-20190625093520-0169|15|4| END|214.08|A.Points indexed | 0.12| 55644|3 2019-06-25 09:38:53,303|MF|app-20190625093520-0169|15|4|START|214.08|B.Pairs found | 0.00| 0|3 2019-06-25 09:38:54,210|MF|app-20190625093520-0169|15|4| END|214.98|B.Pairs found | 0.91|123771|3 2019-06-25 09:38:54,210|MF|app-20190625093520-0169|15|4|START|214.98|C.Centers found | 0.00| 0|3 2019-06-25 09:38:55,118|MF|app-20190625093520-0169|15|4| END|215.89|C.Centers found | 0.91|247542|3 2019-06-25 09:38:55,118|MF|app-20190625093520-0169|15|4|START|215.89|D.Disks found | 0.00| 0|3 2019-06-25 09:38:59,826|MF|app-20190625093520-0169|15|4| END|220.60|D.Disks found | 4.71|111261|3 2019-06-25 09:38:59,826|MF|app-20190625093520-0169|15|4|START|220.60|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:39:01,329|MF|app-20190625093520-0169|15|4| END|222.10|E.Disks partitioned | 1.50|162756|3 2019-06-25 09:39:01,329|MF|app-20190625093520-0169|15|4|START|222.10|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:39:01,330|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:39:01,330|Cell area: 1055533.7681000116 2019-06-25 09:39:34,181|MF|app-20190625093520-0169|15|4| END|254.96|F.Maximal disks found | 32.85| 31512|3 2019-06-25 09:39:34,181|MAXIMALS|app-20190625093520-0169|4|15|110.0|3|1350|40.993|31512 2019-06-25 09:39:35,221|FF|app-20190625093520-0169|15|4| END|256.00|1.Maximal disks found | 42.03| 31512|3 2019-06-25 09:39:35,221|FF|app-20190625093520-0169|15|4|START|256.00|2.Join done | 0.00| 0|3 2019-06-25 09:39:46,688|FF|app-20190625093520-0169|15|4| END|267.46|2.Join done | 11.47|134798|3 2019-06-25 09:39:46,688|FF|app-20190625093520-0169|15|4|START|267.46|3.Flocks to report | 0.00| 0|3 2019-06-25 09:39:49,158|FF|app-20190625093520-0169|15|4| END|269.93|3.Flocks to report | 2.47|115131|3 2019-06-25 09:39:49,158|FF|app-20190625093520-0169|15|4|START|269.93|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:39:49,241|FF|app-20190625093520-0169|15|4|START|270.02|4a.Making expansions | 0.00| 0|3 2019-06-25 09:39:50,566|FF|app-20190625093520-0169|15|4| END|271.34|4a.Making expansions | 1.33|143295|3 2019-06-25 09:39:50,566|FF|app-20190625093520-0169|15|4|START|271.34|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:40:58,884|FF|app-20190625093520-0169|15|4| END|339.66|4b.Finding maximals | 68.32| 20007|3 2019-06-25 09:40:59,380|FF|app-20190625093520-0169|15|4| END|340.15|4.Flocks prunned by expansion | 70.22| 20007|3 2019-06-25 09:40:59,380|FF|app-20190625093520-0169|15|4|START|340.15|5.Flocks reported | 0.00| 0|3 2019-06-25 09:40:59,982|FF|app-20190625093520-0169|15|4| END|340.76|5.Flocks reported | 0.60| 20007|3 2019-06-25 09:40:59,982|FF|app-20190625093520-0169|15|4|START|340.76|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:41:02,131|FF|app-20190625093520-0169|15|4| END|342.91|6.Candidates indexed | 2.15| 41642|3 2019-06-25 09:41:03,483|Number of flocks: 39810 2019-06-25 09:41:04,412|PFLOCK|app-20190625093520-0169|4|15|110.0|3|3|337.31|39810 2019-06-25 09:41:05,320|FF|app-20190625093520-0169|15|4| END|346.09|Flock Finder run |339.15| 39810|3 2019-06-25 09:41:05,320|FF|app-20190625093520-0169|15|4|START|346.09|Session closed | 0.00| 0|3 2019-06-25 09:41:12,545|FF|app-20190625093520-0169|15|4| END|353.32|Session closed | 7.22| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 10 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:41:14,535|FF|app-00000000000000-0000|10|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 09:41:15,666|FF|app-20190625094115-0170|10|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 09:41:15,667|FF|app-20190625094115-0170|10|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 09:41:19,707|FF|app-20190625094115-0170|10|4| END| 5.16|Data read | 4.04|220752|-1 2019-06-25 09:41:19,707|FF|app-20190625094115-0170|10|4|START| 5.16|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:41:19,868|FF|app-20190625094115-0170|10|4| END| 5.32|KDBTree partitioner | 0.16| 544|-1 2019-06-25 09:41:19,869|FF|app-20190625094115-0170|10|4|START| 5.32|MF partitioner | 0.00| 0|-1 2019-06-25 09:41:19,887|FF|app-20190625094115-0170|10|4| END| 5.34|MF partitioner | 0.02| 900|-1 2019-06-25 09:41:19,887|FF|app-20190625094115-0170|10|4|START| 5.34|Pointset done | 0.00| 0|-1 2019-06-25 09:41:20,989|FF|app-20190625094115-0170|10|4| END| 6.44|Pointset done | 1.10| 4|-1 2019-06-25 09:41:20,990|FF|app-20190625094115-0170|10|4|START| 6.44|Flock Finder run | 0.00| 0|-1 2019-06-25 09:41:21,010|FF|app-20190625094115-0170|10|4|START| 6.46|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:41:21,012|MF|app-20190625094115-0170|10|4|START| 6.46|A.Points indexed | 0.00| 0|0 2019-06-25 09:41:21,207|MF|app-20190625094115-0170|10|4| END| 6.66|A.Points indexed | 0.20| 36186|0 2019-06-25 09:41:21,207|MF|app-20190625094115-0170|10|4|START| 6.66|B.Pairs found | 0.00| 0|0 2019-06-25 09:41:23,236|MF|app-20190625094115-0170|10|4| END| 8.68|B.Pairs found | 2.03| 78808|0 2019-06-25 09:41:23,236|MF|app-20190625094115-0170|10|4|START| 8.68|C.Centers found | 0.00| 0|0 2019-06-25 09:41:25,246|MF|app-20190625094115-0170|10|4| END| 10.69|C.Centers found | 2.01|157616|0 2019-06-25 09:41:25,246|MF|app-20190625094115-0170|10|4|START| 10.69|D.Disks found | 0.00| 0|0 2019-06-25 09:41:33,922|MF|app-20190625094115-0170|10|4| END| 19.37|D.Disks found | 8.68| 70458|0 2019-06-25 09:41:33,923|MF|app-20190625094115-0170|10|4|START| 19.37|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:41:38,802|MF|app-20190625094115-0170|10|4| END| 24.25|E.Disks partitioned | 4.88|103004|0 2019-06-25 09:41:38,802|MF|app-20190625094115-0170|10|4|START| 24.25|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:41:38,805|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:41:38,805|Cell area: 1055533.7681000116 2019-06-25 09:42:10,061|MF|app-20190625094115-0170|10|4| END| 55.51|F.Maximal disks found | 31.26| 20001|0 2019-06-25 09:42:10,061|MAXIMALS|app-20190625094115-0170|4|10|110.0|3|900|49.049|20001 2019-06-25 09:42:11,666|FF|app-20190625094115-0170|10|4| END| 57.11|1.Maximal disks found | 50.66| 20001|0 2019-06-25 09:42:11,667|FF|app-20190625094115-0170|10|4|START| 57.12|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:42:11,667|MF|app-20190625094115-0170|10|4|START| 57.12|A.Points indexed | 0.00| 0|1 2019-06-25 09:42:11,764|MF|app-20190625094115-0170|10|4| END| 57.21|A.Points indexed | 0.10| 36490|1 2019-06-25 09:42:11,764|MF|app-20190625094115-0170|10|4|START| 57.21|B.Pairs found | 0.00| 0|1 2019-06-25 09:42:12,720|MF|app-20190625094115-0170|10|4| END| 58.17|B.Pairs found | 0.96| 79998|1 2019-06-25 09:42:12,720|MF|app-20190625094115-0170|10|4|START| 58.17|C.Centers found | 0.00| 0|1 2019-06-25 09:42:14,149|MF|app-20190625094115-0170|10|4| END| 59.60|C.Centers found | 1.43|159996|1 2019-06-25 09:42:14,149|MF|app-20190625094115-0170|10|4|START| 59.60|D.Disks found | 0.00| 0|1 2019-06-25 09:42:19,597|MF|app-20190625094115-0170|10|4| END| 65.05|D.Disks found | 5.45| 71698|1 2019-06-25 09:42:19,597|MF|app-20190625094115-0170|10|4|START| 65.05|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:42:22,276|MF|app-20190625094115-0170|10|4| END| 67.72|E.Disks partitioned | 2.68|104758|1 2019-06-25 09:42:22,276|MF|app-20190625094115-0170|10|4|START| 67.72|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:42:22,276|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:42:22,276|Cell area: 1055533.7681000116 2019-06-25 09:42:48,510|MF|app-20190625094115-0170|10|4| END| 93.96|F.Maximal disks found | 26.23| 20222|1 2019-06-25 09:42:48,510|MAXIMALS|app-20190625094115-0170|4|10|110.0|3|900|36.843|20222 2019-06-25 09:42:49,512|FF|app-20190625094115-0170|10|4| END| 94.96|1.Maximal disks found | 37.85| 20222|1 2019-06-25 09:42:49,512|FF|app-20190625094115-0170|10|4|START| 94.96|2.Join done | 0.00| 0|1 2019-06-25 09:42:56,106|FF|app-20190625094115-0170|10|4| END|101.55|2.Join done | 6.59| 43837|1 2019-06-25 09:42:56,106|FF|app-20190625094115-0170|10|4|START|101.55|3.Flocks to report | 0.00| 0|1 2019-06-25 09:42:57,357|FF|app-20190625094115-0170|10|4| END|102.81|3.Flocks to report | 1.25| 0|1 2019-06-25 09:42:57,357|FF|app-20190625094115-0170|10|4|START|102.81|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:42:57,418|FF|app-20190625094115-0170|10|4| END|102.87|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 09:42:57,418|FF|app-20190625094115-0170|10|4|START|102.87|5.Flocks reported | 0.00| 0|1 2019-06-25 09:42:57,423|FF|app-20190625094115-0170|10|4| END|102.87|5.Flocks reported | 0.01| 0|1 2019-06-25 09:42:57,423|FF|app-20190625094115-0170|10|4|START|102.87|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:43:00,075|FF|app-20190625094115-0170|10|4| END|105.52|6.Candidates indexed | 2.65| 45047|1 2019-06-25 09:43:00,075|FF|app-20190625094115-0170|10|4|START|105.52|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:43:00,075|MF|app-20190625094115-0170|10|4|START|105.52|A.Points indexed | 0.00| 0|2 2019-06-25 09:43:00,171|MF|app-20190625094115-0170|10|4| END|105.62|A.Points indexed | 0.10| 36788|2 2019-06-25 09:43:00,171|MF|app-20190625094115-0170|10|4|START|105.62|B.Pairs found | 0.00| 0|2 2019-06-25 09:43:00,949|MF|app-20190625094115-0170|10|4| END|106.40|B.Pairs found | 0.78| 81132|2 2019-06-25 09:43:00,949|MF|app-20190625094115-0170|10|4|START|106.40|C.Centers found | 0.00| 0|2 2019-06-25 09:43:01,799|MF|app-20190625094115-0170|10|4| END|107.25|C.Centers found | 0.85|162264|2 2019-06-25 09:43:01,799|MF|app-20190625094115-0170|10|4|START|107.25|D.Disks found | 0.00| 0|2 2019-06-25 09:43:06,135|MF|app-20190625094115-0170|10|4| END|111.58|D.Disks found | 4.34| 72706|2 2019-06-25 09:43:06,136|MF|app-20190625094115-0170|10|4|START|111.58|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:43:10,641|MF|app-20190625094115-0170|10|4| END|116.09|E.Disks partitioned | 4.51|106347|2 2019-06-25 09:43:10,641|MF|app-20190625094115-0170|10|4|START|116.09|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:43:10,642|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:43:10,642|Cell area: 1055533.7681000116 2019-06-25 09:43:40,140|MF|app-20190625094115-0170|10|4| END|145.59|F.Maximal disks found | 29.50| 20682|2 2019-06-25 09:43:40,140|MAXIMALS|app-20190625094115-0170|4|10|110.0|3|900|40.065|20682 2019-06-25 09:43:41,623|FF|app-20190625094115-0170|10|4| END|147.07|1.Maximal disks found | 41.55| 20682|2 2019-06-25 09:43:41,623|FF|app-20190625094115-0170|10|4|START|147.07|2.Join done | 0.00| 0|2 2019-06-25 09:44:13,606|FF|app-20190625094115-0170|10|4| END|179.05|2.Join done | 31.98| 89740|2 2019-06-25 09:44:13,606|FF|app-20190625094115-0170|10|4|START|179.05|3.Flocks to report | 0.00| 0|2 2019-06-25 09:44:18,374|FF|app-20190625094115-0170|10|4| END|183.82|3.Flocks to report | 4.77| 76643|2 2019-06-25 09:44:18,374|FF|app-20190625094115-0170|10|4|START|183.82|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:44:18,467|FF|app-20190625094115-0170|10|4|START|183.92|4a.Making expansions | 0.00| 0|2 2019-06-25 09:44:20,834|FF|app-20190625094115-0170|10|4| END|186.28|4a.Making expansions | 2.37| 95701|2 2019-06-25 09:44:20,835|FF|app-20190625094115-0170|10|4|START|186.28|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:45:06,416|FF|app-20190625094115-0170|10|4| END|231.86|4b.Finding maximals | 45.58| 13202|2 2019-06-25 09:45:07,024|FF|app-20190625094115-0170|10|4| END|232.47|4.Flocks prunned by expansion | 48.65| 13202|2 2019-06-25 09:45:07,024|FF|app-20190625094115-0170|10|4|START|232.47|5.Flocks reported | 0.00| 0|2 2019-06-25 09:45:08,044|FF|app-20190625094115-0170|10|4| END|233.49|5.Flocks reported | 1.02| 13202|2 2019-06-25 09:45:08,044|FF|app-20190625094115-0170|10|4|START|233.49|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:45:12,272|FF|app-20190625094115-0170|10|4| END|237.72|6.Candidates indexed | 4.23| 27595|2 2019-06-25 09:45:12,272|FF|app-20190625094115-0170|10|4|START|237.72|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:45:12,272|MF|app-20190625094115-0170|10|4|START|237.72|A.Points indexed | 0.00| 0|3 2019-06-25 09:45:12,360|MF|app-20190625094115-0170|10|4| END|237.81|A.Points indexed | 0.09| 37096|3 2019-06-25 09:45:12,360|MF|app-20190625094115-0170|10|4|START|237.81|B.Pairs found | 0.00| 0|3 2019-06-25 09:45:12,981|MF|app-20190625094115-0170|10|4| END|238.43|B.Pairs found | 0.62| 82514|3 2019-06-25 09:45:12,981|MF|app-20190625094115-0170|10|4|START|238.43|C.Centers found | 0.00| 0|3 2019-06-25 09:45:13,713|MF|app-20190625094115-0170|10|4| END|239.16|C.Centers found | 0.73|165028|3 2019-06-25 09:45:13,713|MF|app-20190625094115-0170|10|4|START|239.16|D.Disks found | 0.00| 0|3 2019-06-25 09:45:19,756|MF|app-20190625094115-0170|10|4| END|245.20|D.Disks found | 6.04| 74174|3 2019-06-25 09:45:19,756|MF|app-20190625094115-0170|10|4|START|245.20|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:45:24,431|MF|app-20190625094115-0170|10|4| END|249.88|E.Disks partitioned | 4.68|108468|3 2019-06-25 09:45:24,431|MF|app-20190625094115-0170|10|4|START|249.88|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:45:24,431|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:45:24,431|Cell area: 1055533.7681000116 2019-06-25 09:46:01,213|MF|app-20190625094115-0170|10|4| END|286.66|F.Maximal disks found | 36.78| 21009|3 2019-06-25 09:46:01,213|MAXIMALS|app-20190625094115-0170|4|10|110.0|3|900|48.941|21009 2019-06-25 09:46:02,781|FF|app-20190625094115-0170|10|4| END|288.23|1.Maximal disks found | 50.51| 21009|3 2019-06-25 09:46:02,781|FF|app-20190625094115-0170|10|4|START|288.23|2.Join done | 0.00| 0|3 2019-06-25 09:46:25,221|FF|app-20190625094115-0170|10|4| END|310.67|2.Join done | 22.44| 90003|3 2019-06-25 09:46:25,221|FF|app-20190625094115-0170|10|4|START|310.67|3.Flocks to report | 0.00| 0|3 2019-06-25 09:46:29,762|FF|app-20190625094115-0170|10|4| END|315.21|3.Flocks to report | 4.54| 76861|3 2019-06-25 09:46:29,762|FF|app-20190625094115-0170|10|4|START|315.21|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:46:29,865|FF|app-20190625094115-0170|10|4|START|315.31|4a.Making expansions | 0.00| 0|3 2019-06-25 09:46:33,027|FF|app-20190625094115-0170|10|4| END|318.48|4a.Making expansions | 3.16| 95919|3 2019-06-25 09:46:33,027|FF|app-20190625094115-0170|10|4|START|318.48|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:47:36,262|FF|app-20190625094115-0170|10|4| END|381.71|4b.Finding maximals | 63.24| 13338|3 2019-06-25 09:47:36,891|FF|app-20190625094115-0170|10|4| END|382.34|4.Flocks prunned by expansion | 67.13| 13338|3 2019-06-25 09:47:36,891|FF|app-20190625094115-0170|10|4|START|382.34|5.Flocks reported | 0.00| 0|3 2019-06-25 09:47:37,948|FF|app-20190625094115-0170|10|4| END|383.40|5.Flocks reported | 1.06| 13338|3 2019-06-25 09:47:37,948|FF|app-20190625094115-0170|10|4|START|383.40|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:47:42,145|FF|app-20190625094115-0170|10|4| END|387.59|6.Candidates indexed | 4.20| 27789|3 2019-06-25 09:47:43,677|Number of flocks: 26540 2019-06-25 09:47:44,523|PFLOCK|app-20190625094115-0170|4|10|110.0|3|3|382.69|26540 2019-06-25 09:47:45,304|FF|app-20190625094115-0170|10|4| END|390.75|Flock Finder run |384.31| 26540|3 2019-06-25 09:47:45,304|FF|app-20190625094115-0170|10|4|START|390.75|Session closed | 0.00| 0|3 2019-06-25 09:47:52,078|FF|app-20190625094115-0170|10|4| END|397.53|Session closed | 6.77| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 5 --fftimestamp 4 --portui 4040 --info 2019-06-25 09:47:54,077|FF|app-00000000000000-0000|5|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 09:47:55,167|FF|app-20190625094754-0171|5|4| END| 1.07|Session start | 1.09| 0|-1 2019-06-25 09:47:55,167|FF|app-20190625094754-0171|5|4|START| 1.07|Data read | 0.00| 0|-1 2019-06-25 09:47:58,937|FF|app-20190625094754-0171|5|4| END| 4.84|Data read | 3.77|110376|-1 2019-06-25 09:47:58,937|FF|app-20190625094754-0171|5|4|START| 4.84|KDBTree partitioner | 0.00| 0|-1 2019-06-25 09:47:59,070|FF|app-20190625094754-0171|5|4| END| 4.98|KDBTree partitioner | 0.13| 272|-1 2019-06-25 09:47:59,070|FF|app-20190625094754-0171|5|4|START| 4.98|MF partitioner | 0.00| 0|-1 2019-06-25 09:47:59,084|FF|app-20190625094754-0171|5|4| END| 4.99|MF partitioner | 0.01| 450|-1 2019-06-25 09:47:59,084|FF|app-20190625094754-0171|5|4|START| 4.99|Pointset done | 0.00| 0|-1 2019-06-25 09:47:59,979|FF|app-20190625094754-0171|5|4| END| 5.89|Pointset done | 0.89| 4|-1 2019-06-25 09:47:59,979|FF|app-20190625094754-0171|5|4|START| 5.89|Flock Finder run | 0.00| 0|-1 2019-06-25 09:48:00,002|FF|app-20190625094754-0171|5|4|START| 5.91|1.Maximal disks found | 0.00| 0|0 2019-06-25 09:48:00,005|MF|app-20190625094754-0171|5|4|START| 5.91|A.Points indexed | 0.00| 0|0 2019-06-25 09:48:00,169|MF|app-20190625094754-0171|5|4| END| 6.08|A.Points indexed | 0.16| 18093|0 2019-06-25 09:48:00,169|MF|app-20190625094754-0171|5|4|START| 6.08|B.Pairs found | 0.00| 0|0 2019-06-25 09:48:01,475|MF|app-20190625094754-0171|5|4| END| 7.38|B.Pairs found | 1.31| 39404|0 2019-06-25 09:48:01,475|MF|app-20190625094754-0171|5|4|START| 7.38|C.Centers found | 0.00| 0|0 2019-06-25 09:48:02,237|MF|app-20190625094754-0171|5|4| END| 8.14|C.Centers found | 0.76| 78808|0 2019-06-25 09:48:02,237|MF|app-20190625094754-0171|5|4|START| 8.14|D.Disks found | 0.00| 0|0 2019-06-25 09:48:05,269|MF|app-20190625094754-0171|5|4| END| 11.18|D.Disks found | 3.03| 35229|0 2019-06-25 09:48:05,269|MF|app-20190625094754-0171|5|4|START| 11.18|E.Disks partitioned | 0.00| 0|0 2019-06-25 09:48:06,517|MF|app-20190625094754-0171|5|4| END| 12.42|E.Disks partitioned | 1.25| 51442|0 2019-06-25 09:48:06,517|MF|app-20190625094754-0171|5|4|START| 12.42|F.Maximal disks found | 0.00| 0|0 2019-06-25 09:48:06,518|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:48:06,519|Cell area: 1055533.7681000116 2019-06-25 09:48:30,531|MF|app-20190625094754-0171|5|4| END| 36.44|F.Maximal disks found | 24.01| 10001|0 2019-06-25 09:48:30,531|MAXIMALS|app-20190625094754-0171|4|5|110.0|3|450|30.526|10001 2019-06-25 09:48:31,040|FF|app-20190625094754-0171|5|4| END| 36.95|1.Maximal disks found | 31.04| 10001|0 2019-06-25 09:48:31,040|FF|app-20190625094754-0171|5|4|START| 36.95|1.Maximal disks found | 0.00| 0|1 2019-06-25 09:48:31,040|MF|app-20190625094754-0171|5|4|START| 36.95|A.Points indexed | 0.00| 0|1 2019-06-25 09:48:31,117|MF|app-20190625094754-0171|5|4| END| 37.02|A.Points indexed | 0.08| 18245|1 2019-06-25 09:48:31,117|MF|app-20190625094754-0171|5|4|START| 37.02|B.Pairs found | 0.00| 0|1 2019-06-25 09:48:31,604|MF|app-20190625094754-0171|5|4| END| 37.51|B.Pairs found | 0.49| 39999|1 2019-06-25 09:48:31,604|MF|app-20190625094754-0171|5|4|START| 37.51|C.Centers found | 0.00| 0|1 2019-06-25 09:48:32,018|MF|app-20190625094754-0171|5|4| END| 37.93|C.Centers found | 0.41| 79998|1 2019-06-25 09:48:32,018|MF|app-20190625094754-0171|5|4|START| 37.93|D.Disks found | 0.00| 0|1 2019-06-25 09:48:34,147|MF|app-20190625094754-0171|5|4| END| 40.05|D.Disks found | 2.13| 35849|1 2019-06-25 09:48:34,148|MF|app-20190625094754-0171|5|4|START| 40.05|E.Disks partitioned | 0.00| 0|1 2019-06-25 09:48:35,053|MF|app-20190625094754-0171|5|4| END| 40.96|E.Disks partitioned | 0.91| 52317|1 2019-06-25 09:48:35,053|MF|app-20190625094754-0171|5|4|START| 40.96|F.Maximal disks found | 0.00| 0|1 2019-06-25 09:48:35,054|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:48:35,054|Cell area: 1055533.7681000116 2019-06-25 09:49:00,181|MF|app-20190625094754-0171|5|4| END| 66.09|F.Maximal disks found | 25.13| 10110|1 2019-06-25 09:49:00,181|MAXIMALS|app-20190625094754-0171|4|5|110.0|3|450|29.141|10110 2019-06-25 09:49:00,650|FF|app-20190625094754-0171|5|4| END| 66.56|1.Maximal disks found | 29.61| 10110|1 2019-06-25 09:49:00,651|FF|app-20190625094754-0171|5|4|START| 66.56|2.Join done | 0.00| 0|1 2019-06-25 09:49:03,234|FF|app-20190625094754-0171|5|4| END| 69.14|2.Join done | 2.58| 21993|1 2019-06-25 09:49:03,235|FF|app-20190625094754-0171|5|4|START| 69.14|3.Flocks to report | 0.00| 0|1 2019-06-25 09:49:03,802|FF|app-20190625094754-0171|5|4| END| 69.71|3.Flocks to report | 0.57| 0|1 2019-06-25 09:49:03,802|FF|app-20190625094754-0171|5|4|START| 69.71|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 09:49:03,841|FF|app-20190625094754-0171|5|4| END| 69.75|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 09:49:03,841|FF|app-20190625094754-0171|5|4|START| 69.75|5.Flocks reported | 0.00| 0|1 2019-06-25 09:49:03,846|FF|app-20190625094754-0171|5|4| END| 69.75|5.Flocks reported | 0.01| 0|1 2019-06-25 09:49:03,846|FF|app-20190625094754-0171|5|4|START| 69.75|6.Candidates indexed | 0.00| 0|1 2019-06-25 09:49:05,797|FF|app-20190625094754-0171|5|4| END| 71.70|6.Candidates indexed | 1.95| 22599|1 2019-06-25 09:49:05,797|FF|app-20190625094754-0171|5|4|START| 71.70|1.Maximal disks found | 0.00| 0|2 2019-06-25 09:49:05,798|MF|app-20190625094754-0171|5|4|START| 71.71|A.Points indexed | 0.00| 0|2 2019-06-25 09:49:05,868|MF|app-20190625094754-0171|5|4| END| 71.78|A.Points indexed | 0.07| 18394|2 2019-06-25 09:49:05,868|MF|app-20190625094754-0171|5|4|START| 71.78|B.Pairs found | 0.00| 0|2 2019-06-25 09:49:06,317|MF|app-20190625094754-0171|5|4| END| 72.22|B.Pairs found | 0.45| 40566|2 2019-06-25 09:49:06,317|MF|app-20190625094754-0171|5|4|START| 72.22|C.Centers found | 0.00| 0|2 2019-06-25 09:49:06,721|MF|app-20190625094754-0171|5|4| END| 72.63|C.Centers found | 0.40| 81132|2 2019-06-25 09:49:06,721|MF|app-20190625094754-0171|5|4|START| 72.63|D.Disks found | 0.00| 0|2 2019-06-25 09:49:08,876|MF|app-20190625094754-0171|5|4| END| 74.78|D.Disks found | 2.16| 36353|2 2019-06-25 09:49:08,876|MF|app-20190625094754-0171|5|4|START| 74.78|E.Disks partitioned | 0.00| 0|2 2019-06-25 09:49:09,720|MF|app-20190625094754-0171|5|4| END| 75.63|E.Disks partitioned | 0.84| 53134|2 2019-06-25 09:49:09,720|MF|app-20190625094754-0171|5|4|START| 75.63|F.Maximal disks found | 0.00| 0|2 2019-06-25 09:49:09,720|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:49:09,720|Cell area: 1055533.7681000116 2019-06-25 09:49:34,851|MF|app-20190625094754-0171|5|4| END|100.76|F.Maximal disks found | 25.13| 10342|2 2019-06-25 09:49:34,851|MAXIMALS|app-20190625094754-0171|4|5|110.0|3|450|29.053|10342 2019-06-25 09:49:35,270|FF|app-20190625094754-0171|5|4| END|101.18|1.Maximal disks found | 29.47| 10342|2 2019-06-25 09:49:35,270|FF|app-20190625094754-0171|5|4|START|101.18|2.Join done | 0.00| 0|2 2019-06-25 09:49:46,980|FF|app-20190625094754-0171|5|4| END|112.89|2.Join done | 11.71| 45000|2 2019-06-25 09:49:46,980|FF|app-20190625094754-0171|5|4|START|112.89|3.Flocks to report | 0.00| 0|2 2019-06-25 09:49:48,288|FF|app-20190625094754-0171|5|4| END|114.20|3.Flocks to report | 1.31| 38432|2 2019-06-25 09:49:48,288|FF|app-20190625094754-0171|5|4|START|114.20|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 09:49:48,328|FF|app-20190625094754-0171|5|4|START|114.24|4a.Making expansions | 0.00| 0|2 2019-06-25 09:49:49,069|FF|app-20190625094754-0171|5|4| END|114.98|4a.Making expansions | 0.74| 47634|2 2019-06-25 09:49:49,069|FF|app-20190625094754-0171|5|4|START|114.98|4b.Finding maximals | 0.00| 0|2 2019-06-25 09:50:33,488|FF|app-20190625094754-0171|5|4| END|159.40|4b.Finding maximals | 44.42| 6601|2 2019-06-25 09:50:33,687|FF|app-20190625094754-0171|5|4| END|159.59|4.Flocks prunned by expansion | 45.40| 6601|2 2019-06-25 09:50:33,687|FF|app-20190625094754-0171|5|4|START|159.59|5.Flocks reported | 0.00| 0|2 2019-06-25 09:50:33,992|FF|app-20190625094754-0171|5|4| END|159.90|5.Flocks reported | 0.31| 6601|2 2019-06-25 09:50:33,992|FF|app-20190625094754-0171|5|4|START|159.90|6.Candidates indexed | 0.00| 0|2 2019-06-25 09:50:36,244|FF|app-20190625094754-0171|5|4| END|162.15|6.Candidates indexed | 2.25| 13819|2 2019-06-25 09:50:36,245|FF|app-20190625094754-0171|5|4|START|162.15|1.Maximal disks found | 0.00| 0|3 2019-06-25 09:50:36,245|MF|app-20190625094754-0171|5|4|START|162.15|A.Points indexed | 0.00| 0|3 2019-06-25 09:50:36,308|MF|app-20190625094754-0171|5|4| END|162.22|A.Points indexed | 0.06| 18548|3 2019-06-25 09:50:36,308|MF|app-20190625094754-0171|5|4|START|162.22|B.Pairs found | 0.00| 0|3 2019-06-25 09:50:36,865|MF|app-20190625094754-0171|5|4| END|162.77|B.Pairs found | 0.56| 41257|3 2019-06-25 09:50:36,865|MF|app-20190625094754-0171|5|4|START|162.77|C.Centers found | 0.00| 0|3 2019-06-25 09:50:37,506|MF|app-20190625094754-0171|5|4| END|163.41|C.Centers found | 0.64| 82514|3 2019-06-25 09:50:37,506|MF|app-20190625094754-0171|5|4|START|163.41|D.Disks found | 0.00| 0|3 2019-06-25 09:50:40,812|MF|app-20190625094754-0171|5|4| END|166.72|D.Disks found | 3.31| 37087|3 2019-06-25 09:50:40,813|MF|app-20190625094754-0171|5|4|START|166.72|E.Disks partitioned | 0.00| 0|3 2019-06-25 09:50:41,995|MF|app-20190625094754-0171|5|4| END|167.90|E.Disks partitioned | 1.18| 54196|3 2019-06-25 09:50:41,995|MF|app-20190625094754-0171|5|4|START|167.90|F.Maximal disks found | 0.00| 0|3 2019-06-25 09:50:41,996|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 09:50:41,996|Cell area: 1055533.7681000116 2019-06-25 09:51:15,123|MF|app-20190625094754-0171|5|4| END|201.03|F.Maximal disks found | 33.13| 10503|3 2019-06-25 09:51:15,123|MAXIMALS|app-20190625094754-0171|4|5|110.0|3|450|38.878|10503 2019-06-25 09:51:15,614|FF|app-20190625094754-0171|5|4| END|201.52|1.Maximal disks found | 39.37| 10503|3 2019-06-25 09:51:15,615|FF|app-20190625094754-0171|5|4|START|201.52|2.Join done | 0.00| 0|3 2019-06-25 09:51:23,445|FF|app-20190625094754-0171|5|4| END|209.35|2.Join done | 7.83| 45190|3 2019-06-25 09:51:23,445|FF|app-20190625094754-0171|5|4|START|209.35|3.Flocks to report | 0.00| 0|3 2019-06-25 09:51:24,861|FF|app-20190625094754-0171|5|4| END|210.77|3.Flocks to report | 1.42| 38589|3 2019-06-25 09:51:24,861|FF|app-20190625094754-0171|5|4|START|210.77|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 09:51:24,904|FF|app-20190625094754-0171|5|4|START|210.81|4a.Making expansions | 0.00| 0|3 2019-06-25 09:51:25,596|FF|app-20190625094754-0171|5|4| END|211.50|4a.Making expansions | 0.69| 47828|3 2019-06-25 09:51:25,596|FF|app-20190625094754-0171|5|4|START|211.50|4b.Finding maximals | 0.00| 0|3 2019-06-25 09:52:27,390|FF|app-20190625094754-0171|5|4| END|273.30|4b.Finding maximals | 61.79| 6669|3 2019-06-25 09:52:27,601|FF|app-20190625094754-0171|5|4| END|273.51|4.Flocks prunned by expansion | 62.74| 6669|3 2019-06-25 09:52:27,601|FF|app-20190625094754-0171|5|4|START|273.51|5.Flocks reported | 0.00| 0|3 2019-06-25 09:52:27,899|FF|app-20190625094754-0171|5|4| END|273.81|5.Flocks reported | 0.30| 6669|3 2019-06-25 09:52:27,899|FF|app-20190625094754-0171|5|4|START|273.81|6.Candidates indexed | 0.00| 0|3 2019-06-25 09:52:30,214|FF|app-20190625094754-0171|5|4| END|276.12|6.Candidates indexed | 2.32| 13927|3 2019-06-25 09:52:30,746|Number of flocks: 13270 2019-06-25 09:52:31,071|PFLOCK|app-20190625094754-0171|4|5|110.0|3|3|270.77|13270 2019-06-25 09:52:31,395|FF|app-20190625094754-0171|5|4| END|277.30|Flock Finder run |271.42| 13270|3 2019-06-25 09:52:31,395|FF|app-20190625094754-0171|5|4|START|277.30|Session closed | 0.00| 0|3 2019-06-25 09:52:38,192|FF|app-20190625094754-0171|5|4| END|284.10|Session closed | 6.80| 0|3