spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B4_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_grid-60x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 12 --fftimestamp 4 --portui 4040 --info 2019-06-25 18:21:54,528|FF|app-00000000000000-0000|12|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 18:21:55,627|FF|app-20190625182155-0191|12|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 18:21:55,627|FF|app-20190625182155-0191|12|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 18:21:59,859|FF|app-20190625182155-0191|12|4| END| 5.32|Data read | 4.23|441504|-1 2019-06-25 18:21:59,859|FF|app-20190625182155-0191|12|4|START| 5.32|KDBTree partitioner | 0.00| 0|-1 2019-06-25 18:22:00,101|FF|app-20190625182155-0191|12|4| END| 5.56|KDBTree partitioner | 0.24| 1088|-1 2019-06-25 18:22:00,101|FF|app-20190625182155-0191|12|4|START| 5.56|MF partitioner | 0.00| 0|-1 2019-06-25 18:22:00,118|FF|app-20190625182155-0191|12|4| END| 5.57|MF partitioner | 0.02| 1800|-1 2019-06-25 18:22:00,119|FF|app-20190625182155-0191|12|4|START| 5.58|Pointset done | 0.00| 0|-1 2019-06-25 18:22:01,129|FF|app-20190625182155-0191|12|4| END| 6.59|Pointset done | 1.01| 4|-1 2019-06-25 18:22:01,129|FF|app-20190625182155-0191|12|4|START| 6.59|Flock Finder run | 0.00| 0|-1 2019-06-25 18:22:01,145|FF|app-20190625182155-0191|12|4|START| 6.60|1.Maximal disks found | 0.00| 0|0 2019-06-25 18:22:01,147|MF|app-20190625182155-0191|12|4|START| 6.60|A.Points indexed | 0.00| 0|0 2019-06-25 18:22:01,355|MF|app-20190625182155-0191|12|4| END| 6.81|A.Points indexed | 0.21| 72372|0 2019-06-25 18:22:01,356|MF|app-20190625182155-0191|12|4|START| 6.81|B.Pairs found | 0.00| 0|0 2019-06-25 18:22:03,176|MF|app-20190625182155-0191|12|4| END| 8.63|B.Pairs found | 1.82|135828|0 2019-06-25 18:22:03,176|MF|app-20190625182155-0191|12|4|START| 8.63|C.Centers found | 0.00| 0|0 2019-06-25 18:22:04,422|MF|app-20190625182155-0191|12|4| END| 9.88|C.Centers found | 1.25|271656|0 2019-06-25 18:22:04,422|MF|app-20190625182155-0191|12|4|START| 9.88|D.Disks found | 0.00| 0|0 2019-06-25 18:22:08,932|MF|app-20190625182155-0191|12|4| END| 14.39|D.Disks found | 4.51|114664|0 2019-06-25 18:22:08,932|MF|app-20190625182155-0191|12|4|START| 14.39|E.Disks partitioned | 0.00| 0|0 2019-06-25 18:22:10,499|MF|app-20190625182155-0191|12|4| END| 15.96|E.Disks partitioned | 1.57|162379|0 2019-06-25 18:22:10,499|MF|app-20190625182155-0191|12|4|START| 15.96|F.Maximal disks found | 0.00| 0|0 2019-06-25 18:22:10,501|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:22:10,501|Cell area: 1055533.7681000116 2019-06-25 18:22:21,189|MF|app-20190625182155-0191|12|4| END| 26.65|F.Maximal disks found | 10.69| 33494|0 2019-06-25 18:22:21,190|MAXIMALS|app-20190625182155-0191|4|12|100.0|3|1800|20.043|33494 2019-06-25 18:22:22,601|FF|app-20190625182155-0191|12|4| END| 28.06|1.Maximal disks found | 21.46| 33494|0 2019-06-25 18:22:22,601|FF|app-20190625182155-0191|12|4|START| 28.06|1.Maximal disks found | 0.00| 0|1 2019-06-25 18:22:22,601|MF|app-20190625182155-0191|12|4|START| 28.06|A.Points indexed | 0.00| 0|1 2019-06-25 18:22:22,712|MF|app-20190625182155-0191|12|4| END| 28.17|A.Points indexed | 0.11| 72980|1 2019-06-25 18:22:22,713|MF|app-20190625182155-0191|12|4|START| 28.17|B.Pairs found | 0.00| 0|1 2019-06-25 18:22:23,601|MF|app-20190625182155-0191|12|4| END| 29.06|B.Pairs found | 0.89|137848|1 2019-06-25 18:22:23,601|MF|app-20190625182155-0191|12|4|START| 29.06|C.Centers found | 0.00| 0|1 2019-06-25 18:22:24,383|MF|app-20190625182155-0191|12|4| END| 29.84|C.Centers found | 0.78|275696|1 2019-06-25 18:22:24,383|MF|app-20190625182155-0191|12|4|START| 29.84|D.Disks found | 0.00| 0|1 2019-06-25 18:22:27,760|MF|app-20190625182155-0191|12|4| END| 33.22|D.Disks found | 3.38|116464|1 2019-06-25 18:22:27,761|MF|app-20190625182155-0191|12|4|START| 33.22|E.Disks partitioned | 0.00| 0|1 2019-06-25 18:22:28,895|MF|app-20190625182155-0191|12|4| END| 34.35|E.Disks partitioned | 1.14|164834|1 2019-06-25 18:22:28,895|MF|app-20190625182155-0191|12|4|START| 34.35|F.Maximal disks found | 0.00| 0|1 2019-06-25 18:22:28,896|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:22:28,896|Cell area: 1055533.7681000116 2019-06-25 18:22:39,557|MF|app-20190625182155-0191|12|4| END| 45.01|F.Maximal disks found | 10.66| 34190|1 2019-06-25 18:22:39,557|MAXIMALS|app-20190625182155-0191|4|12|100.0|3|1800|16.956|34190 2019-06-25 18:22:40,923|FF|app-20190625182155-0191|12|4| END| 46.38|1.Maximal disks found | 18.32| 34190|1 2019-06-25 18:22:40,923|FF|app-20190625182155-0191|12|4|START| 46.38|2.Join done | 0.00| 0|1 2019-06-25 18:22:44,538|FF|app-20190625182155-0191|12|4| END| 49.99|2.Join done | 3.62| 68607|1 2019-06-25 18:22:44,538|FF|app-20190625182155-0191|12|4|START| 49.99|3.Flocks to report | 0.00| 0|1 2019-06-25 18:22:45,075|FF|app-20190625182155-0191|12|4| END| 50.53|3.Flocks to report | 0.54| 0|1 2019-06-25 18:22:45,075|FF|app-20190625182155-0191|12|4|START| 50.53|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 18:22:45,137|FF|app-20190625182155-0191|12|4| END| 50.59|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 18:22:45,137|FF|app-20190625182155-0191|12|4|START| 50.59|5.Flocks reported | 0.00| 0|1 2019-06-25 18:22:45,143|FF|app-20190625182155-0191|12|4| END| 50.60|5.Flocks reported | 0.01| 0|1 2019-06-25 18:22:45,143|FF|app-20190625182155-0191|12|4|START| 50.60|6.Candidates indexed | 0.00| 0|1 2019-06-25 18:22:47,081|FF|app-20190625182155-0191|12|4| END| 52.54|6.Candidates indexed | 1.94| 70591|1 2019-06-25 18:22:47,082|FF|app-20190625182155-0191|12|4|START| 52.54|1.Maximal disks found | 0.00| 0|2 2019-06-25 18:22:47,082|MF|app-20190625182155-0191|12|4|START| 52.54|A.Points indexed | 0.00| 0|2 2019-06-25 18:22:47,190|MF|app-20190625182155-0191|12|4| END| 52.65|A.Points indexed | 0.11| 73576|2 2019-06-25 18:22:47,190|MF|app-20190625182155-0191|12|4|START| 52.65|B.Pairs found | 0.00| 0|2 2019-06-25 18:22:47,994|MF|app-20190625182155-0191|12|4| END| 53.45|B.Pairs found | 0.80|139672|2 2019-06-25 18:22:47,995|MF|app-20190625182155-0191|12|4|START| 53.45|C.Centers found | 0.00| 0|2 2019-06-25 18:22:48,804|MF|app-20190625182155-0191|12|4| END| 54.26|C.Centers found | 0.81|279344|2 2019-06-25 18:22:48,804|MF|app-20190625182155-0191|12|4|START| 54.26|D.Disks found | 0.00| 0|2 2019-06-25 18:22:52,075|MF|app-20190625182155-0191|12|4| END| 57.53|D.Disks found | 3.27|118196|2 2019-06-25 18:22:52,075|MF|app-20190625182155-0191|12|4|START| 57.53|E.Disks partitioned | 0.00| 0|2 2019-06-25 18:22:53,192|MF|app-20190625182155-0191|12|4| END| 58.65|E.Disks partitioned | 1.12|167618|2 2019-06-25 18:22:53,193|MF|app-20190625182155-0191|12|4|START| 58.65|F.Maximal disks found | 0.00| 0|2 2019-06-25 18:22:53,194|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:22:53,194|Cell area: 1055533.7681000116 2019-06-25 18:23:04,267|MF|app-20190625182155-0191|12|4| END| 69.72|F.Maximal disks found | 11.07| 34747|2 2019-06-25 18:23:04,267|MAXIMALS|app-20190625182155-0191|4|12|100.0|3|1800|17.185|34747 2019-06-25 18:23:05,642|FF|app-20190625182155-0191|12|4| END| 71.10|1.Maximal disks found | 18.56| 34747|2 2019-06-25 18:23:05,642|FF|app-20190625182155-0191|12|4|START| 71.10|2.Join done | 0.00| 0|2 2019-06-25 18:23:12,276|FF|app-20190625182155-0191|12|4| END| 77.73|2.Join done | 6.63|130930|2 2019-06-25 18:23:12,276|FF|app-20190625182155-0191|12|4|START| 77.73|3.Flocks to report | 0.00| 0|2 2019-06-25 18:23:13,070|FF|app-20190625182155-0191|12|4| END| 78.53|3.Flocks to report | 0.79|111727|2 2019-06-25 18:23:13,070|FF|app-20190625182155-0191|12|4|START| 78.53|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 18:23:13,131|FF|app-20190625182155-0191|12|4|START| 78.59|4a.Making expansions | 0.00| 0|2 2019-06-25 18:23:14,166|FF|app-20190625182155-0191|12|4| END| 79.62|4a.Making expansions | 1.04|138952|2 2019-06-25 18:23:14,167|FF|app-20190625182155-0191|12|4|START| 79.62|4b.Finding maximals | 0.00| 0|2 2019-06-25 18:23:29,544|FF|app-20190625182155-0191|12|4| END| 95.00|4b.Finding maximals | 15.38| 22788|2 2019-06-25 18:23:30,140|FF|app-20190625182155-0191|12|4| END| 95.60|4.Flocks prunned by expansion | 17.07| 22788|2 2019-06-25 18:23:30,140|FF|app-20190625182155-0191|12|4|START| 95.60|5.Flocks reported | 0.00| 0|2 2019-06-25 18:23:30,930|FF|app-20190625182155-0191|12|4| END| 96.39|5.Flocks reported | 0.79| 22788|2 2019-06-25 18:23:30,930|FF|app-20190625182155-0191|12|4|START| 96.39|6.Candidates indexed | 0.00| 0|2 2019-06-25 18:23:33,143|FF|app-20190625182155-0191|12|4| END| 98.60|6.Candidates indexed | 2.21| 44305|2 2019-06-25 18:23:33,143|FF|app-20190625182155-0191|12|4|START| 98.60|1.Maximal disks found | 0.00| 0|3 2019-06-25 18:23:33,143|MF|app-20190625182155-0191|12|4|START| 98.60|A.Points indexed | 0.00| 0|3 2019-06-25 18:23:33,274|MF|app-20190625182155-0191|12|4| END| 98.73|A.Points indexed | 0.13| 74192|3 2019-06-25 18:23:33,275|MF|app-20190625182155-0191|12|4|START| 98.73|B.Pairs found | 0.00| 0|3 2019-06-25 18:23:34,049|MF|app-20190625182155-0191|12|4| END| 99.51|B.Pairs found | 0.77|142060|3 2019-06-25 18:23:34,049|MF|app-20190625182155-0191|12|4|START| 99.51|C.Centers found | 0.00| 0|3 2019-06-25 18:23:34,801|MF|app-20190625182155-0191|12|4| END|100.26|C.Centers found | 0.75|284120|3 2019-06-25 18:23:34,801|MF|app-20190625182155-0191|12|4|START|100.26|D.Disks found | 0.00| 0|3 2019-06-25 18:23:38,045|MF|app-20190625182155-0191|12|4| END|103.50|D.Disks found | 3.24|120568|3 2019-06-25 18:23:38,046|MF|app-20190625182155-0191|12|4|START|103.50|E.Disks partitioned | 0.00| 0|3 2019-06-25 18:23:39,202|MF|app-20190625182155-0191|12|4| END|104.66|E.Disks partitioned | 1.16|171019|3 2019-06-25 18:23:39,202|MF|app-20190625182155-0191|12|4|START|104.66|F.Maximal disks found | 0.00| 0|3 2019-06-25 18:23:39,203|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:23:39,203|Cell area: 1055533.7681000116 2019-06-25 18:23:51,264|MF|app-20190625182155-0191|12|4| END|116.72|F.Maximal disks found | 12.06| 35397|3 2019-06-25 18:23:51,264|MAXIMALS|app-20190625182155-0191|4|12|100.0|3|1800|18.121|35397 2019-06-25 18:23:52,625|FF|app-20190625182155-0191|12|4| END|118.08|1.Maximal disks found | 19.48| 35397|3 2019-06-25 18:23:52,625|FF|app-20190625182155-0191|12|4|START|118.08|2.Join done | 0.00| 0|3 2019-06-25 18:23:57,151|FF|app-20190625182155-0191|12|4| END|122.61|2.Join done | 4.53|120798|3 2019-06-25 18:23:57,151|FF|app-20190625182155-0191|12|4|START|122.61|3.Flocks to report | 0.00| 0|3 2019-06-25 18:23:57,907|FF|app-20190625182155-0191|12|4| END|123.36|3.Flocks to report | 0.76|101394|3 2019-06-25 18:23:57,907|FF|app-20190625182155-0191|12|4|START|123.36|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 18:23:57,981|FF|app-20190625182155-0191|12|4|START|123.44|4a.Making expansions | 0.00| 0|3 2019-06-25 18:23:59,100|FF|app-20190625182155-0191|12|4| END|124.56|4a.Making expansions | 1.12|129157|3 2019-06-25 18:23:59,101|FF|app-20190625182155-0191|12|4|START|124.56|4b.Finding maximals | 0.00| 0|3 2019-06-25 18:24:11,326|FF|app-20190625182155-0191|12|4| END|136.78|4b.Finding maximals | 12.23| 23068|3 2019-06-25 18:24:11,973|FF|app-20190625182155-0191|12|4| END|137.43|4.Flocks prunned by expansion | 14.07| 23068|3 2019-06-25 18:24:11,973|FF|app-20190625182155-0191|12|4|START|137.43|5.Flocks reported | 0.00| 0|3 2019-06-25 18:24:12,779|FF|app-20190625182155-0191|12|4| END|138.24|5.Flocks reported | 0.81| 23068|3 2019-06-25 18:24:12,779|FF|app-20190625182155-0191|12|4|START|138.24|6.Candidates indexed | 0.00| 0|3 2019-06-25 18:24:15,064|FF|app-20190625182155-0191|12|4| END|140.52|6.Candidates indexed | 2.28| 44638|3 2019-06-25 18:24:16,862|Number of flocks: 45856 2019-06-25 18:24:18,134|PFLOCK|app-20190625182155-0191|4|12|100.0|3|3|135.73|45856 2019-06-25 18:24:19,397|FF|app-20190625182155-0191|12|4| END|144.85|Flock Finder run |138.27| 45856|3 2019-06-25 18:24:19,398|FF|app-20190625182155-0191|12|4|START|144.85|Session closed | 0.00| 0|3 2019-06-25 18:24:27,126|FF|app-20190625182155-0191|12|4| END|152.58|Session closed | 7.73| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 6 --fftimestamp 4 --portui 4040 --info 2019-06-25 18:24:29,116|FF|app-00000000000000-0000|6|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 18:24:30,193|FF|app-20190625182429-0192|6|4| END| 1.06|Session start | 1.08| 0|-1 2019-06-25 18:24:30,193|FF|app-20190625182429-0192|6|4|START| 1.06|Data read | 0.00| 0|-1 2019-06-25 18:24:34,158|FF|app-20190625182429-0192|6|4| END| 5.03|Data read | 3.97|220752|-1 2019-06-25 18:24:34,158|FF|app-20190625182429-0192|6|4|START| 5.03|KDBTree partitioner | 0.00| 0|-1 2019-06-25 18:24:34,295|FF|app-20190625182429-0192|6|4| END| 5.16|KDBTree partitioner | 0.14| 544|-1 2019-06-25 18:24:34,296|FF|app-20190625182429-0192|6|4|START| 5.16|MF partitioner | 0.00| 0|-1 2019-06-25 18:24:34,319|FF|app-20190625182429-0192|6|4| END| 5.19|MF partitioner | 0.02| 900|-1 2019-06-25 18:24:34,319|FF|app-20190625182429-0192|6|4|START| 5.19|Pointset done | 0.00| 0|-1 2019-06-25 18:24:35,370|FF|app-20190625182429-0192|6|4| END| 6.24|Pointset done | 1.05| 4|-1 2019-06-25 18:24:35,370|FF|app-20190625182429-0192|6|4|START| 6.24|Flock Finder run | 0.00| 0|-1 2019-06-25 18:24:35,387|FF|app-20190625182429-0192|6|4|START| 6.26|1.Maximal disks found | 0.00| 0|0 2019-06-25 18:24:35,389|MF|app-20190625182429-0192|6|4|START| 6.26|A.Points indexed | 0.00| 0|0 2019-06-25 18:24:35,545|MF|app-20190625182429-0192|6|4| END| 6.41|A.Points indexed | 0.16| 36186|0 2019-06-25 18:24:35,545|MF|app-20190625182429-0192|6|4|START| 6.41|B.Pairs found | 0.00| 0|0 2019-06-25 18:24:37,159|MF|app-20190625182429-0192|6|4| END| 8.03|B.Pairs found | 1.61| 67914|0 2019-06-25 18:24:37,160|MF|app-20190625182429-0192|6|4|START| 8.03|C.Centers found | 0.00| 0|0 2019-06-25 18:24:38,122|MF|app-20190625182429-0192|6|4| END| 8.99|C.Centers found | 0.96|135828|0 2019-06-25 18:24:38,122|MF|app-20190625182429-0192|6|4|START| 8.99|D.Disks found | 0.00| 0|0 2019-06-25 18:24:42,599|MF|app-20190625182429-0192|6|4| END| 13.47|D.Disks found | 4.48| 57332|0 2019-06-25 18:24:42,599|MF|app-20190625182429-0192|6|4|START| 13.47|E.Disks partitioned | 0.00| 0|0 2019-06-25 18:24:44,867|MF|app-20190625182429-0192|6|4| END| 15.74|E.Disks partitioned | 2.27| 81114|0 2019-06-25 18:24:44,867|MF|app-20190625182429-0192|6|4|START| 15.74|F.Maximal disks found | 0.00| 0|0 2019-06-25 18:24:44,868|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:24:44,869|Cell area: 1055533.7681000116 2019-06-25 18:24:55,651|MF|app-20190625182429-0192|6|4| END| 26.52|F.Maximal disks found | 10.78| 16742|0 2019-06-25 18:24:55,651|MAXIMALS|app-20190625182429-0192|4|6|100.0|3|900|20.262|16742 2019-06-25 18:24:56,702|FF|app-20190625182429-0192|6|4| END| 27.57|1.Maximal disks found | 21.32| 16742|0 2019-06-25 18:24:56,703|FF|app-20190625182429-0192|6|4|START| 27.57|1.Maximal disks found | 0.00| 0|1 2019-06-25 18:24:56,703|MF|app-20190625182429-0192|6|4|START| 27.57|A.Points indexed | 0.00| 0|1 2019-06-25 18:24:56,792|MF|app-20190625182429-0192|6|4| END| 27.66|A.Points indexed | 0.09| 36490|1 2019-06-25 18:24:56,792|MF|app-20190625182429-0192|6|4|START| 27.66|B.Pairs found | 0.00| 0|1 2019-06-25 18:24:57,681|MF|app-20190625182429-0192|6|4| END| 28.55|B.Pairs found | 0.89| 68924|1 2019-06-25 18:24:57,681|MF|app-20190625182429-0192|6|4|START| 28.55|C.Centers found | 0.00| 0|1 2019-06-25 18:24:58,524|MF|app-20190625182429-0192|6|4| END| 29.39|C.Centers found | 0.84|137848|1 2019-06-25 18:24:58,525|MF|app-20190625182429-0192|6|4|START| 29.39|D.Disks found | 0.00| 0|1 2019-06-25 18:25:03,244|MF|app-20190625182429-0192|6|4| END| 34.11|D.Disks found | 4.72| 58232|1 2019-06-25 18:25:03,244|MF|app-20190625182429-0192|6|4|START| 34.11|E.Disks partitioned | 0.00| 0|1 2019-06-25 18:25:05,315|MF|app-20190625182429-0192|6|4| END| 36.18|E.Disks partitioned | 2.07| 82341|1 2019-06-25 18:25:05,315|MF|app-20190625182429-0192|6|4|START| 36.18|F.Maximal disks found | 0.00| 0|1 2019-06-25 18:25:05,316|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:25:05,316|Cell area: 1055533.7681000116 2019-06-25 18:25:15,372|MF|app-20190625182429-0192|6|4| END| 46.24|F.Maximal disks found | 10.06| 17096|1 2019-06-25 18:25:15,372|MAXIMALS|app-20190625182429-0192|4|6|100.0|3|900|18.669|17096 2019-06-25 18:25:16,325|FF|app-20190625182429-0192|6|4| END| 47.19|1.Maximal disks found | 19.62| 17096|1 2019-06-25 18:25:16,325|FF|app-20190625182429-0192|6|4|START| 47.19|2.Join done | 0.00| 0|1 2019-06-25 18:25:21,091|FF|app-20190625182429-0192|6|4| END| 51.96|2.Join done | 4.77| 34283|1 2019-06-25 18:25:21,091|FF|app-20190625182429-0192|6|4|START| 51.96|3.Flocks to report | 0.00| 0|1 2019-06-25 18:25:21,925|FF|app-20190625182429-0192|6|4| END| 52.79|3.Flocks to report | 0.83| 0|1 2019-06-25 18:25:21,925|FF|app-20190625182429-0192|6|4|START| 52.79|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 18:25:21,968|FF|app-20190625182429-0192|6|4| END| 52.84|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 18:25:21,968|FF|app-20190625182429-0192|6|4|START| 52.84|5.Flocks reported | 0.00| 0|1 2019-06-25 18:25:21,973|FF|app-20190625182429-0192|6|4| END| 52.84|5.Flocks reported | 0.01| 0|1 2019-06-25 18:25:21,973|FF|app-20190625182429-0192|6|4|START| 52.84|6.Candidates indexed | 0.00| 0|1 2019-06-25 18:25:25,673|FF|app-20190625182429-0192|6|4| END| 56.54|6.Candidates indexed | 3.70| 35275|1 2019-06-25 18:25:25,673|FF|app-20190625182429-0192|6|4|START| 56.54|1.Maximal disks found | 0.00| 0|2 2019-06-25 18:25:25,673|MF|app-20190625182429-0192|6|4|START| 56.54|A.Points indexed | 0.00| 0|2 2019-06-25 18:25:25,745|MF|app-20190625182429-0192|6|4| END| 56.61|A.Points indexed | 0.07| 36788|2 2019-06-25 18:25:25,745|MF|app-20190625182429-0192|6|4|START| 56.61|B.Pairs found | 0.00| 0|2 2019-06-25 18:25:26,942|MF|app-20190625182429-0192|6|4| END| 57.81|B.Pairs found | 1.20| 69836|2 2019-06-25 18:25:26,943|MF|app-20190625182429-0192|6|4|START| 57.81|C.Centers found | 0.00| 0|2 2019-06-25 18:25:27,886|MF|app-20190625182429-0192|6|4| END| 58.75|C.Centers found | 0.94|139672|2 2019-06-25 18:25:27,886|MF|app-20190625182429-0192|6|4|START| 58.75|D.Disks found | 0.00| 0|2 2019-06-25 18:25:32,556|MF|app-20190625182429-0192|6|4| END| 63.42|D.Disks found | 4.67| 59098|2 2019-06-25 18:25:32,556|MF|app-20190625182429-0192|6|4|START| 63.42|E.Disks partitioned | 0.00| 0|2 2019-06-25 18:25:34,580|MF|app-20190625182429-0192|6|4| END| 65.45|E.Disks partitioned | 2.02| 83724|2 2019-06-25 18:25:34,580|MF|app-20190625182429-0192|6|4|START| 65.45|F.Maximal disks found | 0.00| 0|2 2019-06-25 18:25:34,580|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:25:34,581|Cell area: 1055533.7681000116 2019-06-25 18:25:44,790|MF|app-20190625182429-0192|6|4| END| 75.66|F.Maximal disks found | 10.21| 17376|2 2019-06-25 18:25:44,790|MAXIMALS|app-20190625182429-0192|4|6|100.0|3|900|19.117|17376 2019-06-25 18:25:45,659|FF|app-20190625182429-0192|6|4| END| 76.53|1.Maximal disks found | 19.99| 17376|2 2019-06-25 18:25:45,659|FF|app-20190625182429-0192|6|4|START| 76.53|2.Join done | 0.00| 0|2 2019-06-25 18:25:56,641|FF|app-20190625182429-0192|6|4| END| 87.51|2.Join done | 10.98| 65352|2 2019-06-25 18:25:56,642|FF|app-20190625182429-0192|6|4|START| 87.51|3.Flocks to report | 0.00| 0|2 2019-06-25 18:25:58,217|FF|app-20190625182429-0192|6|4| END| 89.09|3.Flocks to report | 1.58| 55755|2 2019-06-25 18:25:58,217|FF|app-20190625182429-0192|6|4|START| 89.09|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 18:25:58,260|FF|app-20190625182429-0192|6|4|START| 89.13|4a.Making expansions | 0.00| 0|2 2019-06-25 18:25:59,494|FF|app-20190625182429-0192|6|4| END| 90.36|4a.Making expansions | 1.23| 69305|2 2019-06-25 18:25:59,494|FF|app-20190625182429-0192|6|4|START| 90.36|4b.Finding maximals | 0.00| 0|2 2019-06-25 18:26:14,945|FF|app-20190625182429-0192|6|4| END|105.81|4b.Finding maximals | 15.45| 11394|2 2019-06-25 18:26:15,393|FF|app-20190625182429-0192|6|4| END|106.26|4.Flocks prunned by expansion | 17.18| 11394|2 2019-06-25 18:26:15,394|FF|app-20190625182429-0192|6|4|START|106.26|5.Flocks reported | 0.00| 0|2 2019-06-25 18:26:15,980|FF|app-20190625182429-0192|6|4| END|106.85|5.Flocks reported | 0.59| 11394|2 2019-06-25 18:26:15,981|FF|app-20190625182429-0192|6|4|START|106.85|6.Candidates indexed | 0.00| 0|2 2019-06-25 18:26:18,249|FF|app-20190625182429-0192|6|4| END|109.12|6.Candidates indexed | 2.27| 22156|2 2019-06-25 18:26:18,250|FF|app-20190625182429-0192|6|4|START|109.12|1.Maximal disks found | 0.00| 0|3 2019-06-25 18:26:18,250|MF|app-20190625182429-0192|6|4|START|109.12|A.Points indexed | 0.00| 0|3 2019-06-25 18:26:18,315|MF|app-20190625182429-0192|6|4| END|109.18|A.Points indexed | 0.07| 37096|3 2019-06-25 18:26:18,315|MF|app-20190625182429-0192|6|4|START|109.18|B.Pairs found | 0.00| 0|3 2019-06-25 18:26:19,131|MF|app-20190625182429-0192|6|4| END|110.00|B.Pairs found | 0.82| 71030|3 2019-06-25 18:26:19,131|MF|app-20190625182429-0192|6|4|START|110.00|C.Centers found | 0.00| 0|3 2019-06-25 18:26:19,857|MF|app-20190625182429-0192|6|4| END|110.73|C.Centers found | 0.73|142060|3 2019-06-25 18:26:19,857|MF|app-20190625182429-0192|6|4|START|110.73|D.Disks found | 0.00| 0|3 2019-06-25 18:26:24,018|MF|app-20190625182429-0192|6|4| END|114.89|D.Disks found | 4.16| 60284|3 2019-06-25 18:26:24,018|MF|app-20190625182429-0192|6|4|START|114.89|E.Disks partitioned | 0.00| 0|3 2019-06-25 18:26:26,007|MF|app-20190625182429-0192|6|4| END|116.88|E.Disks partitioned | 1.99| 85409|3 2019-06-25 18:26:26,008|MF|app-20190625182429-0192|6|4|START|116.88|F.Maximal disks found | 0.00| 0|3 2019-06-25 18:26:26,008|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:26:26,008|Cell area: 1055533.7681000116 2019-06-25 18:26:38,320|MF|app-20190625182429-0192|6|4| END|129.19|F.Maximal disks found | 12.31| 17693|3 2019-06-25 18:26:38,320|MAXIMALS|app-20190625182429-0192|4|6|100.0|3|900|20.07|17693 2019-06-25 18:26:39,200|FF|app-20190625182429-0192|6|4| END|130.07|1.Maximal disks found | 20.95| 17693|3 2019-06-25 18:26:39,200|FF|app-20190625182429-0192|6|4|START|130.07|2.Join done | 0.00| 0|3 2019-06-25 18:26:47,302|FF|app-20190625182429-0192|6|4| END|138.17|2.Join done | 8.10| 60349|3 2019-06-25 18:26:47,302|FF|app-20190625182429-0192|6|4|START|138.17|3.Flocks to report | 0.00| 0|3 2019-06-25 18:26:48,807|FF|app-20190625182429-0192|6|4| END|139.68|3.Flocks to report | 1.51| 50613|3 2019-06-25 18:26:48,807|FF|app-20190625182429-0192|6|4|START|139.68|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 18:26:48,854|FF|app-20190625182429-0192|6|4|START|139.72|4a.Making expansions | 0.00| 0|3 2019-06-25 18:26:50,080|FF|app-20190625182429-0192|6|4| END|140.95|4a.Making expansions | 1.23| 64403|3 2019-06-25 18:26:50,080|FF|app-20190625182429-0192|6|4|START|140.95|4b.Finding maximals | 0.00| 0|3 2019-06-25 18:27:01,469|FF|app-20190625182429-0192|6|4| END|152.34|4b.Finding maximals | 11.39| 11534|3 2019-06-25 18:27:01,843|FF|app-20190625182429-0192|6|4| END|152.71|4.Flocks prunned by expansion | 13.04| 11534|3 2019-06-25 18:27:01,844|FF|app-20190625182429-0192|6|4|START|152.71|5.Flocks reported | 0.00| 0|3 2019-06-25 18:27:02,433|FF|app-20190625182429-0192|6|4| END|153.30|5.Flocks reported | 0.59| 11534|3 2019-06-25 18:27:02,433|FF|app-20190625182429-0192|6|4|START|153.30|6.Candidates indexed | 0.00| 0|3 2019-06-25 18:27:04,744|FF|app-20190625182429-0192|6|4| END|155.61|6.Candidates indexed | 2.31| 22352|3 2019-06-25 18:27:06,082|Number of flocks: 22928 2019-06-25 18:27:06,859|PFLOCK|app-20190625182429-0192|4|6|100.0|3|3|150.71|22928 2019-06-25 18:27:07,617|FF|app-20190625182429-0192|6|4| END|158.49|Flock Finder run |152.25| 22928|3 2019-06-25 18:27:07,617|FF|app-20190625182429-0192|6|4|START|158.49|Session closed | 0.00| 0|3 2019-06-25 18:27:14,542|FF|app-20190625182429-0192|6|4| END|165.41|Session closed | 6.93| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 3 --fftimestamp 4 --portui 4040 --info 2019-06-25 18:27:16,494|FF|app-00000000000000-0000|3|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 18:27:17,587|FF|app-20190625182717-0193|3|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 18:27:17,587|FF|app-20190625182717-0193|3|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 18:27:21,246|FF|app-20190625182717-0193|3|4| END| 4.74|Data read | 3.66|110376|-1 2019-06-25 18:27:21,246|FF|app-20190625182717-0193|3|4|START| 4.74|KDBTree partitioner | 0.00| 0|-1 2019-06-25 18:27:21,341|FF|app-20190625182717-0193|3|4| END| 4.83|KDBTree partitioner | 0.10| 272|-1 2019-06-25 18:27:21,342|FF|app-20190625182717-0193|3|4|START| 4.83|MF partitioner | 0.00| 0|-1 2019-06-25 18:27:21,351|FF|app-20190625182717-0193|3|4| END| 4.84|MF partitioner | 0.01| 450|-1 2019-06-25 18:27:21,352|FF|app-20190625182717-0193|3|4|START| 4.84|Pointset done | 0.00| 0|-1 2019-06-25 18:27:22,187|FF|app-20190625182717-0193|3|4| END| 5.68|Pointset done | 0.84| 4|-1 2019-06-25 18:27:22,187|FF|app-20190625182717-0193|3|4|START| 5.68|Flock Finder run | 0.00| 0|-1 2019-06-25 18:27:22,206|FF|app-20190625182717-0193|3|4|START| 5.70|1.Maximal disks found | 0.00| 0|0 2019-06-25 18:27:22,208|MF|app-20190625182717-0193|3|4|START| 5.70|A.Points indexed | 0.00| 0|0 2019-06-25 18:27:22,351|MF|app-20190625182717-0193|3|4| END| 5.84|A.Points indexed | 0.14| 18093|0 2019-06-25 18:27:22,351|MF|app-20190625182717-0193|3|4|START| 5.84|B.Pairs found | 0.00| 0|0 2019-06-25 18:27:23,785|MF|app-20190625182717-0193|3|4| END| 7.27|B.Pairs found | 1.43| 33957|0 2019-06-25 18:27:23,785|MF|app-20190625182717-0193|3|4|START| 7.27|C.Centers found | 0.00| 0|0 2019-06-25 18:27:24,638|MF|app-20190625182717-0193|3|4| END| 8.13|C.Centers found | 0.85| 67914|0 2019-06-25 18:27:24,638|MF|app-20190625182717-0193|3|4|START| 8.13|D.Disks found | 0.00| 0|0 2019-06-25 18:27:27,753|MF|app-20190625182717-0193|3|4| END| 11.24|D.Disks found | 3.12| 28666|0 2019-06-25 18:27:27,754|MF|app-20190625182717-0193|3|4|START| 11.24|E.Disks partitioned | 0.00| 0|0 2019-06-25 18:27:28,765|MF|app-20190625182717-0193|3|4| END| 12.25|E.Disks partitioned | 1.01| 40550|0 2019-06-25 18:27:28,765|MF|app-20190625182717-0193|3|4|START| 12.25|F.Maximal disks found | 0.00| 0|0 2019-06-25 18:27:28,766|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:27:28,766|Cell area: 1055533.7681000116 2019-06-25 18:27:40,064|MF|app-20190625182717-0193|3|4| END| 23.55|F.Maximal disks found | 11.30| 8371|0 2019-06-25 18:27:40,064|MAXIMALS|app-20190625182717-0193|4|3|100.0|3|450|17.856|8371 2019-06-25 18:27:40,582|FF|app-20190625182717-0193|3|4| END| 24.07|1.Maximal disks found | 18.38| 8371|0 2019-06-25 18:27:40,582|FF|app-20190625182717-0193|3|4|START| 24.07|1.Maximal disks found | 0.00| 0|1 2019-06-25 18:27:40,583|MF|app-20190625182717-0193|3|4|START| 24.07|A.Points indexed | 0.00| 0|1 2019-06-25 18:27:40,660|MF|app-20190625182717-0193|3|4| END| 24.15|A.Points indexed | 0.08| 18245|1 2019-06-25 18:27:40,660|MF|app-20190625182717-0193|3|4|START| 24.15|B.Pairs found | 0.00| 0|1 2019-06-25 18:27:41,165|MF|app-20190625182717-0193|3|4| END| 24.65|B.Pairs found | 0.51| 34462|1 2019-06-25 18:27:41,165|MF|app-20190625182717-0193|3|4|START| 24.65|C.Centers found | 0.00| 0|1 2019-06-25 18:27:41,687|MF|app-20190625182717-0193|3|4| END| 25.18|C.Centers found | 0.52| 68924|1 2019-06-25 18:27:41,687|MF|app-20190625182717-0193|3|4|START| 25.18|D.Disks found | 0.00| 0|1 2019-06-25 18:27:44,010|MF|app-20190625182717-0193|3|4| END| 27.50|D.Disks found | 2.32| 29116|1 2019-06-25 18:27:44,010|MF|app-20190625182717-0193|3|4|START| 27.50|E.Disks partitioned | 0.00| 0|1 2019-06-25 18:27:44,849|MF|app-20190625182717-0193|3|4| END| 28.34|E.Disks partitioned | 0.84| 41162|1 2019-06-25 18:27:44,849|MF|app-20190625182717-0193|3|4|START| 28.34|F.Maximal disks found | 0.00| 0|1 2019-06-25 18:27:44,850|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:27:44,850|Cell area: 1055533.7681000116 2019-06-25 18:27:55,175|MF|app-20190625182717-0193|3|4| END| 38.66|F.Maximal disks found | 10.33| 8547|1 2019-06-25 18:27:55,175|MAXIMALS|app-20190625182717-0193|4|3|100.0|3|450|14.593|8547 2019-06-25 18:27:55,613|FF|app-20190625182717-0193|3|4| END| 39.10|1.Maximal disks found | 15.03| 8547|1 2019-06-25 18:27:55,613|FF|app-20190625182717-0193|3|4|START| 39.10|2.Join done | 0.00| 0|1 2019-06-25 18:27:57,644|FF|app-20190625182717-0193|3|4| END| 41.13|2.Join done | 2.03| 17137|1 2019-06-25 18:27:57,644|FF|app-20190625182717-0193|3|4|START| 41.13|3.Flocks to report | 0.00| 0|1 2019-06-25 18:27:58,015|FF|app-20190625182717-0193|3|4| END| 41.50|3.Flocks to report | 0.37| 0|1 2019-06-25 18:27:58,015|FF|app-20190625182717-0193|3|4|START| 41.50|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 18:27:58,046|FF|app-20190625182717-0193|3|4| END| 41.54|4.Flocks prunned by expansion | 0.03| 0|1 2019-06-25 18:27:58,046|FF|app-20190625182717-0193|3|4|START| 41.54|5.Flocks reported | 0.00| 0|1 2019-06-25 18:27:58,051|FF|app-20190625182717-0193|3|4| END| 41.54|5.Flocks reported | 0.01| 0|1 2019-06-25 18:27:58,051|FF|app-20190625182717-0193|3|4|START| 41.54|6.Candidates indexed | 0.00| 0|1 2019-06-25 18:27:59,478|FF|app-20190625182717-0193|3|4| END| 42.97|6.Candidates indexed | 1.43| 17633|1 2019-06-25 18:27:59,479|FF|app-20190625182717-0193|3|4|START| 42.97|1.Maximal disks found | 0.00| 0|2 2019-06-25 18:27:59,479|MF|app-20190625182717-0193|3|4|START| 42.97|A.Points indexed | 0.00| 0|2 2019-06-25 18:27:59,530|MF|app-20190625182717-0193|3|4| END| 43.02|A.Points indexed | 0.05| 18394|2 2019-06-25 18:27:59,531|MF|app-20190625182717-0193|3|4|START| 43.02|B.Pairs found | 0.00| 0|2 2019-06-25 18:27:59,962|MF|app-20190625182717-0193|3|4| END| 43.45|B.Pairs found | 0.43| 34918|2 2019-06-25 18:27:59,963|MF|app-20190625182717-0193|3|4|START| 43.45|C.Centers found | 0.00| 0|2 2019-06-25 18:28:00,487|MF|app-20190625182717-0193|3|4| END| 43.98|C.Centers found | 0.52| 69836|2 2019-06-25 18:28:00,487|MF|app-20190625182717-0193|3|4|START| 43.98|D.Disks found | 0.00| 0|2 2019-06-25 18:28:02,695|MF|app-20190625182717-0193|3|4| END| 46.18|D.Disks found | 2.21| 29549|2 2019-06-25 18:28:02,695|MF|app-20190625182717-0193|3|4|START| 46.18|E.Disks partitioned | 0.00| 0|2 2019-06-25 18:28:03,404|MF|app-20190625182717-0193|3|4| END| 46.89|E.Disks partitioned | 0.71| 41840|2 2019-06-25 18:28:03,404|MF|app-20190625182717-0193|3|4|START| 46.89|F.Maximal disks found | 0.00| 0|2 2019-06-25 18:28:03,404|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:28:03,405|Cell area: 1055533.7681000116 2019-06-25 18:28:14,060|MF|app-20190625182717-0193|3|4| END| 57.55|F.Maximal disks found | 10.66| 8685|2 2019-06-25 18:28:14,060|MAXIMALS|app-20190625182717-0193|4|3|100.0|3|450|14.581|8685 2019-06-25 18:28:14,477|FF|app-20190625182717-0193|3|4| END| 57.97|1.Maximal disks found | 15.00| 8685|2 2019-06-25 18:28:14,478|FF|app-20190625182717-0193|3|4|START| 57.97|2.Join done | 0.00| 0|2 2019-06-25 18:28:23,719|FF|app-20190625182717-0193|3|4| END| 67.21|2.Join done | 9.24| 32677|2 2019-06-25 18:28:23,719|FF|app-20190625182717-0193|3|4|START| 67.21|3.Flocks to report | 0.00| 0|2 2019-06-25 18:28:25,122|FF|app-20190625182717-0193|3|4| END| 68.61|3.Flocks to report | 1.40| 27878|2 2019-06-25 18:28:25,122|FF|app-20190625182717-0193|3|4|START| 68.61|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 18:28:25,161|FF|app-20190625182717-0193|3|4|START| 68.65|4a.Making expansions | 0.00| 0|2 2019-06-25 18:28:26,195|FF|app-20190625182717-0193|3|4| END| 69.68|4a.Making expansions | 1.03| 34771|2 2019-06-25 18:28:26,195|FF|app-20190625182717-0193|3|4|START| 69.68|4b.Finding maximals | 0.00| 0|2 2019-06-25 18:28:40,279|FF|app-20190625182717-0193|3|4| END| 83.77|4b.Finding maximals | 14.08| 5697|2 2019-06-25 18:28:40,597|FF|app-20190625182717-0193|3|4| END| 84.09|4.Flocks prunned by expansion | 15.48| 5697|2 2019-06-25 18:28:40,597|FF|app-20190625182717-0193|3|4|START| 84.09|5.Flocks reported | 0.00| 0|2 2019-06-25 18:28:41,083|FF|app-20190625182717-0193|3|4| END| 84.57|5.Flocks reported | 0.49| 5697|2 2019-06-25 18:28:41,083|FF|app-20190625182717-0193|3|4|START| 84.57|6.Candidates indexed | 0.00| 0|2 2019-06-25 18:28:43,688|FF|app-20190625182717-0193|3|4| END| 87.18|6.Candidates indexed | 2.61| 11079|2 2019-06-25 18:28:43,689|FF|app-20190625182717-0193|3|4|START| 87.18|1.Maximal disks found | 0.00| 0|3 2019-06-25 18:28:43,689|MF|app-20190625182717-0193|3|4|START| 87.18|A.Points indexed | 0.00| 0|3 2019-06-25 18:28:43,741|MF|app-20190625182717-0193|3|4| END| 87.23|A.Points indexed | 0.05| 18548|3 2019-06-25 18:28:43,741|MF|app-20190625182717-0193|3|4|START| 87.23|B.Pairs found | 0.00| 0|3 2019-06-25 18:28:44,632|MF|app-20190625182717-0193|3|4| END| 88.12|B.Pairs found | 0.89| 35515|3 2019-06-25 18:28:44,632|MF|app-20190625182717-0193|3|4|START| 88.12|C.Centers found | 0.00| 0|3 2019-06-25 18:28:45,335|MF|app-20190625182717-0193|3|4| END| 88.82|C.Centers found | 0.70| 71030|3 2019-06-25 18:28:45,335|MF|app-20190625182717-0193|3|4|START| 88.82|D.Disks found | 0.00| 0|3 2019-06-25 18:28:50,084|MF|app-20190625182717-0193|3|4| END| 93.57|D.Disks found | 4.75| 30142|3 2019-06-25 18:28:50,084|MF|app-20190625182717-0193|3|4|START| 93.57|E.Disks partitioned | 0.00| 0|3 2019-06-25 18:28:51,699|MF|app-20190625182717-0193|3|4| END| 95.19|E.Disks partitioned | 1.62| 42665|3 2019-06-25 18:28:51,699|MF|app-20190625182717-0193|3|4|START| 95.19|F.Maximal disks found | 0.00| 0|3 2019-06-25 18:28:51,700|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:28:51,700|Cell area: 1055533.7681000116 2019-06-25 18:29:03,454|MF|app-20190625182717-0193|3|4| END|106.94|F.Maximal disks found | 11.76| 8846|3 2019-06-25 18:29:03,454|MAXIMALS|app-20190625182717-0193|4|3|100.0|3|450|19.765|8846 2019-06-25 18:29:04,141|FF|app-20190625182717-0193|3|4| END|107.63|1.Maximal disks found | 20.45| 8846|3 2019-06-25 18:29:04,141|FF|app-20190625182717-0193|3|4|START|107.63|2.Join done | 0.00| 0|3 2019-06-25 18:29:10,769|FF|app-20190625182717-0193|3|4| END|114.26|2.Join done | 6.63| 30190|3 2019-06-25 18:29:10,770|FF|app-20190625182717-0193|3|4|START|114.26|3.Flocks to report | 0.00| 0|3 2019-06-25 18:29:12,163|FF|app-20190625182717-0193|3|4| END|115.65|3.Flocks to report | 1.39| 25328|3 2019-06-25 18:29:12,163|FF|app-20190625182717-0193|3|4|START|115.65|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 18:29:12,205|FF|app-20190625182717-0193|3|4|START|115.69|4a.Making expansions | 0.00| 0|3 2019-06-25 18:29:13,164|FF|app-20190625182717-0193|3|4| END|116.65|4a.Making expansions | 0.96| 32168|3 2019-06-25 18:29:13,164|FF|app-20190625182717-0193|3|4|START|116.65|4b.Finding maximals | 0.00| 0|3 2019-06-25 18:29:22,376|FF|app-20190625182717-0193|3|4| END|125.87|4b.Finding maximals | 9.21| 5767|3 2019-06-25 18:29:22,669|FF|app-20190625182717-0193|3|4| END|126.16|4.Flocks prunned by expansion | 10.51| 5767|3 2019-06-25 18:29:22,669|FF|app-20190625182717-0193|3|4|START|126.16|5.Flocks reported | 0.00| 0|3 2019-06-25 18:29:23,135|FF|app-20190625182717-0193|3|4| END|126.62|5.Flocks reported | 0.47| 5767|3 2019-06-25 18:29:23,135|FF|app-20190625182717-0193|3|4|START|126.62|6.Candidates indexed | 0.00| 0|3 2019-06-25 18:29:25,910|FF|app-20190625182717-0193|3|4| END|129.40|6.Candidates indexed | 2.78| 11171|3 2019-06-25 18:29:26,641|Number of flocks: 11464 2019-06-25 18:29:27,013|PFLOCK|app-20190625182717-0193|4|3|100.0|3|3|124.45|11464 2019-06-25 18:29:27,379|FF|app-20190625182717-0193|3|4| END|130.87|Flock Finder run |125.19| 11464|3 2019-06-25 18:29:27,379|FF|app-20190625182717-0193|3|4|START|130.87|Session closed | 0.00| 0|3 2019-06-25 18:29:34,358|FF|app-20190625182717-0193|3|4| END|137.85|Session closed | 6.98| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B4_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_grid-60x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 12 --fftimestamp 4 --portui 4040 --info 2019-06-25 18:29:36,338|FF|app-00000000000000-0000|12|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 18:29:37,417|FF|app-20190625182937-0194|12|4| END| 1.06|Session start | 1.08| 0|-1 2019-06-25 18:29:37,418|FF|app-20190625182937-0194|12|4|START| 1.06|Data read | 0.00| 0|-1 2019-06-25 18:29:41,564|FF|app-20190625182937-0194|12|4| END| 5.21|Data read | 4.15|441504|-1 2019-06-25 18:29:41,564|FF|app-20190625182937-0194|12|4|START| 5.21|KDBTree partitioner | 0.00| 0|-1 2019-06-25 18:29:41,745|FF|app-20190625182937-0194|12|4| END| 5.39|KDBTree partitioner | 0.18| 1088|-1 2019-06-25 18:29:41,745|FF|app-20190625182937-0194|12|4|START| 5.39|MF partitioner | 0.00| 0|-1 2019-06-25 18:29:41,778|FF|app-20190625182937-0194|12|4| END| 5.42|MF partitioner | 0.03| 1800|-1 2019-06-25 18:29:41,778|FF|app-20190625182937-0194|12|4|START| 5.42|Pointset done | 0.00| 0|-1 2019-06-25 18:29:42,918|FF|app-20190625182937-0194|12|4| END| 6.56|Pointset done | 1.14| 4|-1 2019-06-25 18:29:42,918|FF|app-20190625182937-0194|12|4|START| 6.56|Flock Finder run | 0.00| 0|-1 2019-06-25 18:29:42,940|FF|app-20190625182937-0194|12|4|START| 6.59|1.Maximal disks found | 0.00| 0|0 2019-06-25 18:29:42,942|MF|app-20190625182937-0194|12|4|START| 6.59|A.Points indexed | 0.00| 0|0 2019-06-25 18:29:43,151|MF|app-20190625182937-0194|12|4| END| 6.80|A.Points indexed | 0.21| 72372|0 2019-06-25 18:29:43,151|MF|app-20190625182937-0194|12|4|START| 6.80|B.Pairs found | 0.00| 0|0 2019-06-25 18:29:44,951|MF|app-20190625182937-0194|12|4| END| 8.60|B.Pairs found | 1.80|157616|0 2019-06-25 18:29:44,951|MF|app-20190625182937-0194|12|4|START| 8.60|C.Centers found | 0.00| 0|0 2019-06-25 18:29:46,163|MF|app-20190625182937-0194|12|4| END| 9.81|C.Centers found | 1.21|315232|0 2019-06-25 18:29:46,163|MF|app-20190625182937-0194|12|4|START| 9.81|D.Disks found | 0.00| 0|0 2019-06-25 18:29:50,967|MF|app-20190625182937-0194|12|4| END| 14.61|D.Disks found | 4.80|140916|0 2019-06-25 18:29:50,968|MF|app-20190625182937-0194|12|4|START| 14.61|E.Disks partitioned | 0.00| 0|0 2019-06-25 18:29:52,687|MF|app-20190625182937-0194|12|4| END| 16.33|E.Disks partitioned | 1.72|206209|0 2019-06-25 18:29:52,688|MF|app-20190625182937-0194|12|4|START| 16.33|F.Maximal disks found | 0.00| 0|0 2019-06-25 18:29:52,690|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:29:52,690|Cell area: 1055533.7681000116 2019-06-25 18:30:17,807|MF|app-20190625182937-0194|12|4| END| 41.45|F.Maximal disks found | 25.12| 40009|0 2019-06-25 18:30:17,807|MAXIMALS|app-20190625182937-0194|4|12|110.0|3|1800|34.865|40009 2019-06-25 18:30:19,214|FF|app-20190625182937-0194|12|4| END| 42.86|1.Maximal disks found | 36.27| 40009|0 2019-06-25 18:30:19,214|FF|app-20190625182937-0194|12|4|START| 42.86|1.Maximal disks found | 0.00| 0|1 2019-06-25 18:30:19,214|MF|app-20190625182937-0194|12|4|START| 42.86|A.Points indexed | 0.00| 0|1 2019-06-25 18:30:19,324|MF|app-20190625182937-0194|12|4| END| 42.97|A.Points indexed | 0.11| 72980|1 2019-06-25 18:30:19,325|MF|app-20190625182937-0194|12|4|START| 42.97|B.Pairs found | 0.00| 0|1 2019-06-25 18:30:20,240|MF|app-20190625182937-0194|12|4| END| 43.89|B.Pairs found | 0.92|159996|1 2019-06-25 18:30:20,241|MF|app-20190625182937-0194|12|4|START| 43.89|C.Centers found | 0.00| 0|1 2019-06-25 18:30:21,022|MF|app-20190625182937-0194|12|4| END| 44.67|C.Centers found | 0.78|319992|1 2019-06-25 18:30:21,022|MF|app-20190625182937-0194|12|4|START| 44.67|D.Disks found | 0.00| 0|1 2019-06-25 18:30:24,563|MF|app-20190625182937-0194|12|4| END| 48.21|D.Disks found | 3.54|143396|1 2019-06-25 18:30:24,563|MF|app-20190625182937-0194|12|4|START| 48.21|E.Disks partitioned | 0.00| 0|1 2019-06-25 18:30:25,849|MF|app-20190625182937-0194|12|4| END| 49.49|E.Disks partitioned | 1.29|209660|1 2019-06-25 18:30:25,849|MF|app-20190625182937-0194|12|4|START| 49.49|F.Maximal disks found | 0.00| 0|1 2019-06-25 18:30:25,850|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:30:25,850|Cell area: 1055533.7681000116 2019-06-25 18:30:54,163|MF|app-20190625182937-0194|12|4| END| 77.81|F.Maximal disks found | 28.31| 40432|1 2019-06-25 18:30:54,163|MAXIMALS|app-20190625182937-0194|4|12|110.0|3|1800|34.949|40432 2019-06-25 18:30:55,552|FF|app-20190625182937-0194|12|4| END| 79.20|1.Maximal disks found | 36.34| 40432|1 2019-06-25 18:30:55,552|FF|app-20190625182937-0194|12|4|START| 79.20|2.Join done | 0.00| 0|1 2019-06-25 18:30:59,688|FF|app-20190625182937-0194|12|4| END| 83.33|2.Join done | 4.14| 87506|1 2019-06-25 18:30:59,688|FF|app-20190625182937-0194|12|4|START| 83.33|3.Flocks to report | 0.00| 0|1 2019-06-25 18:31:00,319|FF|app-20190625182937-0194|12|4| END| 83.96|3.Flocks to report | 0.63| 0|1 2019-06-25 18:31:00,319|FF|app-20190625182937-0194|12|4|START| 83.96|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 18:31:00,380|FF|app-20190625182937-0194|12|4| END| 84.03|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 18:31:00,380|FF|app-20190625182937-0194|12|4|START| 84.03|5.Flocks reported | 0.00| 0|1 2019-06-25 18:31:00,385|FF|app-20190625182937-0194|12|4| END| 84.03|5.Flocks reported | 0.01| 0|1 2019-06-25 18:31:00,385|FF|app-20190625182937-0194|12|4|START| 84.03|6.Candidates indexed | 0.00| 0|1 2019-06-25 18:31:02,565|FF|app-20190625182937-0194|12|4| END| 86.21|6.Candidates indexed | 2.18| 89925|1 2019-06-25 18:31:02,565|FF|app-20190625182937-0194|12|4|START| 86.21|1.Maximal disks found | 0.00| 0|2 2019-06-25 18:31:02,566|MF|app-20190625182937-0194|12|4|START| 86.21|A.Points indexed | 0.00| 0|2 2019-06-25 18:31:02,679|MF|app-20190625182937-0194|12|4| END| 86.32|A.Points indexed | 0.11| 73576|2 2019-06-25 18:31:02,679|MF|app-20190625182937-0194|12|4|START| 86.32|B.Pairs found | 0.00| 0|2 2019-06-25 18:31:03,634|MF|app-20190625182937-0194|12|4| END| 87.28|B.Pairs found | 0.96|162264|2 2019-06-25 18:31:03,634|MF|app-20190625182937-0194|12|4|START| 87.28|C.Centers found | 0.00| 0|2 2019-06-25 18:31:04,403|MF|app-20190625182937-0194|12|4| END| 88.05|C.Centers found | 0.77|324528|2 2019-06-25 18:31:04,403|MF|app-20190625182937-0194|12|4|START| 88.05|D.Disks found | 0.00| 0|2 2019-06-25 18:31:07,792|MF|app-20190625182937-0194|12|4| END| 91.44|D.Disks found | 3.39|145412|2 2019-06-25 18:31:07,792|MF|app-20190625182937-0194|12|4|START| 91.44|E.Disks partitioned | 0.00| 0|2 2019-06-25 18:31:08,977|MF|app-20190625182937-0194|12|4| END| 92.62|E.Disks partitioned | 1.19|212798|2 2019-06-25 18:31:08,977|MF|app-20190625182937-0194|12|4|START| 92.62|F.Maximal disks found | 0.00| 0|2 2019-06-25 18:31:08,978|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:31:08,978|Cell area: 1055533.7681000116 2019-06-25 18:31:37,741|MF|app-20190625182937-0194|12|4| END|121.39|F.Maximal disks found | 28.76| 41347|2 2019-06-25 18:31:37,741|MAXIMALS|app-20190625182937-0194|4|12|110.0|3|1800|35.175|41347 2019-06-25 18:31:39,092|FF|app-20190625182937-0194|12|4| END|122.74|1.Maximal disks found | 36.53| 41347|2 2019-06-25 18:31:39,092|FF|app-20190625182937-0194|12|4|START|122.74|2.Join done | 0.00| 0|2 2019-06-25 18:31:49,686|FF|app-20190625182937-0194|12|4| END|133.33|2.Join done | 10.59|179268|2 2019-06-25 18:31:49,686|FF|app-20190625182937-0194|12|4|START|133.33|3.Flocks to report | 0.00| 0|2 2019-06-25 18:31:50,642|FF|app-20190625182937-0194|12|4| END|134.29|3.Flocks to report | 0.96|153105|2 2019-06-25 18:31:50,643|FF|app-20190625182937-0194|12|4|START|134.29|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 18:31:50,706|FF|app-20190625182937-0194|12|4|START|134.35|4a.Making expansions | 0.00| 0|2 2019-06-25 18:31:51,750|FF|app-20190625182937-0194|12|4| END|135.40|4a.Making expansions | 1.04|191370|2 2019-06-25 18:31:51,750|FF|app-20190625182937-0194|12|4|START|135.40|4b.Finding maximals | 0.00| 0|2 2019-06-25 18:32:41,579|FF|app-20190625182937-0194|12|4| END|185.22|4b.Finding maximals | 49.83| 26404|2 2019-06-25 18:32:42,189|FF|app-20190625182937-0194|12|4| END|185.83|4.Flocks prunned by expansion | 51.55| 26404|2 2019-06-25 18:32:42,189|FF|app-20190625182937-0194|12|4|START|185.83|5.Flocks reported | 0.00| 0|2 2019-06-25 18:32:42,983|FF|app-20190625182937-0194|12|4| END|186.63|5.Flocks reported | 0.79| 26404|2 2019-06-25 18:32:42,983|FF|app-20190625182937-0194|12|4|START|186.63|6.Candidates indexed | 0.00| 0|2 2019-06-25 18:32:45,435|FF|app-20190625182937-0194|12|4| END|189.08|6.Candidates indexed | 2.45| 55147|2 2019-06-25 18:32:45,435|FF|app-20190625182937-0194|12|4|START|189.08|1.Maximal disks found | 0.00| 0|3 2019-06-25 18:32:45,435|MF|app-20190625182937-0194|12|4|START|189.08|A.Points indexed | 0.00| 0|3 2019-06-25 18:32:45,540|MF|app-20190625182937-0194|12|4| END|189.19|A.Points indexed | 0.11| 74192|3 2019-06-25 18:32:45,540|MF|app-20190625182937-0194|12|4|START|189.19|B.Pairs found | 0.00| 0|3 2019-06-25 18:32:46,323|MF|app-20190625182937-0194|12|4| END|189.97|B.Pairs found | 0.78|165028|3 2019-06-25 18:32:46,323|MF|app-20190625182937-0194|12|4|START|189.97|C.Centers found | 0.00| 0|3 2019-06-25 18:32:47,137|MF|app-20190625182937-0194|12|4| END|190.78|C.Centers found | 0.81|330056|3 2019-06-25 18:32:47,137|MF|app-20190625182937-0194|12|4|START|190.78|D.Disks found | 0.00| 0|3 2019-06-25 18:32:50,527|MF|app-20190625182937-0194|12|4| END|194.17|D.Disks found | 3.39|148348|3 2019-06-25 18:32:50,527|MF|app-20190625182937-0194|12|4|START|194.17|E.Disks partitioned | 0.00| 0|3 2019-06-25 18:32:52,035|MF|app-20190625182937-0194|12|4| END|195.68|E.Disks partitioned | 1.51|217088|3 2019-06-25 18:32:52,035|MF|app-20190625182937-0194|12|4|START|195.68|F.Maximal disks found | 0.00| 0|3 2019-06-25 18:32:52,036|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:32:52,036|Cell area: 1055533.7681000116 2019-06-25 18:33:28,948|MF|app-20190625182937-0194|12|4| END|232.59|F.Maximal disks found | 36.91| 42012|3 2019-06-25 18:33:28,948|MAXIMALS|app-20190625182937-0194|4|12|110.0|3|1800|43.513|42012 2019-06-25 18:33:30,365|FF|app-20190625182937-0194|12|4| END|234.01|1.Maximal disks found | 44.93| 42012|3 2019-06-25 18:33:30,365|FF|app-20190625182937-0194|12|4|START|234.01|2.Join done | 0.00| 0|3 2019-06-25 18:33:36,862|FF|app-20190625182937-0194|12|4| END|240.51|2.Join done | 6.50|179709|3 2019-06-25 18:33:36,862|FF|app-20190625182937-0194|12|4|START|240.51|3.Flocks to report | 0.00| 0|3 2019-06-25 18:33:37,824|FF|app-20190625182937-0194|12|4| END|241.47|3.Flocks to report | 0.96|153488|3 2019-06-25 18:33:37,824|FF|app-20190625182937-0194|12|4|START|241.47|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 18:33:37,906|FF|app-20190625182937-0194|12|4|START|241.55|4a.Making expansions | 0.00| 0|3 2019-06-25 18:33:39,338|FF|app-20190625182937-0194|12|4| END|242.98|4a.Making expansions | 1.43|191719|3 2019-06-25 18:33:39,338|FF|app-20190625182937-0194|12|4|START|242.98|4b.Finding maximals | 0.00| 0|3 2019-06-25 18:34:46,017|FF|app-20190625182937-0194|12|4| END|309.66|4b.Finding maximals | 66.68| 26676|3 2019-06-25 18:34:46,622|FF|app-20190625182937-0194|12|4| END|310.27|4.Flocks prunned by expansion | 68.80| 26676|3 2019-06-25 18:34:46,622|FF|app-20190625182937-0194|12|4|START|310.27|5.Flocks reported | 0.00| 0|3 2019-06-25 18:34:47,450|FF|app-20190625182937-0194|12|4| END|311.10|5.Flocks reported | 0.83| 26676|3 2019-06-25 18:34:47,450|FF|app-20190625182937-0194|12|4|START|311.10|6.Candidates indexed | 0.00| 0|3 2019-06-25 18:34:50,007|FF|app-20190625182937-0194|12|4| END|313.65|6.Candidates indexed | 2.56| 55524|3 2019-06-25 18:34:51,814|Number of flocks: 53080 2019-06-25 18:34:53,107|PFLOCK|app-20190625182937-0194|4|12|110.0|3|3|308.90|53080 2019-06-25 18:34:54,380|FF|app-20190625182937-0194|12|4| END|318.03|Flock Finder run |311.46| 53080|3 2019-06-25 18:34:54,380|FF|app-20190625182937-0194|12|4|START|318.03|Session closed | 0.00| 0|3 2019-06-25 18:35:02,050|FF|app-20190625182937-0194|12|4| END|325.70|Session closed | 7.67| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 6 --fftimestamp 4 --portui 4040 --info 2019-06-25 18:35:04,056|FF|app-00000000000000-0000|6|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 18:35:05,161|FF|app-20190625183504-0195|6|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 18:35:05,161|FF|app-20190625183504-0195|6|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 18:35:09,082|FF|app-20190625183504-0195|6|4| END| 5.01|Data read | 3.92|220752|-1 2019-06-25 18:35:09,082|FF|app-20190625183504-0195|6|4|START| 5.01|KDBTree partitioner | 0.00| 0|-1 2019-06-25 18:35:09,220|FF|app-20190625183504-0195|6|4| END| 5.15|KDBTree partitioner | 0.14| 544|-1 2019-06-25 18:35:09,221|FF|app-20190625183504-0195|6|4|START| 5.15|MF partitioner | 0.00| 0|-1 2019-06-25 18:35:09,250|FF|app-20190625183504-0195|6|4| END| 5.18|MF partitioner | 0.03| 900|-1 2019-06-25 18:35:09,250|FF|app-20190625183504-0195|6|4|START| 5.18|Pointset done | 0.00| 0|-1 2019-06-25 18:35:10,300|FF|app-20190625183504-0195|6|4| END| 6.23|Pointset done | 1.05| 4|-1 2019-06-25 18:35:10,300|FF|app-20190625183504-0195|6|4|START| 6.23|Flock Finder run | 0.00| 0|-1 2019-06-25 18:35:10,322|FF|app-20190625183504-0195|6|4|START| 6.25|1.Maximal disks found | 0.00| 0|0 2019-06-25 18:35:10,325|MF|app-20190625183504-0195|6|4|START| 6.25|A.Points indexed | 0.00| 0|0 2019-06-25 18:35:10,480|MF|app-20190625183504-0195|6|4| END| 6.41|A.Points indexed | 0.16| 36186|0 2019-06-25 18:35:10,481|MF|app-20190625183504-0195|6|4|START| 6.41|B.Pairs found | 0.00| 0|0 2019-06-25 18:35:12,021|MF|app-20190625183504-0195|6|4| END| 7.95|B.Pairs found | 1.54| 78808|0 2019-06-25 18:35:12,022|MF|app-20190625183504-0195|6|4|START| 7.95|C.Centers found | 0.00| 0|0 2019-06-25 18:35:12,990|MF|app-20190625183504-0195|6|4| END| 8.92|C.Centers found | 0.97|157616|0 2019-06-25 18:35:12,990|MF|app-20190625183504-0195|6|4|START| 8.92|D.Disks found | 0.00| 0|0 2019-06-25 18:35:17,864|MF|app-20190625183504-0195|6|4| END| 13.79|D.Disks found | 4.87| 70458|0 2019-06-25 18:35:17,864|MF|app-20190625183504-0195|6|4|START| 13.79|E.Disks partitioned | 0.00| 0|0 2019-06-25 18:35:20,394|MF|app-20190625183504-0195|6|4| END| 16.32|E.Disks partitioned | 2.53|103004|0 2019-06-25 18:35:20,394|MF|app-20190625183504-0195|6|4|START| 16.32|F.Maximal disks found | 0.00| 0|0 2019-06-25 18:35:20,396|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:35:20,396|Cell area: 1055533.7681000116 2019-06-25 18:35:46,257|MF|app-20190625183504-0195|6|4| END| 42.18|F.Maximal disks found | 25.86| 20001|0 2019-06-25 18:35:46,257|MAXIMALS|app-20190625183504-0195|4|6|110.0|3|900|35.932|20001 2019-06-25 18:35:47,238|FF|app-20190625183504-0195|6|4| END| 43.17|1.Maximal disks found | 36.92| 20001|0 2019-06-25 18:35:47,238|FF|app-20190625183504-0195|6|4|START| 43.17|1.Maximal disks found | 0.00| 0|1 2019-06-25 18:35:47,238|MF|app-20190625183504-0195|6|4|START| 43.17|A.Points indexed | 0.00| 0|1 2019-06-25 18:35:47,313|MF|app-20190625183504-0195|6|4| END| 43.24|A.Points indexed | 0.08| 36490|1 2019-06-25 18:35:47,313|MF|app-20190625183504-0195|6|4|START| 43.24|B.Pairs found | 0.00| 0|1 2019-06-25 18:35:48,132|MF|app-20190625183504-0195|6|4| END| 44.06|B.Pairs found | 0.82| 79998|1 2019-06-25 18:35:48,132|MF|app-20190625183504-0195|6|4|START| 44.06|C.Centers found | 0.00| 0|1 2019-06-25 18:35:48,934|MF|app-20190625183504-0195|6|4| END| 44.86|C.Centers found | 0.80|159996|1 2019-06-25 18:35:48,934|MF|app-20190625183504-0195|6|4|START| 44.86|D.Disks found | 0.00| 0|1 2019-06-25 18:35:53,528|MF|app-20190625183504-0195|6|4| END| 49.46|D.Disks found | 4.59| 71698|1 2019-06-25 18:35:53,528|MF|app-20190625183504-0195|6|4|START| 49.46|E.Disks partitioned | 0.00| 0|1 2019-06-25 18:35:55,683|MF|app-20190625183504-0195|6|4| END| 51.61|E.Disks partitioned | 2.16|104758|1 2019-06-25 18:35:55,683|MF|app-20190625183504-0195|6|4|START| 51.61|F.Maximal disks found | 0.00| 0|1 2019-06-25 18:35:55,683|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:35:55,683|Cell area: 1055533.7681000116 2019-06-25 18:36:24,086|MF|app-20190625183504-0195|6|4| END| 80.01|F.Maximal disks found | 28.40| 20222|1 2019-06-25 18:36:24,086|MAXIMALS|app-20190625183504-0195|4|6|110.0|3|900|36.848|20222 2019-06-25 18:36:24,991|FF|app-20190625183504-0195|6|4| END| 80.92|1.Maximal disks found | 37.75| 20222|1 2019-06-25 18:36:24,991|FF|app-20190625183504-0195|6|4|START| 80.92|2.Join done | 0.00| 0|1 2019-06-25 18:36:30,507|FF|app-20190625183504-0195|6|4| END| 86.43|2.Join done | 5.52| 43837|1 2019-06-25 18:36:30,507|FF|app-20190625183504-0195|6|4|START| 86.43|3.Flocks to report | 0.00| 0|1 2019-06-25 18:36:31,500|FF|app-20190625183504-0195|6|4| END| 87.43|3.Flocks to report | 0.99| 0|1 2019-06-25 18:36:31,500|FF|app-20190625183504-0195|6|4|START| 87.43|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 18:36:31,546|FF|app-20190625183504-0195|6|4| END| 87.47|4.Flocks prunned by expansion | 0.05| 0|1 2019-06-25 18:36:31,546|FF|app-20190625183504-0195|6|4|START| 87.47|5.Flocks reported | 0.00| 0|1 2019-06-25 18:36:31,551|FF|app-20190625183504-0195|6|4| END| 87.48|5.Flocks reported | 0.01| 0|1 2019-06-25 18:36:31,551|FF|app-20190625183504-0195|6|4|START| 87.48|6.Candidates indexed | 0.00| 0|1 2019-06-25 18:36:35,540|FF|app-20190625183504-0195|6|4| END| 91.47|6.Candidates indexed | 3.99| 45047|1 2019-06-25 18:36:35,540|FF|app-20190625183504-0195|6|4|START| 91.47|1.Maximal disks found | 0.00| 0|2 2019-06-25 18:36:35,540|MF|app-20190625183504-0195|6|4|START| 91.47|A.Points indexed | 0.00| 0|2 2019-06-25 18:36:35,614|MF|app-20190625183504-0195|6|4| END| 91.54|A.Points indexed | 0.07| 36788|2 2019-06-25 18:36:35,614|MF|app-20190625183504-0195|6|4|START| 91.54|B.Pairs found | 0.00| 0|2 2019-06-25 18:36:36,336|MF|app-20190625183504-0195|6|4| END| 92.26|B.Pairs found | 0.72| 81132|2 2019-06-25 18:36:36,336|MF|app-20190625183504-0195|6|4|START| 92.26|C.Centers found | 0.00| 0|2 2019-06-25 18:36:37,032|MF|app-20190625183504-0195|6|4| END| 92.96|C.Centers found | 0.70|162264|2 2019-06-25 18:36:37,032|MF|app-20190625183504-0195|6|4|START| 92.96|D.Disks found | 0.00| 0|2 2019-06-25 18:36:41,156|MF|app-20190625183504-0195|6|4| END| 97.08|D.Disks found | 4.12| 72706|2 2019-06-25 18:36:41,156|MF|app-20190625183504-0195|6|4|START| 97.08|E.Disks partitioned | 0.00| 0|2 2019-06-25 18:36:43,265|MF|app-20190625183504-0195|6|4| END| 99.19|E.Disks partitioned | 2.11|106347|2 2019-06-25 18:36:43,265|MF|app-20190625183504-0195|6|4|START| 99.19|F.Maximal disks found | 0.00| 0|2 2019-06-25 18:36:43,266|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:36:43,266|Cell area: 1055533.7681000116 2019-06-25 18:37:09,368|MF|app-20190625183504-0195|6|4| END|125.30|F.Maximal disks found | 26.10| 20682|2 2019-06-25 18:37:09,368|MAXIMALS|app-20190625183504-0195|4|6|110.0|3|900|33.828|20682 2019-06-25 18:37:10,327|FF|app-20190625183504-0195|6|4| END|126.25|1.Maximal disks found | 34.79| 20682|2 2019-06-25 18:37:10,327|FF|app-20190625183504-0195|6|4|START|126.25|2.Join done | 0.00| 0|2 2019-06-25 18:37:28,081|FF|app-20190625183504-0195|6|4| END|144.01|2.Join done | 17.75| 89740|2 2019-06-25 18:37:28,081|FF|app-20190625183504-0195|6|4|START|144.01|3.Flocks to report | 0.00| 0|2 2019-06-25 18:37:30,121|FF|app-20190625183504-0195|6|4| END|146.05|3.Flocks to report | 2.04| 76643|2 2019-06-25 18:37:30,121|FF|app-20190625183504-0195|6|4|START|146.05|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 18:37:30,164|FF|app-20190625183504-0195|6|4|START|146.09|4a.Making expansions | 0.00| 0|2 2019-06-25 18:37:31,543|FF|app-20190625183504-0195|6|4| END|147.47|4a.Making expansions | 1.38| 96024|2 2019-06-25 18:37:31,543|FF|app-20190625183504-0195|6|4|START|147.47|4b.Finding maximals | 0.00| 0|2 2019-06-25 18:38:19,710|FF|app-20190625183504-0195|6|4| END|195.64|4b.Finding maximals | 48.17| 13202|2 2019-06-25 18:38:20,075|FF|app-20190625183504-0195|6|4| END|196.00|4.Flocks prunned by expansion | 49.95| 13202|2 2019-06-25 18:38:20,075|FF|app-20190625183504-0195|6|4|START|196.00|5.Flocks reported | 0.00| 0|2 2019-06-25 18:38:20,711|FF|app-20190625183504-0195|6|4| END|196.64|5.Flocks reported | 0.64| 13202|2 2019-06-25 18:38:20,711|FF|app-20190625183504-0195|6|4|START|196.64|6.Candidates indexed | 0.00| 0|2 2019-06-25 18:38:24,060|FF|app-20190625183504-0195|6|4| END|199.99|6.Candidates indexed | 3.35| 27595|2 2019-06-25 18:38:24,061|FF|app-20190625183504-0195|6|4|START|199.99|1.Maximal disks found | 0.00| 0|3 2019-06-25 18:38:24,061|MF|app-20190625183504-0195|6|4|START|199.99|A.Points indexed | 0.00| 0|3 2019-06-25 18:38:24,137|MF|app-20190625183504-0195|6|4| END|200.06|A.Points indexed | 0.08| 37096|3 2019-06-25 18:38:24,137|MF|app-20190625183504-0195|6|4|START|200.06|B.Pairs found | 0.00| 0|3 2019-06-25 18:38:24,853|MF|app-20190625183504-0195|6|4| END|200.78|B.Pairs found | 0.72| 82514|3 2019-06-25 18:38:24,853|MF|app-20190625183504-0195|6|4|START|200.78|C.Centers found | 0.00| 0|3 2019-06-25 18:38:25,600|MF|app-20190625183504-0195|6|4| END|201.53|C.Centers found | 0.75|165028|3 2019-06-25 18:38:25,600|MF|app-20190625183504-0195|6|4|START|201.53|D.Disks found | 0.00| 0|3 2019-06-25 18:38:30,019|MF|app-20190625183504-0195|6|4| END|205.95|D.Disks found | 4.42| 74174|3 2019-06-25 18:38:30,019|MF|app-20190625183504-0195|6|4|START|205.95|E.Disks partitioned | 0.00| 0|3 2019-06-25 18:38:32,135|MF|app-20190625183504-0195|6|4| END|208.06|E.Disks partitioned | 2.12|108468|3 2019-06-25 18:38:32,136|MF|app-20190625183504-0195|6|4|START|208.06|F.Maximal disks found | 0.00| 0|3 2019-06-25 18:38:32,136|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:38:32,136|Cell area: 1055533.7681000116 2019-06-25 18:39:05,913|MF|app-20190625183504-0195|6|4| END|241.84|F.Maximal disks found | 33.78| 21009|3 2019-06-25 18:39:05,913|MAXIMALS|app-20190625183504-0195|4|6|110.0|3|900|41.852|21009 2019-06-25 18:39:06,767|FF|app-20190625183504-0195|6|4| END|242.69|1.Maximal disks found | 42.71| 21009|3 2019-06-25 18:39:06,767|FF|app-20190625183504-0195|6|4|START|242.69|2.Join done | 0.00| 0|3 2019-06-25 18:39:19,146|FF|app-20190625183504-0195|6|4| END|255.07|2.Join done | 12.38| 90003|3 2019-06-25 18:39:19,146|FF|app-20190625183504-0195|6|4|START|255.07|3.Flocks to report | 0.00| 0|3 2019-06-25 18:39:21,249|FF|app-20190625183504-0195|6|4| END|257.18|3.Flocks to report | 2.10| 76861|3 2019-06-25 18:39:21,249|FF|app-20190625183504-0195|6|4|START|257.18|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 18:39:21,296|FF|app-20190625183504-0195|6|4|START|257.22|4a.Making expansions | 0.00| 0|3 2019-06-25 18:39:22,750|FF|app-20190625183504-0195|6|4| END|258.68|4a.Making expansions | 1.45| 95535|3 2019-06-25 18:39:22,750|FF|app-20190625183504-0195|6|4|START|258.68|4b.Finding maximals | 0.00| 0|3 2019-06-25 18:40:26,869|FF|app-20190625183504-0195|6|4| END|322.80|4b.Finding maximals | 64.12| 13338|3 2019-06-25 18:40:27,293|FF|app-20190625183504-0195|6|4| END|323.22|4.Flocks prunned by expansion | 66.04| 13338|3 2019-06-25 18:40:27,293|FF|app-20190625183504-0195|6|4|START|323.22|5.Flocks reported | 0.00| 0|3 2019-06-25 18:40:27,869|FF|app-20190625183504-0195|6|4| END|323.80|5.Flocks reported | 0.58| 13338|3 2019-06-25 18:40:27,869|FF|app-20190625183504-0195|6|4|START|323.80|6.Candidates indexed | 0.00| 0|3 2019-06-25 18:40:30,838|FF|app-20190625183504-0195|6|4| END|326.77|6.Candidates indexed | 2.97| 27789|3 2019-06-25 18:40:32,170|Number of flocks: 26540 2019-06-25 18:40:32,919|PFLOCK|app-20190625183504-0195|4|6|110.0|3|3|321.87|26540 2019-06-25 18:40:33,659|FF|app-20190625183504-0195|6|4| END|329.59|Flock Finder run |323.36| 26540|3 2019-06-25 18:40:33,659|FF|app-20190625183504-0195|6|4|START|329.59|Session closed | 0.00| 0|3 2019-06-25 18:40:40,264|FF|app-20190625183504-0195|6|4| END|336.19|Session closed | 6.60| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 3 --fftimestamp 4 --portui 4040 --info 2019-06-25 18:40:42,254|FF|app-00000000000000-0000|3|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 18:40:43,371|FF|app-20190625184043-0196|3|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 18:40:43,372|FF|app-20190625184043-0196|3|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 18:40:47,090|FF|app-20190625184043-0196|3|4| END| 4.82|Data read | 3.72|110376|-1 2019-06-25 18:40:47,091|FF|app-20190625184043-0196|3|4|START| 4.82|KDBTree partitioner | 0.00| 0|-1 2019-06-25 18:40:47,189|FF|app-20190625184043-0196|3|4| END| 4.92|KDBTree partitioner | 0.10| 272|-1 2019-06-25 18:40:47,190|FF|app-20190625184043-0196|3|4|START| 4.92|MF partitioner | 0.00| 0|-1 2019-06-25 18:40:47,200|FF|app-20190625184043-0196|3|4| END| 4.93|MF partitioner | 0.01| 450|-1 2019-06-25 18:40:47,200|FF|app-20190625184043-0196|3|4|START| 4.93|Pointset done | 0.00| 0|-1 2019-06-25 18:40:48,017|FF|app-20190625184043-0196|3|4| END| 5.75|Pointset done | 0.82| 4|-1 2019-06-25 18:40:48,017|FF|app-20190625184043-0196|3|4|START| 5.75|Flock Finder run | 0.00| 0|-1 2019-06-25 18:40:48,036|FF|app-20190625184043-0196|3|4|START| 5.76|1.Maximal disks found | 0.00| 0|0 2019-06-25 18:40:48,038|MF|app-20190625184043-0196|3|4|START| 5.77|A.Points indexed | 0.00| 0|0 2019-06-25 18:40:48,193|MF|app-20190625184043-0196|3|4| END| 5.92|A.Points indexed | 0.16| 18093|0 2019-06-25 18:40:48,193|MF|app-20190625184043-0196|3|4|START| 5.92|B.Pairs found | 0.00| 0|0 2019-06-25 18:40:49,605|MF|app-20190625184043-0196|3|4| END| 7.33|B.Pairs found | 1.41| 39404|0 2019-06-25 18:40:49,605|MF|app-20190625184043-0196|3|4|START| 7.33|C.Centers found | 0.00| 0|0 2019-06-25 18:40:50,447|MF|app-20190625184043-0196|3|4| END| 8.18|C.Centers found | 0.84| 78808|0 2019-06-25 18:40:50,447|MF|app-20190625184043-0196|3|4|START| 8.18|D.Disks found | 0.00| 0|0 2019-06-25 18:40:53,844|MF|app-20190625184043-0196|3|4| END| 11.57|D.Disks found | 3.40| 35229|0 2019-06-25 18:40:53,844|MF|app-20190625184043-0196|3|4|START| 11.57|E.Disks partitioned | 0.00| 0|0 2019-06-25 18:40:55,059|MF|app-20190625184043-0196|3|4| END| 12.79|E.Disks partitioned | 1.22| 51442|0 2019-06-25 18:40:55,059|MF|app-20190625184043-0196|3|4|START| 12.79|F.Maximal disks found | 0.00| 0|0 2019-06-25 18:40:55,060|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:40:55,061|Cell area: 1055533.7681000116 2019-06-25 18:41:19,623|MF|app-20190625184043-0196|3|4| END| 37.35|F.Maximal disks found | 24.56| 10001|0 2019-06-25 18:41:19,623|MAXIMALS|app-20190625184043-0196|4|3|110.0|3|450|31.585|10001 2019-06-25 18:41:20,157|FF|app-20190625184043-0196|3|4| END| 37.89|1.Maximal disks found | 32.12| 10001|0 2019-06-25 18:41:20,157|FF|app-20190625184043-0196|3|4|START| 37.89|1.Maximal disks found | 0.00| 0|1 2019-06-25 18:41:20,157|MF|app-20190625184043-0196|3|4|START| 37.89|A.Points indexed | 0.00| 0|1 2019-06-25 18:41:20,224|MF|app-20190625184043-0196|3|4| END| 37.95|A.Points indexed | 0.07| 18245|1 2019-06-25 18:41:20,224|MF|app-20190625184043-0196|3|4|START| 37.95|B.Pairs found | 0.00| 0|1 2019-06-25 18:41:20,677|MF|app-20190625184043-0196|3|4| END| 38.41|B.Pairs found | 0.45| 39999|1 2019-06-25 18:41:20,677|MF|app-20190625184043-0196|3|4|START| 38.41|C.Centers found | 0.00| 0|1 2019-06-25 18:41:21,183|MF|app-20190625184043-0196|3|4| END| 38.91|C.Centers found | 0.51| 79998|1 2019-06-25 18:41:21,183|MF|app-20190625184043-0196|3|4|START| 38.91|D.Disks found | 0.00| 0|1 2019-06-25 18:41:23,529|MF|app-20190625184043-0196|3|4| END| 41.26|D.Disks found | 2.35| 35849|1 2019-06-25 18:41:23,530|MF|app-20190625184043-0196|3|4|START| 41.26|E.Disks partitioned | 0.00| 0|1 2019-06-25 18:41:24,331|MF|app-20190625184043-0196|3|4| END| 42.06|E.Disks partitioned | 0.80| 52317|1 2019-06-25 18:41:24,331|MF|app-20190625184043-0196|3|4|START| 42.06|F.Maximal disks found | 0.00| 0|1 2019-06-25 18:41:24,331|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:41:24,332|Cell area: 1055533.7681000116 2019-06-25 18:41:49,509|MF|app-20190625184043-0196|3|4| END| 67.24|F.Maximal disks found | 25.18| 10110|1 2019-06-25 18:41:49,509|MAXIMALS|app-20190625184043-0196|4|3|110.0|3|450|29.352|10110 2019-06-25 18:41:49,924|FF|app-20190625184043-0196|3|4| END| 67.65|1.Maximal disks found | 29.77| 10110|1 2019-06-25 18:41:49,924|FF|app-20190625184043-0196|3|4|START| 67.65|2.Join done | 0.00| 0|1 2019-06-25 18:41:52,400|FF|app-20190625184043-0196|3|4| END| 70.13|2.Join done | 2.48| 21993|1 2019-06-25 18:41:52,400|FF|app-20190625184043-0196|3|4|START| 70.13|3.Flocks to report | 0.00| 0|1 2019-06-25 18:41:52,858|FF|app-20190625184043-0196|3|4| END| 70.59|3.Flocks to report | 0.46| 0|1 2019-06-25 18:41:52,858|FF|app-20190625184043-0196|3|4|START| 70.59|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 18:41:52,888|FF|app-20190625184043-0196|3|4| END| 70.62|4.Flocks prunned by expansion | 0.03| 0|1 2019-06-25 18:41:52,888|FF|app-20190625184043-0196|3|4|START| 70.62|5.Flocks reported | 0.00| 0|1 2019-06-25 18:41:52,893|FF|app-20190625184043-0196|3|4| END| 70.62|5.Flocks reported | 0.01| 0|1 2019-06-25 18:41:52,893|FF|app-20190625184043-0196|3|4|START| 70.62|6.Candidates indexed | 0.00| 0|1 2019-06-25 18:41:54,391|FF|app-20190625184043-0196|3|4| END| 72.12|6.Candidates indexed | 1.50| 22599|1 2019-06-25 18:41:54,392|FF|app-20190625184043-0196|3|4|START| 72.12|1.Maximal disks found | 0.00| 0|2 2019-06-25 18:41:54,392|MF|app-20190625184043-0196|3|4|START| 72.12|A.Points indexed | 0.00| 0|2 2019-06-25 18:41:54,455|MF|app-20190625184043-0196|3|4| END| 72.18|A.Points indexed | 0.06| 18394|2 2019-06-25 18:41:54,455|MF|app-20190625184043-0196|3|4|START| 72.18|B.Pairs found | 0.00| 0|2 2019-06-25 18:41:54,863|MF|app-20190625184043-0196|3|4| END| 72.59|B.Pairs found | 0.41| 40566|2 2019-06-25 18:41:54,863|MF|app-20190625184043-0196|3|4|START| 72.59|C.Centers found | 0.00| 0|2 2019-06-25 18:41:55,303|MF|app-20190625184043-0196|3|4| END| 73.03|C.Centers found | 0.44| 81132|2 2019-06-25 18:41:55,303|MF|app-20190625184043-0196|3|4|START| 73.03|D.Disks found | 0.00| 0|2 2019-06-25 18:41:57,576|MF|app-20190625184043-0196|3|4| END| 75.31|D.Disks found | 2.27| 36353|2 2019-06-25 18:41:57,576|MF|app-20190625184043-0196|3|4|START| 75.31|E.Disks partitioned | 0.00| 0|2 2019-06-25 18:41:58,309|MF|app-20190625184043-0196|3|4| END| 76.04|E.Disks partitioned | 0.73| 53134|2 2019-06-25 18:41:58,309|MF|app-20190625184043-0196|3|4|START| 76.04|F.Maximal disks found | 0.00| 0|2 2019-06-25 18:41:58,309|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:41:58,309|Cell area: 1055533.7681000116 2019-06-25 18:42:24,384|MF|app-20190625184043-0196|3|4| END|102.11|F.Maximal disks found | 26.08| 10342|2 2019-06-25 18:42:24,384|MAXIMALS|app-20190625184043-0196|4|3|110.0|3|450|29.992|10342 2019-06-25 18:42:24,758|FF|app-20190625184043-0196|3|4| END|102.49|1.Maximal disks found | 30.37| 10342|2 2019-06-25 18:42:24,758|FF|app-20190625184043-0196|3|4|START|102.49|2.Join done | 0.00| 0|2 2019-06-25 18:42:38,783|FF|app-20190625184043-0196|3|4| END|116.51|2.Join done | 14.02| 45000|2 2019-06-25 18:42:38,783|FF|app-20190625184043-0196|3|4|START|116.51|3.Flocks to report | 0.00| 0|2 2019-06-25 18:42:40,769|FF|app-20190625184043-0196|3|4| END|118.50|3.Flocks to report | 1.99| 38432|2 2019-06-25 18:42:40,769|FF|app-20190625184043-0196|3|4|START|118.50|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 18:42:40,809|FF|app-20190625184043-0196|3|4|START|118.54|4a.Making expansions | 0.00| 0|2 2019-06-25 18:42:41,894|FF|app-20190625184043-0196|3|4| END|119.62|4a.Making expansions | 1.09| 48134|2 2019-06-25 18:42:41,895|FF|app-20190625184043-0196|3|4|START|119.62|4b.Finding maximals | 0.00| 0|2 2019-06-25 18:43:27,185|FF|app-20190625184043-0196|3|4| END|164.91|4b.Finding maximals | 45.29| 6601|2 2019-06-25 18:43:27,517|FF|app-20190625184043-0196|3|4| END|165.25|4.Flocks prunned by expansion | 46.75| 6601|2 2019-06-25 18:43:27,517|FF|app-20190625184043-0196|3|4|START|165.25|5.Flocks reported | 0.00| 0|2 2019-06-25 18:43:28,019|FF|app-20190625184043-0196|3|4| END|165.75|5.Flocks reported | 0.50| 6601|2 2019-06-25 18:43:28,020|FF|app-20190625184043-0196|3|4|START|165.75|6.Candidates indexed | 0.00| 0|2 2019-06-25 18:43:31,434|FF|app-20190625184043-0196|3|4| END|169.16|6.Candidates indexed | 3.41| 13819|2 2019-06-25 18:43:31,434|FF|app-20190625184043-0196|3|4|START|169.16|1.Maximal disks found | 0.00| 0|3 2019-06-25 18:43:31,434|MF|app-20190625184043-0196|3|4|START|169.16|A.Points indexed | 0.00| 0|3 2019-06-25 18:43:31,488|MF|app-20190625184043-0196|3|4| END|169.22|A.Points indexed | 0.05| 18548|3 2019-06-25 18:43:31,489|MF|app-20190625184043-0196|3|4|START|169.22|B.Pairs found | 0.00| 0|3 2019-06-25 18:43:32,403|MF|app-20190625184043-0196|3|4| END|170.13|B.Pairs found | 0.91| 41257|3 2019-06-25 18:43:32,403|MF|app-20190625184043-0196|3|4|START|170.13|C.Centers found | 0.00| 0|3 2019-06-25 18:43:33,159|MF|app-20190625184043-0196|3|4| END|170.89|C.Centers found | 0.76| 82514|3 2019-06-25 18:43:33,159|MF|app-20190625184043-0196|3|4|START|170.89|D.Disks found | 0.00| 0|3 2019-06-25 18:43:37,988|MF|app-20190625184043-0196|3|4| END|175.72|D.Disks found | 4.83| 37087|3 2019-06-25 18:43:37,988|MF|app-20190625184043-0196|3|4|START|175.72|E.Disks partitioned | 0.00| 0|3 2019-06-25 18:43:39,833|MF|app-20190625184043-0196|3|4| END|177.56|E.Disks partitioned | 1.85| 54196|3 2019-06-25 18:43:39,833|MF|app-20190625184043-0196|3|4|START|177.56|F.Maximal disks found | 0.00| 0|3 2019-06-25 18:43:39,834|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:43:39,834|Cell area: 1055533.7681000116 2019-06-25 18:44:13,176|MF|app-20190625184043-0196|3|4| END|210.91|F.Maximal disks found | 33.34| 10503|3 2019-06-25 18:44:13,176|MAXIMALS|app-20190625184043-0196|4|3|110.0|3|450|41.742|10503 2019-06-25 18:44:13,865|FF|app-20190625184043-0196|3|4| END|211.59|1.Maximal disks found | 42.43| 10503|3 2019-06-25 18:44:13,865|FF|app-20190625184043-0196|3|4|START|211.59|2.Join done | 0.00| 0|3 2019-06-25 18:44:23,318|FF|app-20190625184043-0196|3|4| END|221.05|2.Join done | 9.45| 45190|3 2019-06-25 18:44:23,318|FF|app-20190625184043-0196|3|4|START|221.05|3.Flocks to report | 0.00| 0|3 2019-06-25 18:44:25,163|FF|app-20190625184043-0196|3|4| END|222.89|3.Flocks to report | 1.85| 38589|3 2019-06-25 18:44:25,163|FF|app-20190625184043-0196|3|4|START|222.89|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 18:44:25,205|FF|app-20190625184043-0196|3|4|START|222.93|4a.Making expansions | 0.00| 0|3 2019-06-25 18:44:26,311|FF|app-20190625184043-0196|3|4| END|224.04|4a.Making expansions | 1.11| 47925|3 2019-06-25 18:44:26,311|FF|app-20190625184043-0196|3|4|START|224.04|4b.Finding maximals | 0.00| 0|3 2019-06-25 18:45:29,004|FF|app-20190625184043-0196|3|4| END|286.73|4b.Finding maximals | 62.69| 6669|3 2019-06-25 18:45:29,284|FF|app-20190625184043-0196|3|4| END|287.01|4.Flocks prunned by expansion | 64.12| 6669|3 2019-06-25 18:45:29,284|FF|app-20190625184043-0196|3|4|START|287.01|5.Flocks reported | 0.00| 0|3 2019-06-25 18:45:29,778|FF|app-20190625184043-0196|3|4| END|287.51|5.Flocks reported | 0.49| 6669|3 2019-06-25 18:45:29,778|FF|app-20190625184043-0196|3|4|START|287.51|6.Candidates indexed | 0.00| 0|3 2019-06-25 18:45:33,066|FF|app-20190625184043-0196|3|4| END|290.80|6.Candidates indexed | 3.29| 13927|3 2019-06-25 18:45:33,851|Number of flocks: 13270 2019-06-25 18:45:34,217|PFLOCK|app-20190625184043-0196|4|3|110.0|3|3|285.83|13270 2019-06-25 18:45:34,571|FF|app-20190625184043-0196|3|4| END|292.30|Flock Finder run |286.55| 13270|3 2019-06-25 18:45:34,571|FF|app-20190625184043-0196|3|4|START|292.30|Session closed | 0.00| 0|3 2019-06-25 18:45:41,510|FF|app-20190625184043-0196|3|4| END|299.24|Session closed | 6.94| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B4_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_grid-60x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 12 --fftimestamp 4 --portui 4040 --info 2019-06-25 18:45:43,477|FF|app-00000000000000-0000|12|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 18:45:44,590|FF|app-20190625184544-0197|12|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 18:45:44,590|FF|app-20190625184544-0197|12|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 18:45:48,729|FF|app-20190625184544-0197|12|4| END| 5.24|Data read | 4.14|441504|-1 2019-06-25 18:45:48,729|FF|app-20190625184544-0197|12|4|START| 5.24|KDBTree partitioner | 0.00| 0|-1 2019-06-25 18:45:48,967|FF|app-20190625184544-0197|12|4| END| 5.47|KDBTree partitioner | 0.24| 1088|-1 2019-06-25 18:45:48,968|FF|app-20190625184544-0197|12|4|START| 5.48|MF partitioner | 0.00| 0|-1 2019-06-25 18:45:48,994|FF|app-20190625184544-0197|12|4| END| 5.50|MF partitioner | 0.03| 1800|-1 2019-06-25 18:45:48,994|FF|app-20190625184544-0197|12|4|START| 5.50|Pointset done | 0.00| 0|-1 2019-06-25 18:45:49,968|FF|app-20190625184544-0197|12|4| END| 6.48|Pointset done | 0.97| 4|-1 2019-06-25 18:45:49,968|FF|app-20190625184544-0197|12|4|START| 6.48|Flock Finder run | 0.00| 0|-1 2019-06-25 18:45:49,984|FF|app-20190625184544-0197|12|4|START| 6.49|1.Maximal disks found | 0.00| 0|0 2019-06-25 18:45:49,987|MF|app-20190625184544-0197|12|4|START| 6.49|A.Points indexed | 0.00| 0|0 2019-06-25 18:45:50,190|MF|app-20190625184544-0197|12|4| END| 6.70|A.Points indexed | 0.20| 72372|0 2019-06-25 18:45:50,190|MF|app-20190625184544-0197|12|4|START| 6.70|B.Pairs found | 0.00| 0|0 2019-06-25 18:45:52,040|MF|app-20190625184544-0197|12|4| END| 8.55|B.Pairs found | 1.85|135828|0 2019-06-25 18:45:52,041|MF|app-20190625184544-0197|12|4|START| 8.55|C.Centers found | 0.00| 0|0 2019-06-25 18:45:53,408|MF|app-20190625184544-0197|12|4| END| 9.92|C.Centers found | 1.37|271656|0 2019-06-25 18:45:53,408|MF|app-20190625184544-0197|12|4|START| 9.92|D.Disks found | 0.00| 0|0 2019-06-25 18:45:57,784|MF|app-20190625184544-0197|12|4| END| 14.29|D.Disks found | 4.38|114664|0 2019-06-25 18:45:57,784|MF|app-20190625184544-0197|12|4|START| 14.29|E.Disks partitioned | 0.00| 0|0 2019-06-25 18:45:59,341|MF|app-20190625184544-0197|12|4| END| 15.85|E.Disks partitioned | 1.56|162379|0 2019-06-25 18:45:59,342|MF|app-20190625184544-0197|12|4|START| 15.85|F.Maximal disks found | 0.00| 0|0 2019-06-25 18:45:59,344|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:45:59,344|Cell area: 1055533.7681000116 2019-06-25 18:46:10,659|MF|app-20190625184544-0197|12|4| END| 27.17|F.Maximal disks found | 11.32| 33494|0 2019-06-25 18:46:10,659|MAXIMALS|app-20190625184544-0197|4|12|100.0|3|1800|20.672|33494 2019-06-25 18:46:12,064|FF|app-20190625184544-0197|12|4| END| 28.57|1.Maximal disks found | 22.08| 33494|0 2019-06-25 18:46:12,064|FF|app-20190625184544-0197|12|4|START| 28.57|1.Maximal disks found | 0.00| 0|1 2019-06-25 18:46:12,064|MF|app-20190625184544-0197|12|4|START| 28.57|A.Points indexed | 0.00| 0|1 2019-06-25 18:46:12,179|MF|app-20190625184544-0197|12|4| END| 28.69|A.Points indexed | 0.12| 72980|1 2019-06-25 18:46:12,179|MF|app-20190625184544-0197|12|4|START| 28.69|B.Pairs found | 0.00| 0|1 2019-06-25 18:46:13,108|MF|app-20190625184544-0197|12|4| END| 29.62|B.Pairs found | 0.93|137848|1 2019-06-25 18:46:13,108|MF|app-20190625184544-0197|12|4|START| 29.62|C.Centers found | 0.00| 0|1 2019-06-25 18:46:13,896|MF|app-20190625184544-0197|12|4| END| 30.40|C.Centers found | 0.79|275696|1 2019-06-25 18:46:13,897|MF|app-20190625184544-0197|12|4|START| 30.40|D.Disks found | 0.00| 0|1 2019-06-25 18:46:17,348|MF|app-20190625184544-0197|12|4| END| 33.86|D.Disks found | 3.45|116464|1 2019-06-25 18:46:17,348|MF|app-20190625184544-0197|12|4|START| 33.86|E.Disks partitioned | 0.00| 0|1 2019-06-25 18:46:18,498|MF|app-20190625184544-0197|12|4| END| 35.01|E.Disks partitioned | 1.15|164834|1 2019-06-25 18:46:18,499|MF|app-20190625184544-0197|12|4|START| 35.01|F.Maximal disks found | 0.00| 0|1 2019-06-25 18:46:18,499|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:46:18,499|Cell area: 1055533.7681000116 2019-06-25 18:46:28,240|MF|app-20190625184544-0197|12|4| END| 44.75|F.Maximal disks found | 9.74| 34190|1 2019-06-25 18:46:28,240|MAXIMALS|app-20190625184544-0197|4|12|100.0|3|1800|16.176|34190 2019-06-25 18:46:29,581|FF|app-20190625184544-0197|12|4| END| 46.09|1.Maximal disks found | 17.52| 34190|1 2019-06-25 18:46:29,581|FF|app-20190625184544-0197|12|4|START| 46.09|2.Join done | 0.00| 0|1 2019-06-25 18:46:33,260|FF|app-20190625184544-0197|12|4| END| 49.77|2.Join done | 3.68| 68607|1 2019-06-25 18:46:33,260|FF|app-20190625184544-0197|12|4|START| 49.77|3.Flocks to report | 0.00| 0|1 2019-06-25 18:46:33,794|FF|app-20190625184544-0197|12|4| END| 50.30|3.Flocks to report | 0.53| 0|1 2019-06-25 18:46:33,794|FF|app-20190625184544-0197|12|4|START| 50.30|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 18:46:33,851|FF|app-20190625184544-0197|12|4| END| 50.36|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 18:46:33,851|FF|app-20190625184544-0197|12|4|START| 50.36|5.Flocks reported | 0.00| 0|1 2019-06-25 18:46:33,856|FF|app-20190625184544-0197|12|4| END| 50.36|5.Flocks reported | 0.01| 0|1 2019-06-25 18:46:33,856|FF|app-20190625184544-0197|12|4|START| 50.36|6.Candidates indexed | 0.00| 0|1 2019-06-25 18:46:35,765|FF|app-20190625184544-0197|12|4| END| 52.27|6.Candidates indexed | 1.91| 70591|1 2019-06-25 18:46:35,765|FF|app-20190625184544-0197|12|4|START| 52.27|1.Maximal disks found | 0.00| 0|2 2019-06-25 18:46:35,765|MF|app-20190625184544-0197|12|4|START| 52.27|A.Points indexed | 0.00| 0|2 2019-06-25 18:46:35,878|MF|app-20190625184544-0197|12|4| END| 52.39|A.Points indexed | 0.11| 73576|2 2019-06-25 18:46:35,878|MF|app-20190625184544-0197|12|4|START| 52.39|B.Pairs found | 0.00| 0|2 2019-06-25 18:46:36,633|MF|app-20190625184544-0197|12|4| END| 53.14|B.Pairs found | 0.75|139672|2 2019-06-25 18:46:36,633|MF|app-20190625184544-0197|12|4|START| 53.14|C.Centers found | 0.00| 0|2 2019-06-25 18:46:37,393|MF|app-20190625184544-0197|12|4| END| 53.90|C.Centers found | 0.76|279344|2 2019-06-25 18:46:37,393|MF|app-20190625184544-0197|12|4|START| 53.90|D.Disks found | 0.00| 0|2 2019-06-25 18:46:40,748|MF|app-20190625184544-0197|12|4| END| 57.26|D.Disks found | 3.36|118196|2 2019-06-25 18:46:40,748|MF|app-20190625184544-0197|12|4|START| 57.26|E.Disks partitioned | 0.00| 0|2 2019-06-25 18:46:42,183|MF|app-20190625184544-0197|12|4| END| 58.69|E.Disks partitioned | 1.44|167618|2 2019-06-25 18:46:42,183|MF|app-20190625184544-0197|12|4|START| 58.69|F.Maximal disks found | 0.00| 0|2 2019-06-25 18:46:42,184|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:46:42,184|Cell area: 1055533.7681000116 2019-06-25 18:46:52,290|MF|app-20190625184544-0197|12|4| END| 68.80|F.Maximal disks found | 10.11| 34747|2 2019-06-25 18:46:52,290|MAXIMALS|app-20190625184544-0197|4|12|100.0|3|1800|16.525|34747 2019-06-25 18:46:53,698|FF|app-20190625184544-0197|12|4| END| 70.21|1.Maximal disks found | 17.93| 34747|2 2019-06-25 18:46:53,698|FF|app-20190625184544-0197|12|4|START| 70.21|2.Join done | 0.00| 0|2 2019-06-25 18:47:00,674|FF|app-20190625184544-0197|12|4| END| 77.18|2.Join done | 6.98|130922|2 2019-06-25 18:47:00,674|FF|app-20190625184544-0197|12|4|START| 77.18|3.Flocks to report | 0.00| 0|2 2019-06-25 18:47:01,445|FF|app-20190625184544-0197|12|4| END| 77.95|3.Flocks to report | 0.77|111719|2 2019-06-25 18:47:01,445|FF|app-20190625184544-0197|12|4|START| 77.95|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 18:47:01,505|FF|app-20190625184544-0197|12|4|START| 78.01|4a.Making expansions | 0.00| 0|2 2019-06-25 18:47:02,683|FF|app-20190625184544-0197|12|4| END| 79.19|4a.Making expansions | 1.18|139004|2 2019-06-25 18:47:02,683|FF|app-20190625184544-0197|12|4|START| 79.19|4b.Finding maximals | 0.00| 0|2 2019-06-25 18:47:18,035|FF|app-20190625184544-0197|12|4| END| 94.54|4b.Finding maximals | 15.35| 22788|2 2019-06-25 18:47:18,640|FF|app-20190625184544-0197|12|4| END| 95.15|4.Flocks prunned by expansion | 17.20| 22788|2 2019-06-25 18:47:18,641|FF|app-20190625184544-0197|12|4|START| 95.15|5.Flocks reported | 0.00| 0|2 2019-06-25 18:47:19,401|FF|app-20190625184544-0197|12|4| END| 95.91|5.Flocks reported | 0.76| 22788|2 2019-06-25 18:47:19,401|FF|app-20190625184544-0197|12|4|START| 95.91|6.Candidates indexed | 0.00| 0|2 2019-06-25 18:47:21,635|FF|app-20190625184544-0197|12|4| END| 98.14|6.Candidates indexed | 2.23| 44305|2 2019-06-25 18:47:21,635|FF|app-20190625184544-0197|12|4|START| 98.14|1.Maximal disks found | 0.00| 0|3 2019-06-25 18:47:21,635|MF|app-20190625184544-0197|12|4|START| 98.14|A.Points indexed | 0.00| 0|3 2019-06-25 18:47:21,731|MF|app-20190625184544-0197|12|4| END| 98.24|A.Points indexed | 0.10| 74192|3 2019-06-25 18:47:21,731|MF|app-20190625184544-0197|12|4|START| 98.24|B.Pairs found | 0.00| 0|3 2019-06-25 18:47:22,583|MF|app-20190625184544-0197|12|4| END| 99.09|B.Pairs found | 0.85|142060|3 2019-06-25 18:47:22,583|MF|app-20190625184544-0197|12|4|START| 99.09|C.Centers found | 0.00| 0|3 2019-06-25 18:47:23,390|MF|app-20190625184544-0197|12|4| END| 99.90|C.Centers found | 0.81|284120|3 2019-06-25 18:47:23,390|MF|app-20190625184544-0197|12|4|START| 99.90|D.Disks found | 0.00| 0|3 2019-06-25 18:47:26,612|MF|app-20190625184544-0197|12|4| END|103.12|D.Disks found | 3.22|120568|3 2019-06-25 18:47:26,612|MF|app-20190625184544-0197|12|4|START|103.12|E.Disks partitioned | 0.00| 0|3 2019-06-25 18:47:27,724|MF|app-20190625184544-0197|12|4| END|104.23|E.Disks partitioned | 1.11|171019|3 2019-06-25 18:47:27,724|MF|app-20190625184544-0197|12|4|START|104.23|F.Maximal disks found | 0.00| 0|3 2019-06-25 18:47:27,725|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:47:27,725|Cell area: 1055533.7681000116 2019-06-25 18:47:40,710|MF|app-20190625184544-0197|12|4| END|117.22|F.Maximal disks found | 12.99| 35397|3 2019-06-25 18:47:40,711|MAXIMALS|app-20190625184544-0197|4|12|100.0|3|1800|19.076|35397 2019-06-25 18:47:42,103|FF|app-20190625184544-0197|12|4| END|118.61|1.Maximal disks found | 20.47| 35397|3 2019-06-25 18:47:42,103|FF|app-20190625184544-0197|12|4|START|118.61|2.Join done | 0.00| 0|3 2019-06-25 18:47:46,783|FF|app-20190625184544-0197|12|4| END|123.29|2.Join done | 4.68|120799|3 2019-06-25 18:47:46,784|FF|app-20190625184544-0197|12|4|START|123.29|3.Flocks to report | 0.00| 0|3 2019-06-25 18:47:47,526|FF|app-20190625184544-0197|12|4| END|124.03|3.Flocks to report | 0.74|101395|3 2019-06-25 18:47:47,526|FF|app-20190625184544-0197|12|4|START|124.03|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 18:47:47,632|FF|app-20190625184544-0197|12|4|START|124.14|4a.Making expansions | 0.00| 0|3 2019-06-25 18:47:48,675|FF|app-20190625184544-0197|12|4| END|125.18|4a.Making expansions | 1.04|129159|3 2019-06-25 18:47:48,675|FF|app-20190625184544-0197|12|4|START|125.18|4b.Finding maximals | 0.00| 0|3 2019-06-25 18:48:01,064|FF|app-20190625184544-0197|12|4| END|137.57|4b.Finding maximals | 12.39| 23068|3 2019-06-25 18:48:01,686|FF|app-20190625184544-0197|12|4| END|138.19|4.Flocks prunned by expansion | 14.16| 23068|3 2019-06-25 18:48:01,686|FF|app-20190625184544-0197|12|4|START|138.19|5.Flocks reported | 0.00| 0|3 2019-06-25 18:48:02,528|FF|app-20190625184544-0197|12|4| END|139.04|5.Flocks reported | 0.84| 23068|3 2019-06-25 18:48:02,528|FF|app-20190625184544-0197|12|4|START|139.04|6.Candidates indexed | 0.00| 0|3 2019-06-25 18:48:04,856|FF|app-20190625184544-0197|12|4| END|141.36|6.Candidates indexed | 2.33| 44638|3 2019-06-25 18:48:06,655|Number of flocks: 45856 2019-06-25 18:48:07,941|PFLOCK|app-20190625184544-0197|4|12|100.0|3|3|136.69|45856 2019-06-25 18:48:09,173|FF|app-20190625184544-0197|12|4| END|145.68|Flock Finder run |139.21| 45856|3 2019-06-25 18:48:09,173|FF|app-20190625184544-0197|12|4|START|145.68|Session closed | 0.00| 0|3 2019-06-25 18:48:17,360|FF|app-20190625184544-0197|12|4| END|153.87|Session closed | 8.19| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 6 --fftimestamp 4 --portui 4040 --info 2019-06-25 18:48:19,386|FF|app-00000000000000-0000|6|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 18:48:20,489|FF|app-20190625184820-0198|6|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 18:48:20,489|FF|app-20190625184820-0198|6|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 18:48:24,454|FF|app-20190625184820-0198|6|4| END| 5.05|Data read | 3.97|220752|-1 2019-06-25 18:48:24,454|FF|app-20190625184820-0198|6|4|START| 5.05|KDBTree partitioner | 0.00| 0|-1 2019-06-25 18:48:24,584|FF|app-20190625184820-0198|6|4| END| 5.18|KDBTree partitioner | 0.13| 544|-1 2019-06-25 18:48:24,585|FF|app-20190625184820-0198|6|4|START| 5.18|MF partitioner | 0.00| 0|-1 2019-06-25 18:48:24,603|FF|app-20190625184820-0198|6|4| END| 5.20|MF partitioner | 0.02| 900|-1 2019-06-25 18:48:24,603|FF|app-20190625184820-0198|6|4|START| 5.20|Pointset done | 0.00| 0|-1 2019-06-25 18:48:25,580|FF|app-20190625184820-0198|6|4| END| 6.18|Pointset done | 0.98| 4|-1 2019-06-25 18:48:25,580|FF|app-20190625184820-0198|6|4|START| 6.18|Flock Finder run | 0.00| 0|-1 2019-06-25 18:48:25,597|FF|app-20190625184820-0198|6|4|START| 6.19|1.Maximal disks found | 0.00| 0|0 2019-06-25 18:48:25,599|MF|app-20190625184820-0198|6|4|START| 6.20|A.Points indexed | 0.00| 0|0 2019-06-25 18:48:25,760|MF|app-20190625184820-0198|6|4| END| 6.36|A.Points indexed | 0.16| 36186|0 2019-06-25 18:48:25,760|MF|app-20190625184820-0198|6|4|START| 6.36|B.Pairs found | 0.00| 0|0 2019-06-25 18:48:27,188|MF|app-20190625184820-0198|6|4| END| 7.79|B.Pairs found | 1.43| 67914|0 2019-06-25 18:48:27,188|MF|app-20190625184820-0198|6|4|START| 7.79|C.Centers found | 0.00| 0|0 2019-06-25 18:48:28,098|MF|app-20190625184820-0198|6|4| END| 8.70|C.Centers found | 0.91|135828|0 2019-06-25 18:48:28,098|MF|app-20190625184820-0198|6|4|START| 8.70|D.Disks found | 0.00| 0|0 2019-06-25 18:48:33,596|MF|app-20190625184820-0198|6|4| END| 14.19|D.Disks found | 5.50| 57332|0 2019-06-25 18:48:33,596|MF|app-20190625184820-0198|6|4|START| 14.19|E.Disks partitioned | 0.00| 0|0 2019-06-25 18:48:37,510|MF|app-20190625184820-0198|6|4| END| 18.11|E.Disks partitioned | 3.91| 81114|0 2019-06-25 18:48:37,510|MF|app-20190625184820-0198|6|4|START| 18.11|F.Maximal disks found | 0.00| 0|0 2019-06-25 18:48:37,512|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:48:37,512|Cell area: 1055533.7681000116 2019-06-25 18:48:50,410|MF|app-20190625184820-0198|6|4| END| 31.01|F.Maximal disks found | 12.90| 16742|0 2019-06-25 18:48:50,410|MAXIMALS|app-20190625184820-0198|4|6|100.0|3|900|24.811|16742 2019-06-25 18:48:51,970|FF|app-20190625184820-0198|6|4| END| 32.57|1.Maximal disks found | 26.37| 16742|0 2019-06-25 18:48:51,970|FF|app-20190625184820-0198|6|4|START| 32.57|1.Maximal disks found | 0.00| 0|1 2019-06-25 18:48:51,970|MF|app-20190625184820-0198|6|4|START| 32.57|A.Points indexed | 0.00| 0|1 2019-06-25 18:48:52,044|MF|app-20190625184820-0198|6|4| END| 32.64|A.Points indexed | 0.07| 36490|1 2019-06-25 18:48:52,044|MF|app-20190625184820-0198|6|4|START| 32.64|B.Pairs found | 0.00| 0|1 2019-06-25 18:48:52,963|MF|app-20190625184820-0198|6|4| END| 33.56|B.Pairs found | 0.92| 68924|1 2019-06-25 18:48:52,963|MF|app-20190625184820-0198|6|4|START| 33.56|C.Centers found | 0.00| 0|1 2019-06-25 18:48:53,808|MF|app-20190625184820-0198|6|4| END| 34.41|C.Centers found | 0.85|137848|1 2019-06-25 18:48:53,808|MF|app-20190625184820-0198|6|4|START| 34.41|D.Disks found | 0.00| 0|1 2019-06-25 18:48:58,091|MF|app-20190625184820-0198|6|4| END| 38.69|D.Disks found | 4.28| 58232|1 2019-06-25 18:48:58,091|MF|app-20190625184820-0198|6|4|START| 38.69|E.Disks partitioned | 0.00| 0|1 2019-06-25 18:48:59,983|MF|app-20190625184820-0198|6|4| END| 40.58|E.Disks partitioned | 1.89| 82341|1 2019-06-25 18:48:59,983|MF|app-20190625184820-0198|6|4|START| 40.58|F.Maximal disks found | 0.00| 0|1 2019-06-25 18:48:59,984|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:48:59,984|Cell area: 1055533.7681000116 2019-06-25 18:49:10,179|MF|app-20190625184820-0198|6|4| END| 50.78|F.Maximal disks found | 10.20| 17096|1 2019-06-25 18:49:10,179|MAXIMALS|app-20190625184820-0198|4|6|100.0|3|900|18.209|17096 2019-06-25 18:49:11,122|FF|app-20190625184820-0198|6|4| END| 51.72|1.Maximal disks found | 19.15| 17096|1 2019-06-25 18:49:11,122|FF|app-20190625184820-0198|6|4|START| 51.72|2.Join done | 0.00| 0|1 2019-06-25 18:49:16,124|FF|app-20190625184820-0198|6|4| END| 56.72|2.Join done | 5.00| 34283|1 2019-06-25 18:49:16,124|FF|app-20190625184820-0198|6|4|START| 56.72|3.Flocks to report | 0.00| 0|1 2019-06-25 18:49:16,868|FF|app-20190625184820-0198|6|4| END| 57.47|3.Flocks to report | 0.74| 0|1 2019-06-25 18:49:16,869|FF|app-20190625184820-0198|6|4|START| 57.47|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 18:49:16,911|FF|app-20190625184820-0198|6|4| END| 57.51|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 18:49:16,911|FF|app-20190625184820-0198|6|4|START| 57.51|5.Flocks reported | 0.00| 0|1 2019-06-25 18:49:16,916|FF|app-20190625184820-0198|6|4| END| 57.51|5.Flocks reported | 0.01| 0|1 2019-06-25 18:49:16,916|FF|app-20190625184820-0198|6|4|START| 57.51|6.Candidates indexed | 0.00| 0|1 2019-06-25 18:49:20,352|FF|app-20190625184820-0198|6|4| END| 60.95|6.Candidates indexed | 3.44| 35275|1 2019-06-25 18:49:20,352|FF|app-20190625184820-0198|6|4|START| 60.95|1.Maximal disks found | 0.00| 0|2 2019-06-25 18:49:20,352|MF|app-20190625184820-0198|6|4|START| 60.95|A.Points indexed | 0.00| 0|2 2019-06-25 18:49:20,422|MF|app-20190625184820-0198|6|4| END| 61.02|A.Points indexed | 0.07| 36788|2 2019-06-25 18:49:20,422|MF|app-20190625184820-0198|6|4|START| 61.02|B.Pairs found | 0.00| 0|2 2019-06-25 18:49:21,197|MF|app-20190625184820-0198|6|4| END| 61.79|B.Pairs found | 0.78| 69836|2 2019-06-25 18:49:21,198|MF|app-20190625184820-0198|6|4|START| 61.80|C.Centers found | 0.00| 0|2 2019-06-25 18:49:21,947|MF|app-20190625184820-0198|6|4| END| 62.54|C.Centers found | 0.75|139672|2 2019-06-25 18:49:21,948|MF|app-20190625184820-0198|6|4|START| 62.55|D.Disks found | 0.00| 0|2 2019-06-25 18:49:25,726|MF|app-20190625184820-0198|6|4| END| 66.32|D.Disks found | 3.78| 59098|2 2019-06-25 18:49:25,726|MF|app-20190625184820-0198|6|4|START| 66.32|E.Disks partitioned | 0.00| 0|2 2019-06-25 18:49:27,564|MF|app-20190625184820-0198|6|4| END| 68.16|E.Disks partitioned | 1.84| 83724|2 2019-06-25 18:49:27,565|MF|app-20190625184820-0198|6|4|START| 68.16|F.Maximal disks found | 0.00| 0|2 2019-06-25 18:49:27,565|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:49:27,565|Cell area: 1055533.7681000116 2019-06-25 18:49:38,408|MF|app-20190625184820-0198|6|4| END| 79.01|F.Maximal disks found | 10.84| 17376|2 2019-06-25 18:49:38,408|MAXIMALS|app-20190625184820-0198|4|6|100.0|3|900|18.056|17376 2019-06-25 18:49:39,276|FF|app-20190625184820-0198|6|4| END| 79.87|1.Maximal disks found | 18.92| 17376|2 2019-06-25 18:49:39,276|FF|app-20190625184820-0198|6|4|START| 79.87|2.Join done | 0.00| 0|2 2019-06-25 18:49:49,733|FF|app-20190625184820-0198|6|4| END| 90.33|2.Join done | 10.46| 65351|2 2019-06-25 18:49:49,733|FF|app-20190625184820-0198|6|4|START| 90.33|3.Flocks to report | 0.00| 0|2 2019-06-25 18:49:51,153|FF|app-20190625184820-0198|6|4| END| 91.75|3.Flocks to report | 1.42| 55754|2 2019-06-25 18:49:51,153|FF|app-20190625184820-0198|6|4|START| 91.75|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 18:49:51,195|FF|app-20190625184820-0198|6|4|START| 91.79|4a.Making expansions | 0.00| 0|2 2019-06-25 18:49:52,356|FF|app-20190625184820-0198|6|4| END| 92.95|4a.Making expansions | 1.16| 69253|2 2019-06-25 18:49:52,356|FF|app-20190625184820-0198|6|4|START| 92.95|4b.Finding maximals | 0.00| 0|2 2019-06-25 18:50:07,096|FF|app-20190625184820-0198|6|4| END|107.69|4b.Finding maximals | 14.74| 11394|2 2019-06-25 18:50:07,465|FF|app-20190625184820-0198|6|4| END|108.06|4.Flocks prunned by expansion | 16.31| 11394|2 2019-06-25 18:50:07,465|FF|app-20190625184820-0198|6|4|START|108.06|5.Flocks reported | 0.00| 0|2 2019-06-25 18:50:08,011|FF|app-20190625184820-0198|6|4| END|108.61|5.Flocks reported | 0.55| 11394|2 2019-06-25 18:50:08,011|FF|app-20190625184820-0198|6|4|START|108.61|6.Candidates indexed | 0.00| 0|2 2019-06-25 18:50:11,053|FF|app-20190625184820-0198|6|4| END|111.65|6.Candidates indexed | 3.04| 22156|2 2019-06-25 18:50:11,053|FF|app-20190625184820-0198|6|4|START|111.65|1.Maximal disks found | 0.00| 0|3 2019-06-25 18:50:11,054|MF|app-20190625184820-0198|6|4|START|111.65|A.Points indexed | 0.00| 0|3 2019-06-25 18:50:11,120|MF|app-20190625184820-0198|6|4| END|111.72|A.Points indexed | 0.07| 37096|3 2019-06-25 18:50:11,120|MF|app-20190625184820-0198|6|4|START|111.72|B.Pairs found | 0.00| 0|3 2019-06-25 18:50:11,847|MF|app-20190625184820-0198|6|4| END|112.44|B.Pairs found | 0.73| 71030|3 2019-06-25 18:50:11,848|MF|app-20190625184820-0198|6|4|START|112.45|C.Centers found | 0.00| 0|3 2019-06-25 18:50:12,629|MF|app-20190625184820-0198|6|4| END|113.23|C.Centers found | 0.78|142060|3 2019-06-25 18:50:12,629|MF|app-20190625184820-0198|6|4|START|113.23|D.Disks found | 0.00| 0|3 2019-06-25 18:50:16,499|MF|app-20190625184820-0198|6|4| END|117.10|D.Disks found | 3.87| 60284|3 2019-06-25 18:50:16,499|MF|app-20190625184820-0198|6|4|START|117.10|E.Disks partitioned | 0.00| 0|3 2019-06-25 18:50:18,392|MF|app-20190625184820-0198|6|4| END|118.99|E.Disks partitioned | 1.89| 85409|3 2019-06-25 18:50:18,393|MF|app-20190625184820-0198|6|4|START|118.99|F.Maximal disks found | 0.00| 0|3 2019-06-25 18:50:18,393|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:50:18,393|Cell area: 1055533.7681000116 2019-06-25 18:50:30,927|MF|app-20190625184820-0198|6|4| END|131.52|F.Maximal disks found | 12.53| 17693|3 2019-06-25 18:50:30,927|MAXIMALS|app-20190625184820-0198|4|6|100.0|3|900|19.873|17693 2019-06-25 18:50:31,827|FF|app-20190625184820-0198|6|4| END|132.42|1.Maximal disks found | 20.77| 17693|3 2019-06-25 18:50:31,827|FF|app-20190625184820-0198|6|4|START|132.42|2.Join done | 0.00| 0|3 2019-06-25 18:50:38,776|FF|app-20190625184820-0198|6|4| END|139.37|2.Join done | 6.95| 60353|3 2019-06-25 18:50:38,776|FF|app-20190625184820-0198|6|4|START|139.37|3.Flocks to report | 0.00| 0|3 2019-06-25 18:50:40,148|FF|app-20190625184820-0198|6|4| END|140.75|3.Flocks to report | 1.37| 50617|3 2019-06-25 18:50:40,148|FF|app-20190625184820-0198|6|4|START|140.75|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 18:50:40,194|FF|app-20190625184820-0198|6|4|START|140.79|4a.Making expansions | 0.00| 0|3 2019-06-25 18:50:41,395|FF|app-20190625184820-0198|6|4| END|141.99|4a.Making expansions | 1.20| 64403|3 2019-06-25 18:50:41,395|FF|app-20190625184820-0198|6|4|START|141.99|4b.Finding maximals | 0.00| 0|3 2019-06-25 18:50:51,774|FF|app-20190625184820-0198|6|4| END|152.37|4b.Finding maximals | 10.38| 11534|3 2019-06-25 18:50:52,167|FF|app-20190625184820-0198|6|4| END|152.76|4.Flocks prunned by expansion | 12.02| 11534|3 2019-06-25 18:50:52,167|FF|app-20190625184820-0198|6|4|START|152.76|5.Flocks reported | 0.00| 0|3 2019-06-25 18:50:52,720|FF|app-20190625184820-0198|6|4| END|153.32|5.Flocks reported | 0.55| 11534|3 2019-06-25 18:50:52,720|FF|app-20190625184820-0198|6|4|START|153.32|6.Candidates indexed | 0.00| 0|3 2019-06-25 18:50:55,330|FF|app-20190625184820-0198|6|4| END|155.93|6.Candidates indexed | 2.61| 22352|3 2019-06-25 18:50:56,671|Number of flocks: 22928 2019-06-25 18:50:57,457|PFLOCK|app-20190625184820-0198|4|6|100.0|3|3|151.09|22928 2019-06-25 18:50:58,317|FF|app-20190625184820-0198|6|4| END|158.91|Flock Finder run |152.74| 22928|3 2019-06-25 18:50:58,317|FF|app-20190625184820-0198|6|4|START|158.91|Session closed | 0.00| 0|3 2019-06-25 18:51:04,952|FF|app-20190625184820-0198|6|4| END|165.55|Session closed | 6.64| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 3 --fftimestamp 4 --portui 4040 --info 2019-06-25 18:51:06,985|FF|app-00000000000000-0000|3|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 18:51:08,134|FF|app-20190625185107-0199|3|4| END| 1.13|Session start | 1.15| 0|-1 2019-06-25 18:51:08,135|FF|app-20190625185107-0199|3|4|START| 1.13|Data read | 0.00| 0|-1 2019-06-25 18:51:11,902|FF|app-20190625185107-0199|3|4| END| 4.90|Data read | 3.77|110376|-1 2019-06-25 18:51:11,902|FF|app-20190625185107-0199|3|4|START| 4.90|KDBTree partitioner | 0.00| 0|-1 2019-06-25 18:51:12,030|FF|app-20190625185107-0199|3|4| END| 5.03|KDBTree partitioner | 0.13| 272|-1 2019-06-25 18:51:12,031|FF|app-20190625185107-0199|3|4|START| 5.03|MF partitioner | 0.00| 0|-1 2019-06-25 18:51:12,046|FF|app-20190625185107-0199|3|4| END| 5.04|MF partitioner | 0.02| 450|-1 2019-06-25 18:51:12,046|FF|app-20190625185107-0199|3|4|START| 5.04|Pointset done | 0.00| 0|-1 2019-06-25 18:51:12,781|FF|app-20190625185107-0199|3|4| END| 5.78|Pointset done | 0.73| 4|-1 2019-06-25 18:51:12,781|FF|app-20190625185107-0199|3|4|START| 5.78|Flock Finder run | 0.00| 0|-1 2019-06-25 18:51:12,798|FF|app-20190625185107-0199|3|4|START| 5.80|1.Maximal disks found | 0.00| 0|0 2019-06-25 18:51:12,800|MF|app-20190625185107-0199|3|4|START| 5.80|A.Points indexed | 0.00| 0|0 2019-06-25 18:51:12,938|MF|app-20190625185107-0199|3|4| END| 5.94|A.Points indexed | 0.14| 18093|0 2019-06-25 18:51:12,938|MF|app-20190625185107-0199|3|4|START| 5.94|B.Pairs found | 0.00| 0|0 2019-06-25 18:51:14,369|MF|app-20190625185107-0199|3|4| END| 7.37|B.Pairs found | 1.43| 33957|0 2019-06-25 18:51:14,370|MF|app-20190625185107-0199|3|4|START| 7.37|C.Centers found | 0.00| 0|0 2019-06-25 18:51:15,226|MF|app-20190625185107-0199|3|4| END| 8.22|C.Centers found | 0.86| 67914|0 2019-06-25 18:51:15,226|MF|app-20190625185107-0199|3|4|START| 8.22|D.Disks found | 0.00| 0|0 2019-06-25 18:51:18,333|MF|app-20190625185107-0199|3|4| END| 11.33|D.Disks found | 3.11| 28666|0 2019-06-25 18:51:18,333|MF|app-20190625185107-0199|3|4|START| 11.33|E.Disks partitioned | 0.00| 0|0 2019-06-25 18:51:19,232|MF|app-20190625185107-0199|3|4| END| 12.23|E.Disks partitioned | 0.90| 40550|0 2019-06-25 18:51:19,232|MF|app-20190625185107-0199|3|4|START| 12.23|F.Maximal disks found | 0.00| 0|0 2019-06-25 18:51:19,234|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:51:19,234|Cell area: 1055533.7681000116 2019-06-25 18:51:29,764|MF|app-20190625185107-0199|3|4| END| 22.76|F.Maximal disks found | 10.53| 8371|0 2019-06-25 18:51:29,764|MAXIMALS|app-20190625185107-0199|4|3|100.0|3|450|16.964|8371 2019-06-25 18:51:30,284|FF|app-20190625185107-0199|3|4| END| 23.28|1.Maximal disks found | 17.49| 8371|0 2019-06-25 18:51:30,284|FF|app-20190625185107-0199|3|4|START| 23.28|1.Maximal disks found | 0.00| 0|1 2019-06-25 18:51:30,285|MF|app-20190625185107-0199|3|4|START| 23.28|A.Points indexed | 0.00| 0|1 2019-06-25 18:51:30,351|MF|app-20190625185107-0199|3|4| END| 23.35|A.Points indexed | 0.07| 18245|1 2019-06-25 18:51:30,351|MF|app-20190625185107-0199|3|4|START| 23.35|B.Pairs found | 0.00| 0|1 2019-06-25 18:51:30,823|MF|app-20190625185107-0199|3|4| END| 23.82|B.Pairs found | 0.47| 34462|1 2019-06-25 18:51:30,823|MF|app-20190625185107-0199|3|4|START| 23.82|C.Centers found | 0.00| 0|1 2019-06-25 18:51:31,353|MF|app-20190625185107-0199|3|4| END| 24.35|C.Centers found | 0.53| 68924|1 2019-06-25 18:51:31,353|MF|app-20190625185107-0199|3|4|START| 24.35|D.Disks found | 0.00| 0|1 2019-06-25 18:51:33,581|MF|app-20190625185107-0199|3|4| END| 26.58|D.Disks found | 2.23| 29116|1 2019-06-25 18:51:33,581|MF|app-20190625185107-0199|3|4|START| 26.58|E.Disks partitioned | 0.00| 0|1 2019-06-25 18:51:34,313|MF|app-20190625185107-0199|3|4| END| 27.31|E.Disks partitioned | 0.73| 41162|1 2019-06-25 18:51:34,313|MF|app-20190625185107-0199|3|4|START| 27.31|F.Maximal disks found | 0.00| 0|1 2019-06-25 18:51:34,314|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:51:34,314|Cell area: 1055533.7681000116 2019-06-25 18:51:44,056|MF|app-20190625185107-0199|3|4| END| 37.05|F.Maximal disks found | 9.74| 8547|1 2019-06-25 18:51:44,056|MAXIMALS|app-20190625185107-0199|4|3|100.0|3|450|13.772|8547 2019-06-25 18:51:44,466|FF|app-20190625185107-0199|3|4| END| 37.46|1.Maximal disks found | 14.18| 8547|1 2019-06-25 18:51:44,466|FF|app-20190625185107-0199|3|4|START| 37.46|2.Join done | 0.00| 0|1 2019-06-25 18:51:46,704|FF|app-20190625185107-0199|3|4| END| 39.70|2.Join done | 2.24| 17137|1 2019-06-25 18:51:46,705|FF|app-20190625185107-0199|3|4|START| 39.70|3.Flocks to report | 0.00| 0|1 2019-06-25 18:51:47,095|FF|app-20190625185107-0199|3|4| END| 40.09|3.Flocks to report | 0.39| 0|1 2019-06-25 18:51:47,095|FF|app-20190625185107-0199|3|4|START| 40.09|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 18:51:47,128|FF|app-20190625185107-0199|3|4| END| 40.13|4.Flocks prunned by expansion | 0.03| 0|1 2019-06-25 18:51:47,128|FF|app-20190625185107-0199|3|4|START| 40.13|5.Flocks reported | 0.00| 0|1 2019-06-25 18:51:47,133|FF|app-20190625185107-0199|3|4| END| 40.13|5.Flocks reported | 0.01| 0|1 2019-06-25 18:51:47,133|FF|app-20190625185107-0199|3|4|START| 40.13|6.Candidates indexed | 0.00| 0|1 2019-06-25 18:51:48,575|FF|app-20190625185107-0199|3|4| END| 41.57|6.Candidates indexed | 1.44| 17633|1 2019-06-25 18:51:48,575|FF|app-20190625185107-0199|3|4|START| 41.57|1.Maximal disks found | 0.00| 0|2 2019-06-25 18:51:48,575|MF|app-20190625185107-0199|3|4|START| 41.57|A.Points indexed | 0.00| 0|2 2019-06-25 18:51:48,647|MF|app-20190625185107-0199|3|4| END| 41.65|A.Points indexed | 0.07| 18394|2 2019-06-25 18:51:48,647|MF|app-20190625185107-0199|3|4|START| 41.65|B.Pairs found | 0.00| 0|2 2019-06-25 18:51:49,112|MF|app-20190625185107-0199|3|4| END| 42.11|B.Pairs found | 0.47| 34918|2 2019-06-25 18:51:49,113|MF|app-20190625185107-0199|3|4|START| 42.11|C.Centers found | 0.00| 0|2 2019-06-25 18:51:49,551|MF|app-20190625185107-0199|3|4| END| 42.55|C.Centers found | 0.44| 69836|2 2019-06-25 18:51:49,551|MF|app-20190625185107-0199|3|4|START| 42.55|D.Disks found | 0.00| 0|2 2019-06-25 18:51:51,687|MF|app-20190625185107-0199|3|4| END| 44.69|D.Disks found | 2.14| 29549|2 2019-06-25 18:51:51,688|MF|app-20190625185107-0199|3|4|START| 44.69|E.Disks partitioned | 0.00| 0|2 2019-06-25 18:51:52,345|MF|app-20190625185107-0199|3|4| END| 45.34|E.Disks partitioned | 0.66| 41840|2 2019-06-25 18:51:52,345|MF|app-20190625185107-0199|3|4|START| 45.34|F.Maximal disks found | 0.00| 0|2 2019-06-25 18:51:52,346|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:51:52,346|Cell area: 1055533.7681000116 2019-06-25 18:52:02,043|MF|app-20190625185107-0199|3|4| END| 55.04|F.Maximal disks found | 9.70| 8685|2 2019-06-25 18:52:02,043|MAXIMALS|app-20190625185107-0199|4|3|100.0|3|450|13.468|8685 2019-06-25 18:52:02,448|FF|app-20190625185107-0199|3|4| END| 55.45|1.Maximal disks found | 13.87| 8685|2 2019-06-25 18:52:02,448|FF|app-20190625185107-0199|3|4|START| 55.45|2.Join done | 0.00| 0|2 2019-06-25 18:52:11,729|FF|app-20190625185107-0199|3|4| END| 64.73|2.Join done | 9.28| 32678|2 2019-06-25 18:52:11,729|FF|app-20190625185107-0199|3|4|START| 64.73|3.Flocks to report | 0.00| 0|2 2019-06-25 18:52:13,230|FF|app-20190625185107-0199|3|4| END| 66.23|3.Flocks to report | 1.50| 27879|2 2019-06-25 18:52:13,231|FF|app-20190625185107-0199|3|4|START| 66.23|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 18:52:13,270|FF|app-20190625185107-0199|3|4|START| 66.27|4a.Making expansions | 0.00| 0|2 2019-06-25 18:52:14,261|FF|app-20190625185107-0199|3|4| END| 67.26|4a.Making expansions | 0.99| 34776|2 2019-06-25 18:52:14,261|FF|app-20190625185107-0199|3|4|START| 67.26|4b.Finding maximals | 0.00| 0|2 2019-06-25 18:52:27,354|FF|app-20190625185107-0199|3|4| END| 80.35|4b.Finding maximals | 13.09| 5697|2 2019-06-25 18:52:27,675|FF|app-20190625185107-0199|3|4| END| 80.67|4.Flocks prunned by expansion | 14.44| 5697|2 2019-06-25 18:52:27,675|FF|app-20190625185107-0199|3|4|START| 80.67|5.Flocks reported | 0.00| 0|2 2019-06-25 18:52:28,157|FF|app-20190625185107-0199|3|4| END| 81.16|5.Flocks reported | 0.48| 5697|2 2019-06-25 18:52:28,157|FF|app-20190625185107-0199|3|4|START| 81.16|6.Candidates indexed | 0.00| 0|2 2019-06-25 18:52:30,923|FF|app-20190625185107-0199|3|4| END| 83.92|6.Candidates indexed | 2.77| 11079|2 2019-06-25 18:52:30,923|FF|app-20190625185107-0199|3|4|START| 83.92|1.Maximal disks found | 0.00| 0|3 2019-06-25 18:52:30,923|MF|app-20190625185107-0199|3|4|START| 83.92|A.Points indexed | 0.00| 0|3 2019-06-25 18:52:30,973|MF|app-20190625185107-0199|3|4| END| 83.97|A.Points indexed | 0.05| 18548|3 2019-06-25 18:52:30,973|MF|app-20190625185107-0199|3|4|START| 83.97|B.Pairs found | 0.00| 0|3 2019-06-25 18:52:32,107|MF|app-20190625185107-0199|3|4| END| 85.11|B.Pairs found | 1.13| 35515|3 2019-06-25 18:52:32,107|MF|app-20190625185107-0199|3|4|START| 85.11|C.Centers found | 0.00| 0|3 2019-06-25 18:52:32,829|MF|app-20190625185107-0199|3|4| END| 85.83|C.Centers found | 0.72| 71030|3 2019-06-25 18:52:32,829|MF|app-20190625185107-0199|3|4|START| 85.83|D.Disks found | 0.00| 0|3 2019-06-25 18:52:37,172|MF|app-20190625185107-0199|3|4| END| 90.17|D.Disks found | 4.34| 30142|3 2019-06-25 18:52:37,172|MF|app-20190625185107-0199|3|4|START| 90.17|E.Disks partitioned | 0.00| 0|3 2019-06-25 18:52:38,632|MF|app-20190625185107-0199|3|4| END| 91.63|E.Disks partitioned | 1.46| 42665|3 2019-06-25 18:52:38,632|MF|app-20190625185107-0199|3|4|START| 91.63|F.Maximal disks found | 0.00| 0|3 2019-06-25 18:52:38,632|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:52:38,632|Cell area: 1055533.7681000116 2019-06-25 18:52:50,392|MF|app-20190625185107-0199|3|4| END|103.39|F.Maximal disks found | 11.76| 8846|3 2019-06-25 18:52:50,392|MAXIMALS|app-20190625185107-0199|4|3|100.0|3|450|19.469|8846 2019-06-25 18:52:51,062|FF|app-20190625185107-0199|3|4| END|104.06|1.Maximal disks found | 20.14| 8846|3 2019-06-25 18:52:51,062|FF|app-20190625185107-0199|3|4|START|104.06|2.Join done | 0.00| 0|3 2019-06-25 18:52:57,403|FF|app-20190625185107-0199|3|4| END|110.40|2.Join done | 6.34| 30190|3 2019-06-25 18:52:57,404|FF|app-20190625185107-0199|3|4|START|110.40|3.Flocks to report | 0.00| 0|3 2019-06-25 18:52:58,741|FF|app-20190625185107-0199|3|4| END|111.74|3.Flocks to report | 1.34| 25328|3 2019-06-25 18:52:58,741|FF|app-20190625185107-0199|3|4|START|111.74|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 18:52:58,793|FF|app-20190625185107-0199|3|4|START|111.79|4a.Making expansions | 0.00| 0|3 2019-06-25 18:52:59,786|FF|app-20190625185107-0199|3|4| END|112.78|4a.Making expansions | 0.99| 32168|3 2019-06-25 18:52:59,786|FF|app-20190625185107-0199|3|4|START|112.78|4b.Finding maximals | 0.00| 0|3 2019-06-25 18:53:10,775|FF|app-20190625185107-0199|3|4| END|123.77|4b.Finding maximals | 10.99| 5767|3 2019-06-25 18:53:11,115|FF|app-20190625185107-0199|3|4| END|124.11|4.Flocks prunned by expansion | 12.37| 5767|3 2019-06-25 18:53:11,115|FF|app-20190625185107-0199|3|4|START|124.11|5.Flocks reported | 0.00| 0|3 2019-06-25 18:53:11,572|FF|app-20190625185107-0199|3|4| END|124.57|5.Flocks reported | 0.46| 5767|3 2019-06-25 18:53:11,572|FF|app-20190625185107-0199|3|4|START|124.57|6.Candidates indexed | 0.00| 0|3 2019-06-25 18:53:14,415|FF|app-20190625185107-0199|3|4| END|127.41|6.Candidates indexed | 2.84| 11171|3 2019-06-25 18:53:15,487|Number of flocks: 11464 2019-06-25 18:53:16,044|PFLOCK|app-20190625185107-0199|4|3|100.0|3|3|122.71|11464 2019-06-25 18:53:16,586|FF|app-20190625185107-0199|3|4| END|129.58|Flock Finder run |123.81| 11464|3 2019-06-25 18:53:16,586|FF|app-20190625185107-0199|3|4|START|129.58|Session closed | 0.00| 0|3 2019-06-25 18:53:23,783|FF|app-20190625185107-0199|3|4| END|136.78|Session closed | 7.20| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B4_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_grid-60x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 12 --fftimestamp 4 --portui 4040 --info 2019-06-25 18:53:25,762|FF|app-00000000000000-0000|12|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 18:53:26,889|FF|app-20190625185326-0200|12|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 18:53:26,889|FF|app-20190625185326-0200|12|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 18:53:31,211|FF|app-20190625185326-0200|12|4| END| 5.43|Data read | 4.32|441504|-1 2019-06-25 18:53:31,211|FF|app-20190625185326-0200|12|4|START| 5.43|KDBTree partitioner | 0.00| 0|-1 2019-06-25 18:53:31,478|FF|app-20190625185326-0200|12|4| END| 5.70|KDBTree partitioner | 0.27| 1088|-1 2019-06-25 18:53:31,478|FF|app-20190625185326-0200|12|4|START| 5.70|MF partitioner | 0.00| 0|-1 2019-06-25 18:53:31,505|FF|app-20190625185326-0200|12|4| END| 5.73|MF partitioner | 0.03| 1800|-1 2019-06-25 18:53:31,505|FF|app-20190625185326-0200|12|4|START| 5.73|Pointset done | 0.00| 0|-1 2019-06-25 18:53:32,401|FF|app-20190625185326-0200|12|4| END| 6.62|Pointset done | 0.90| 4|-1 2019-06-25 18:53:32,401|FF|app-20190625185326-0200|12|4|START| 6.62|Flock Finder run | 0.00| 0|-1 2019-06-25 18:53:32,419|FF|app-20190625185326-0200|12|4|START| 6.64|1.Maximal disks found | 0.00| 0|0 2019-06-25 18:53:32,422|MF|app-20190625185326-0200|12|4|START| 6.64|A.Points indexed | 0.00| 0|0 2019-06-25 18:53:32,611|MF|app-20190625185326-0200|12|4| END| 6.83|A.Points indexed | 0.19| 72372|0 2019-06-25 18:53:32,612|MF|app-20190625185326-0200|12|4|START| 6.83|B.Pairs found | 0.00| 0|0 2019-06-25 18:53:34,408|MF|app-20190625185326-0200|12|4| END| 8.63|B.Pairs found | 1.80|157616|0 2019-06-25 18:53:34,409|MF|app-20190625185326-0200|12|4|START| 8.63|C.Centers found | 0.00| 0|0 2019-06-25 18:53:35,675|MF|app-20190625185326-0200|12|4| END| 9.90|C.Centers found | 1.27|315232|0 2019-06-25 18:53:35,676|MF|app-20190625185326-0200|12|4|START| 9.90|D.Disks found | 0.00| 0|0 2019-06-25 18:53:40,511|MF|app-20190625185326-0200|12|4| END| 14.73|D.Disks found | 4.84|140916|0 2019-06-25 18:53:40,511|MF|app-20190625185326-0200|12|4|START| 14.73|E.Disks partitioned | 0.00| 0|0 2019-06-25 18:53:42,281|MF|app-20190625185326-0200|12|4| END| 16.50|E.Disks partitioned | 1.77|206209|0 2019-06-25 18:53:42,281|MF|app-20190625185326-0200|12|4|START| 16.50|F.Maximal disks found | 0.00| 0|0 2019-06-25 18:53:42,283|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:53:42,283|Cell area: 1055533.7681000116 2019-06-25 18:54:09,671|MF|app-20190625185326-0200|12|4| END| 43.89|F.Maximal disks found | 27.39| 40009|0 2019-06-25 18:54:09,671|MAXIMALS|app-20190625185326-0200|4|12|110.0|3|1800|37.249|40009 2019-06-25 18:54:11,063|FF|app-20190625185326-0200|12|4| END| 45.28|1.Maximal disks found | 38.64| 40009|0 2019-06-25 18:54:11,064|FF|app-20190625185326-0200|12|4|START| 45.28|1.Maximal disks found | 0.00| 0|1 2019-06-25 18:54:11,064|MF|app-20190625185326-0200|12|4|START| 45.28|A.Points indexed | 0.00| 0|1 2019-06-25 18:54:11,174|MF|app-20190625185326-0200|12|4| END| 45.39|A.Points indexed | 0.11| 72980|1 2019-06-25 18:54:11,174|MF|app-20190625185326-0200|12|4|START| 45.39|B.Pairs found | 0.00| 0|1 2019-06-25 18:54:11,967|MF|app-20190625185326-0200|12|4| END| 46.19|B.Pairs found | 0.79|159996|1 2019-06-25 18:54:11,967|MF|app-20190625185326-0200|12|4|START| 46.19|C.Centers found | 0.00| 0|1 2019-06-25 18:54:12,786|MF|app-20190625185326-0200|12|4| END| 47.01|C.Centers found | 0.82|319992|1 2019-06-25 18:54:12,786|MF|app-20190625185326-0200|12|4|START| 47.01|D.Disks found | 0.00| 0|1 2019-06-25 18:54:16,246|MF|app-20190625185326-0200|12|4| END| 50.47|D.Disks found | 3.46|143396|1 2019-06-25 18:54:16,246|MF|app-20190625185326-0200|12|4|START| 50.47|E.Disks partitioned | 0.00| 0|1 2019-06-25 18:54:17,635|MF|app-20190625185326-0200|12|4| END| 51.85|E.Disks partitioned | 1.39|209660|1 2019-06-25 18:54:17,635|MF|app-20190625185326-0200|12|4|START| 51.86|F.Maximal disks found | 0.00| 0|1 2019-06-25 18:54:17,636|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:54:17,636|Cell area: 1055533.7681000116 2019-06-25 18:54:45,798|MF|app-20190625185326-0200|12|4| END| 80.02|F.Maximal disks found | 28.16| 40432|1 2019-06-25 18:54:45,798|MAXIMALS|app-20190625185326-0200|4|12|110.0|3|1800|34.734|40432 2019-06-25 18:54:47,141|FF|app-20190625185326-0200|12|4| END| 81.36|1.Maximal disks found | 36.08| 40432|1 2019-06-25 18:54:47,141|FF|app-20190625185326-0200|12|4|START| 81.36|2.Join done | 0.00| 0|1 2019-06-25 18:54:51,100|FF|app-20190625185326-0200|12|4| END| 85.32|2.Join done | 3.96| 87506|1 2019-06-25 18:54:51,100|FF|app-20190625185326-0200|12|4|START| 85.32|3.Flocks to report | 0.00| 0|1 2019-06-25 18:54:51,687|FF|app-20190625185326-0200|12|4| END| 85.91|3.Flocks to report | 0.59| 0|1 2019-06-25 18:54:51,687|FF|app-20190625185326-0200|12|4|START| 85.91|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 18:54:51,746|FF|app-20190625185326-0200|12|4| END| 85.97|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 18:54:51,746|FF|app-20190625185326-0200|12|4|START| 85.97|5.Flocks reported | 0.00| 0|1 2019-06-25 18:54:51,751|FF|app-20190625185326-0200|12|4| END| 85.97|5.Flocks reported | 0.01| 0|1 2019-06-25 18:54:51,751|FF|app-20190625185326-0200|12|4|START| 85.97|6.Candidates indexed | 0.00| 0|1 2019-06-25 18:54:53,861|FF|app-20190625185326-0200|12|4| END| 88.08|6.Candidates indexed | 2.11| 89925|1 2019-06-25 18:54:53,862|FF|app-20190625185326-0200|12|4|START| 88.08|1.Maximal disks found | 0.00| 0|2 2019-06-25 18:54:53,862|MF|app-20190625185326-0200|12|4|START| 88.08|A.Points indexed | 0.00| 0|2 2019-06-25 18:54:53,971|MF|app-20190625185326-0200|12|4| END| 88.19|A.Points indexed | 0.11| 73576|2 2019-06-25 18:54:53,971|MF|app-20190625185326-0200|12|4|START| 88.19|B.Pairs found | 0.00| 0|2 2019-06-25 18:54:54,751|MF|app-20190625185326-0200|12|4| END| 88.97|B.Pairs found | 0.78|162264|2 2019-06-25 18:54:54,752|MF|app-20190625185326-0200|12|4|START| 88.97|C.Centers found | 0.00| 0|2 2019-06-25 18:54:55,582|MF|app-20190625185326-0200|12|4| END| 89.80|C.Centers found | 0.83|324528|2 2019-06-25 18:54:55,582|MF|app-20190625185326-0200|12|4|START| 89.80|D.Disks found | 0.00| 0|2 2019-06-25 18:54:59,044|MF|app-20190625185326-0200|12|4| END| 93.26|D.Disks found | 3.46|145412|2 2019-06-25 18:54:59,044|MF|app-20190625185326-0200|12|4|START| 93.26|E.Disks partitioned | 0.00| 0|2 2019-06-25 18:55:00,402|MF|app-20190625185326-0200|12|4| END| 94.62|E.Disks partitioned | 1.36|212798|2 2019-06-25 18:55:00,402|MF|app-20190625185326-0200|12|4|START| 94.62|F.Maximal disks found | 0.00| 0|2 2019-06-25 18:55:00,403|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:55:00,403|Cell area: 1055533.7681000116 2019-06-25 18:55:27,651|MF|app-20190625185326-0200|12|4| END|121.87|F.Maximal disks found | 27.25| 41347|2 2019-06-25 18:55:27,652|MAXIMALS|app-20190625185326-0200|4|12|110.0|3|1800|33.79|41347 2019-06-25 18:55:28,987|FF|app-20190625185326-0200|12|4| END|123.21|1.Maximal disks found | 35.13| 41347|2 2019-06-25 18:55:28,987|FF|app-20190625185326-0200|12|4|START|123.21|2.Join done | 0.00| 0|2 2019-06-25 18:55:39,675|FF|app-20190625185326-0200|12|4| END|133.89|2.Join done | 10.69|179268|2 2019-06-25 18:55:39,675|FF|app-20190625185326-0200|12|4|START|133.90|3.Flocks to report | 0.00| 0|2 2019-06-25 18:55:40,697|FF|app-20190625185326-0200|12|4| END|134.92|3.Flocks to report | 1.02|153105|2 2019-06-25 18:55:40,697|FF|app-20190625185326-0200|12|4|START|134.92|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 18:55:40,755|FF|app-20190625185326-0200|12|4|START|134.98|4a.Making expansions | 0.00| 0|2 2019-06-25 18:55:41,817|FF|app-20190625185326-0200|12|4| END|136.04|4a.Making expansions | 1.06|191418|2 2019-06-25 18:55:41,817|FF|app-20190625185326-0200|12|4|START|136.04|4b.Finding maximals | 0.00| 0|2 2019-06-25 18:56:27,554|FF|app-20190625185326-0200|12|4| END|181.77|4b.Finding maximals | 45.74| 26404|2 2019-06-25 18:56:28,144|FF|app-20190625185326-0200|12|4| END|182.36|4.Flocks prunned by expansion | 47.45| 26404|2 2019-06-25 18:56:28,144|FF|app-20190625185326-0200|12|4|START|182.36|5.Flocks reported | 0.00| 0|2 2019-06-25 18:56:28,929|FF|app-20190625185326-0200|12|4| END|183.15|5.Flocks reported | 0.79| 26404|2 2019-06-25 18:56:28,929|FF|app-20190625185326-0200|12|4|START|183.15|6.Candidates indexed | 0.00| 0|2 2019-06-25 18:56:31,330|FF|app-20190625185326-0200|12|4| END|185.55|6.Candidates indexed | 2.40| 55147|2 2019-06-25 18:56:31,330|FF|app-20190625185326-0200|12|4|START|185.55|1.Maximal disks found | 0.00| 0|3 2019-06-25 18:56:31,330|MF|app-20190625185326-0200|12|4|START|185.55|A.Points indexed | 0.00| 0|3 2019-06-25 18:56:31,432|MF|app-20190625185326-0200|12|4| END|185.65|A.Points indexed | 0.10| 74192|3 2019-06-25 18:56:31,432|MF|app-20190625185326-0200|12|4|START|185.65|B.Pairs found | 0.00| 0|3 2019-06-25 18:56:32,192|MF|app-20190625185326-0200|12|4| END|186.41|B.Pairs found | 0.76|165028|3 2019-06-25 18:56:32,192|MF|app-20190625185326-0200|12|4|START|186.41|C.Centers found | 0.00| 0|3 2019-06-25 18:56:33,002|MF|app-20190625185326-0200|12|4| END|187.22|C.Centers found | 0.81|330056|3 2019-06-25 18:56:33,002|MF|app-20190625185326-0200|12|4|START|187.22|D.Disks found | 0.00| 0|3 2019-06-25 18:56:36,364|MF|app-20190625185326-0200|12|4| END|190.58|D.Disks found | 3.36|148348|3 2019-06-25 18:56:36,364|MF|app-20190625185326-0200|12|4|START|190.58|E.Disks partitioned | 0.00| 0|3 2019-06-25 18:56:37,498|MF|app-20190625185326-0200|12|4| END|191.72|E.Disks partitioned | 1.13|217088|3 2019-06-25 18:56:37,498|MF|app-20190625185326-0200|12|4|START|191.72|F.Maximal disks found | 0.00| 0|3 2019-06-25 18:56:37,499|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:56:37,499|Cell area: 1055533.7681000116 2019-06-25 18:57:10,734|MF|app-20190625185326-0200|12|4| END|224.95|F.Maximal disks found | 33.24| 42012|3 2019-06-25 18:57:10,734|MAXIMALS|app-20190625185326-0200|4|12|110.0|3|1800|39.404|42012 2019-06-25 18:57:12,094|FF|app-20190625185326-0200|12|4| END|226.31|1.Maximal disks found | 40.76| 42012|3 2019-06-25 18:57:12,094|FF|app-20190625185326-0200|12|4|START|226.31|2.Join done | 0.00| 0|3 2019-06-25 18:57:18,768|FF|app-20190625185326-0200|12|4| END|232.99|2.Join done | 6.67|179709|3 2019-06-25 18:57:18,768|FF|app-20190625185326-0200|12|4|START|232.99|3.Flocks to report | 0.00| 0|3 2019-06-25 18:57:20,030|FF|app-20190625185326-0200|12|4| END|234.25|3.Flocks to report | 1.26|153488|3 2019-06-25 18:57:20,030|FF|app-20190625185326-0200|12|4|START|234.25|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 18:57:20,127|FF|app-20190625185326-0200|12|4|START|234.35|4a.Making expansions | 0.00| 0|3 2019-06-25 18:57:21,183|FF|app-20190625185326-0200|12|4| END|235.40|4a.Making expansions | 1.06|191602|3 2019-06-25 18:57:21,183|FF|app-20190625185326-0200|12|4|START|235.40|4b.Finding maximals | 0.00| 0|3 2019-06-25 18:58:31,944|FF|app-20190625185326-0200|12|4| END|306.16|4b.Finding maximals | 70.76| 26676|3 2019-06-25 18:58:32,588|FF|app-20190625185326-0200|12|4| END|306.81|4.Flocks prunned by expansion | 72.56| 26676|3 2019-06-25 18:58:32,588|FF|app-20190625185326-0200|12|4|START|306.81|5.Flocks reported | 0.00| 0|3 2019-06-25 18:58:33,428|FF|app-20190625185326-0200|12|4| END|307.65|5.Flocks reported | 0.84| 26676|3 2019-06-25 18:58:33,428|FF|app-20190625185326-0200|12|4|START|307.65|6.Candidates indexed | 0.00| 0|3 2019-06-25 18:58:35,982|FF|app-20190625185326-0200|12|4| END|310.20|6.Candidates indexed | 2.55| 55524|3 2019-06-25 18:58:37,764|Number of flocks: 53080 2019-06-25 18:58:38,995|PFLOCK|app-20190625185326-0200|4|12|110.0|3|3|305.36|53080 2019-06-25 18:58:40,246|FF|app-20190625185326-0200|12|4| END|314.47|Flock Finder run |307.84| 53080|3 2019-06-25 18:58:40,246|FF|app-20190625185326-0200|12|4|START|314.47|Session closed | 0.00| 0|3 2019-06-25 18:58:47,624|FF|app-20190625185326-0200|12|4| END|321.84|Session closed | 7.38| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 6 --fftimestamp 4 --portui 4040 --info 2019-06-25 18:58:49,622|FF|app-00000000000000-0000|6|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 18:58:50,746|FF|app-20190625185850-0201|6|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 18:58:50,746|FF|app-20190625185850-0201|6|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 18:58:54,796|FF|app-20190625185850-0201|6|4| END| 5.16|Data read | 4.05|220752|-1 2019-06-25 18:58:54,796|FF|app-20190625185850-0201|6|4|START| 5.16|KDBTree partitioner | 0.00| 0|-1 2019-06-25 18:58:55,068|FF|app-20190625185850-0201|6|4| END| 5.43|KDBTree partitioner | 0.27| 544|-1 2019-06-25 18:58:55,068|FF|app-20190625185850-0201|6|4|START| 5.43|MF partitioner | 0.00| 0|-1 2019-06-25 18:58:55,087|FF|app-20190625185850-0201|6|4| END| 5.45|MF partitioner | 0.02| 900|-1 2019-06-25 18:58:55,087|FF|app-20190625185850-0201|6|4|START| 5.45|Pointset done | 0.00| 0|-1 2019-06-25 18:58:56,079|FF|app-20190625185850-0201|6|4| END| 6.44|Pointset done | 0.99| 4|-1 2019-06-25 18:58:56,079|FF|app-20190625185850-0201|6|4|START| 6.44|Flock Finder run | 0.00| 0|-1 2019-06-25 18:58:56,099|FF|app-20190625185850-0201|6|4|START| 6.46|1.Maximal disks found | 0.00| 0|0 2019-06-25 18:58:56,102|MF|app-20190625185850-0201|6|4|START| 6.46|A.Points indexed | 0.00| 0|0 2019-06-25 18:58:56,265|MF|app-20190625185850-0201|6|4| END| 6.63|A.Points indexed | 0.16| 36186|0 2019-06-25 18:58:56,265|MF|app-20190625185850-0201|6|4|START| 6.63|B.Pairs found | 0.00| 0|0 2019-06-25 18:58:57,826|MF|app-20190625185850-0201|6|4| END| 8.19|B.Pairs found | 1.56| 78808|0 2019-06-25 18:58:57,827|MF|app-20190625185850-0201|6|4|START| 8.19|C.Centers found | 0.00| 0|0 2019-06-25 18:58:58,788|MF|app-20190625185850-0201|6|4| END| 9.15|C.Centers found | 0.96|157616|0 2019-06-25 18:58:58,789|MF|app-20190625185850-0201|6|4|START| 9.15|D.Disks found | 0.00| 0|0 2019-06-25 18:59:03,873|MF|app-20190625185850-0201|6|4| END| 14.23|D.Disks found | 5.09| 70458|0 2019-06-25 18:59:03,873|MF|app-20190625185850-0201|6|4|START| 14.23|E.Disks partitioned | 0.00| 0|0 2019-06-25 18:59:06,321|MF|app-20190625185850-0201|6|4| END| 16.68|E.Disks partitioned | 2.45|103004|0 2019-06-25 18:59:06,321|MF|app-20190625185850-0201|6|4|START| 16.68|F.Maximal disks found | 0.00| 0|0 2019-06-25 18:59:06,323|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:59:06,323|Cell area: 1055533.7681000116 2019-06-25 18:59:33,135|MF|app-20190625185850-0201|6|4| END| 43.50|F.Maximal disks found | 26.81| 20001|0 2019-06-25 18:59:33,135|MAXIMALS|app-20190625185850-0201|4|6|110.0|3|900|37.034|20001 2019-06-25 18:59:34,112|FF|app-20190625185850-0201|6|4| END| 44.47|1.Maximal disks found | 38.01| 20001|0 2019-06-25 18:59:34,112|FF|app-20190625185850-0201|6|4|START| 44.47|1.Maximal disks found | 0.00| 0|1 2019-06-25 18:59:34,112|MF|app-20190625185850-0201|6|4|START| 44.47|A.Points indexed | 0.00| 0|1 2019-06-25 18:59:34,194|MF|app-20190625185850-0201|6|4| END| 44.56|A.Points indexed | 0.08| 36490|1 2019-06-25 18:59:34,194|MF|app-20190625185850-0201|6|4|START| 44.56|B.Pairs found | 0.00| 0|1 2019-06-25 18:59:35,102|MF|app-20190625185850-0201|6|4| END| 45.46|B.Pairs found | 0.91| 79998|1 2019-06-25 18:59:35,102|MF|app-20190625185850-0201|6|4|START| 45.46|C.Centers found | 0.00| 0|1 2019-06-25 18:59:35,985|MF|app-20190625185850-0201|6|4| END| 46.35|C.Centers found | 0.88|159996|1 2019-06-25 18:59:35,985|MF|app-20190625185850-0201|6|4|START| 46.35|D.Disks found | 0.00| 0|1 2019-06-25 18:59:40,944|MF|app-20190625185850-0201|6|4| END| 51.31|D.Disks found | 4.96| 71698|1 2019-06-25 18:59:40,944|MF|app-20190625185850-0201|6|4|START| 51.31|E.Disks partitioned | 0.00| 0|1 2019-06-25 18:59:43,303|MF|app-20190625185850-0201|6|4| END| 53.66|E.Disks partitioned | 2.36|104758|1 2019-06-25 18:59:43,303|MF|app-20190625185850-0201|6|4|START| 53.66|F.Maximal disks found | 0.00| 0|1 2019-06-25 18:59:43,304|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 18:59:43,304|Cell area: 1055533.7681000116 2019-06-25 19:00:11,713|MF|app-20190625185850-0201|6|4| END| 82.07|F.Maximal disks found | 28.41| 20222|1 2019-06-25 19:00:11,713|MAXIMALS|app-20190625185850-0201|4|6|110.0|3|900|37.601|20222 2019-06-25 19:00:12,620|FF|app-20190625185850-0201|6|4| END| 82.98|1.Maximal disks found | 38.51| 20222|1 2019-06-25 19:00:12,620|FF|app-20190625185850-0201|6|4|START| 82.98|2.Join done | 0.00| 0|1 2019-06-25 19:00:17,974|FF|app-20190625185850-0201|6|4| END| 88.34|2.Join done | 5.35| 43837|1 2019-06-25 19:00:17,974|FF|app-20190625185850-0201|6|4|START| 88.34|3.Flocks to report | 0.00| 0|1 2019-06-25 19:00:19,002|FF|app-20190625185850-0201|6|4| END| 89.36|3.Flocks to report | 1.03| 0|1 2019-06-25 19:00:19,002|FF|app-20190625185850-0201|6|4|START| 89.36|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 19:00:19,045|FF|app-20190625185850-0201|6|4| END| 89.41|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 19:00:19,045|FF|app-20190625185850-0201|6|4|START| 89.41|5.Flocks reported | 0.00| 0|1 2019-06-25 19:00:19,050|FF|app-20190625185850-0201|6|4| END| 89.41|5.Flocks reported | 0.01| 0|1 2019-06-25 19:00:19,050|FF|app-20190625185850-0201|6|4|START| 89.41|6.Candidates indexed | 0.00| 0|1 2019-06-25 19:00:23,106|FF|app-20190625185850-0201|6|4| END| 93.47|6.Candidates indexed | 4.06| 45047|1 2019-06-25 19:00:23,107|FF|app-20190625185850-0201|6|4|START| 93.47|1.Maximal disks found | 0.00| 0|2 2019-06-25 19:00:23,107|MF|app-20190625185850-0201|6|4|START| 93.47|A.Points indexed | 0.00| 0|2 2019-06-25 19:00:23,185|MF|app-20190625185850-0201|6|4| END| 93.55|A.Points indexed | 0.08| 36788|2 2019-06-25 19:00:23,186|MF|app-20190625185850-0201|6|4|START| 93.55|B.Pairs found | 0.00| 0|2 2019-06-25 19:00:24,106|MF|app-20190625185850-0201|6|4| END| 94.47|B.Pairs found | 0.92| 81132|2 2019-06-25 19:00:24,106|MF|app-20190625185850-0201|6|4|START| 94.47|C.Centers found | 0.00| 0|2 2019-06-25 19:00:25,009|MF|app-20190625185850-0201|6|4| END| 95.37|C.Centers found | 0.90|162264|2 2019-06-25 19:00:25,009|MF|app-20190625185850-0201|6|4|START| 95.37|D.Disks found | 0.00| 0|2 2019-06-25 19:00:29,787|MF|app-20190625185850-0201|6|4| END|100.15|D.Disks found | 4.78| 72706|2 2019-06-25 19:00:29,787|MF|app-20190625185850-0201|6|4|START|100.15|E.Disks partitioned | 0.00| 0|2 2019-06-25 19:00:31,971|MF|app-20190625185850-0201|6|4| END|102.33|E.Disks partitioned | 2.18|106347|2 2019-06-25 19:00:31,972|MF|app-20190625185850-0201|6|4|START|102.33|F.Maximal disks found | 0.00| 0|2 2019-06-25 19:00:31,972|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:00:31,972|Cell area: 1055533.7681000116 2019-06-25 19:00:59,472|MF|app-20190625185850-0201|6|4| END|129.83|F.Maximal disks found | 27.50| 20682|2 2019-06-25 19:00:59,472|MAXIMALS|app-20190625185850-0201|4|6|110.0|3|900|36.365|20682 2019-06-25 19:01:00,388|FF|app-20190625185850-0201|6|4| END|130.75|1.Maximal disks found | 37.28| 20682|2 2019-06-25 19:01:00,388|FF|app-20190625185850-0201|6|4|START|130.75|2.Join done | 0.00| 0|2 2019-06-25 19:01:17,779|FF|app-20190625185850-0201|6|4| END|148.14|2.Join done | 17.39| 89740|2 2019-06-25 19:01:17,779|FF|app-20190625185850-0201|6|4|START|148.14|3.Flocks to report | 0.00| 0|2 2019-06-25 19:01:19,707|FF|app-20190625185850-0201|6|4| END|150.07|3.Flocks to report | 1.93| 76643|2 2019-06-25 19:01:19,707|FF|app-20190625185850-0201|6|4|START|150.07|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 19:01:19,750|FF|app-20190625185850-0201|6|4|START|150.11|4a.Making expansions | 0.00| 0|2 2019-06-25 19:01:21,144|FF|app-20190625185850-0201|6|4| END|151.51|4a.Making expansions | 1.39| 95728|2 2019-06-25 19:01:21,145|FF|app-20190625185850-0201|6|4|START|151.51|4b.Finding maximals | 0.00| 0|2 2019-06-25 19:02:07,484|FF|app-20190625185850-0201|6|4| END|197.85|4b.Finding maximals | 46.34| 13202|2 2019-06-25 19:02:07,930|FF|app-20190625185850-0201|6|4| END|198.29|4.Flocks prunned by expansion | 48.22| 13202|2 2019-06-25 19:02:07,930|FF|app-20190625185850-0201|6|4|START|198.29|5.Flocks reported | 0.00| 0|2 2019-06-25 19:02:08,502|FF|app-20190625185850-0201|6|4| END|198.86|5.Flocks reported | 0.57| 13202|2 2019-06-25 19:02:08,502|FF|app-20190625185850-0201|6|4|START|198.86|6.Candidates indexed | 0.00| 0|2 2019-06-25 19:02:11,170|FF|app-20190625185850-0201|6|4| END|201.53|6.Candidates indexed | 2.67| 27595|2 2019-06-25 19:02:11,170|FF|app-20190625185850-0201|6|4|START|201.53|1.Maximal disks found | 0.00| 0|3 2019-06-25 19:02:11,170|MF|app-20190625185850-0201|6|4|START|201.53|A.Points indexed | 0.00| 0|3 2019-06-25 19:02:11,238|MF|app-20190625185850-0201|6|4| END|201.60|A.Points indexed | 0.07| 37096|3 2019-06-25 19:02:11,238|MF|app-20190625185850-0201|6|4|START|201.60|B.Pairs found | 0.00| 0|3 2019-06-25 19:02:12,074|MF|app-20190625185850-0201|6|4| END|202.44|B.Pairs found | 0.84| 82514|3 2019-06-25 19:02:12,074|MF|app-20190625185850-0201|6|4|START|202.44|C.Centers found | 0.00| 0|3 2019-06-25 19:02:12,803|MF|app-20190625185850-0201|6|4| END|203.16|C.Centers found | 0.73|165028|3 2019-06-25 19:02:12,803|MF|app-20190625185850-0201|6|4|START|203.16|D.Disks found | 0.00| 0|3 2019-06-25 19:02:17,023|MF|app-20190625185850-0201|6|4| END|207.38|D.Disks found | 4.22| 74174|3 2019-06-25 19:02:17,023|MF|app-20190625185850-0201|6|4|START|207.38|E.Disks partitioned | 0.00| 0|3 2019-06-25 19:02:19,066|MF|app-20190625185850-0201|6|4| END|209.43|E.Disks partitioned | 2.04|108468|3 2019-06-25 19:02:19,066|MF|app-20190625185850-0201|6|4|START|209.43|F.Maximal disks found | 0.00| 0|3 2019-06-25 19:02:19,067|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:02:19,067|Cell area: 1055533.7681000116 2019-06-25 19:02:52,863|MF|app-20190625185850-0201|6|4| END|243.22|F.Maximal disks found | 33.80| 21009|3 2019-06-25 19:02:52,863|MAXIMALS|app-20190625185850-0201|4|6|110.0|3|900|41.693|21009 2019-06-25 19:02:53,767|FF|app-20190625185850-0201|6|4| END|244.13|1.Maximal disks found | 42.60| 21009|3 2019-06-25 19:02:53,767|FF|app-20190625185850-0201|6|4|START|244.13|2.Join done | 0.00| 0|3 2019-06-25 19:03:05,510|FF|app-20190625185850-0201|6|4| END|255.87|2.Join done | 11.74| 90003|3 2019-06-25 19:03:05,510|FF|app-20190625185850-0201|6|4|START|255.87|3.Flocks to report | 0.00| 0|3 2019-06-25 19:03:07,565|FF|app-20190625185850-0201|6|4| END|257.93|3.Flocks to report | 2.06| 76861|3 2019-06-25 19:03:07,565|FF|app-20190625185850-0201|6|4|START|257.93|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 19:03:07,613|FF|app-20190625185850-0201|6|4|START|257.97|4a.Making expansions | 0.00| 0|3 2019-06-25 19:03:08,999|FF|app-20190625185850-0201|6|4| END|259.36|4a.Making expansions | 1.39| 95631|3 2019-06-25 19:03:08,999|FF|app-20190625185850-0201|6|4|START|259.36|4b.Finding maximals | 0.00| 0|3 2019-06-25 19:04:12,760|FF|app-20190625185850-0201|6|4| END|323.12|4b.Finding maximals | 63.76| 13338|3 2019-06-25 19:04:13,152|FF|app-20190625185850-0201|6|4| END|323.51|4.Flocks prunned by expansion | 65.59| 13338|3 2019-06-25 19:04:13,152|FF|app-20190625185850-0201|6|4|START|323.51|5.Flocks reported | 0.00| 0|3 2019-06-25 19:04:13,733|FF|app-20190625185850-0201|6|4| END|324.09|5.Flocks reported | 0.58| 13338|3 2019-06-25 19:04:13,733|FF|app-20190625185850-0201|6|4|START|324.09|6.Candidates indexed | 0.00| 0|3 2019-06-25 19:04:16,672|FF|app-20190625185850-0201|6|4| END|327.03|6.Candidates indexed | 2.94| 27789|3 2019-06-25 19:04:18,079|Number of flocks: 26540 2019-06-25 19:04:18,867|PFLOCK|app-20190625185850-0201|4|6|110.0|3|3|322.00|26540 2019-06-25 19:04:19,705|FF|app-20190625185850-0201|6|4| END|330.07|Flock Finder run |323.63| 26540|3 2019-06-25 19:04:19,705|FF|app-20190625185850-0201|6|4|START|330.07|Session closed | 0.00| 0|3 2019-06-25 19:04:26,471|FF|app-20190625185850-0201|6|4| END|336.83|Session closed | 6.77| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 3 --fftimestamp 4 --portui 4040 --info 2019-06-25 19:04:28,423|FF|app-00000000000000-0000|3|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 19:04:29,514|FF|app-20190625190429-0202|3|4| END| 1.08|Session start | 1.09| 0|-1 2019-06-25 19:04:29,515|FF|app-20190625190429-0202|3|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 19:04:33,294|FF|app-20190625190429-0202|3|4| END| 4.86|Data read | 3.78|110376|-1 2019-06-25 19:04:33,294|FF|app-20190625190429-0202|3|4|START| 4.86|KDBTree partitioner | 0.00| 0|-1 2019-06-25 19:04:33,406|FF|app-20190625190429-0202|3|4| END| 4.97|KDBTree partitioner | 0.11| 272|-1 2019-06-25 19:04:33,406|FF|app-20190625190429-0202|3|4|START| 4.97|MF partitioner | 0.00| 0|-1 2019-06-25 19:04:33,415|FF|app-20190625190429-0202|3|4| END| 4.98|MF partitioner | 0.01| 450|-1 2019-06-25 19:04:33,415|FF|app-20190625190429-0202|3|4|START| 4.98|Pointset done | 0.00| 0|-1 2019-06-25 19:04:34,186|FF|app-20190625190429-0202|3|4| END| 5.75|Pointset done | 0.77| 4|-1 2019-06-25 19:04:34,186|FF|app-20190625190429-0202|3|4|START| 5.75|Flock Finder run | 0.00| 0|-1 2019-06-25 19:04:34,204|FF|app-20190625190429-0202|3|4|START| 5.77|1.Maximal disks found | 0.00| 0|0 2019-06-25 19:04:34,206|MF|app-20190625190429-0202|3|4|START| 5.77|A.Points indexed | 0.00| 0|0 2019-06-25 19:04:34,336|MF|app-20190625190429-0202|3|4| END| 5.90|A.Points indexed | 0.13| 18093|0 2019-06-25 19:04:34,337|MF|app-20190625190429-0202|3|4|START| 5.90|B.Pairs found | 0.00| 0|0 2019-06-25 19:04:35,829|MF|app-20190625190429-0202|3|4| END| 7.39|B.Pairs found | 1.49| 39404|0 2019-06-25 19:04:35,830|MF|app-20190625190429-0202|3|4|START| 7.39|C.Centers found | 0.00| 0|0 2019-06-25 19:04:36,707|MF|app-20190625190429-0202|3|4| END| 8.27|C.Centers found | 0.88| 78808|0 2019-06-25 19:04:36,707|MF|app-20190625190429-0202|3|4|START| 8.27|D.Disks found | 0.00| 0|0 2019-06-25 19:04:40,116|MF|app-20190625190429-0202|3|4| END| 11.68|D.Disks found | 3.41| 35229|0 2019-06-25 19:04:40,116|MF|app-20190625190429-0202|3|4|START| 11.68|E.Disks partitioned | 0.00| 0|0 2019-06-25 19:04:41,142|MF|app-20190625190429-0202|3|4| END| 12.70|E.Disks partitioned | 1.03| 51442|0 2019-06-25 19:04:41,142|MF|app-20190625190429-0202|3|4|START| 12.70|F.Maximal disks found | 0.00| 0|0 2019-06-25 19:04:41,144|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:04:41,144|Cell area: 1055533.7681000116 2019-06-25 19:05:06,425|MF|app-20190625190429-0202|3|4| END| 37.99|F.Maximal disks found | 25.28| 10001|0 2019-06-25 19:05:06,425|MAXIMALS|app-20190625190429-0202|4|3|110.0|3|450|32.219|10001 2019-06-25 19:05:06,967|FF|app-20190625190429-0202|3|4| END| 38.53|1.Maximal disks found | 32.76| 10001|0 2019-06-25 19:05:06,967|FF|app-20190625190429-0202|3|4|START| 38.53|1.Maximal disks found | 0.00| 0|1 2019-06-25 19:05:06,967|MF|app-20190625190429-0202|3|4|START| 38.53|A.Points indexed | 0.00| 0|1 2019-06-25 19:05:07,029|MF|app-20190625190429-0202|3|4| END| 38.59|A.Points indexed | 0.06| 18245|1 2019-06-25 19:05:07,029|MF|app-20190625190429-0202|3|4|START| 38.59|B.Pairs found | 0.00| 0|1 2019-06-25 19:05:07,529|MF|app-20190625190429-0202|3|4| END| 39.09|B.Pairs found | 0.50| 39999|1 2019-06-25 19:05:07,529|MF|app-20190625190429-0202|3|4|START| 39.09|C.Centers found | 0.00| 0|1 2019-06-25 19:05:08,039|MF|app-20190625190429-0202|3|4| END| 39.60|C.Centers found | 0.51| 79998|1 2019-06-25 19:05:08,039|MF|app-20190625190429-0202|3|4|START| 39.60|D.Disks found | 0.00| 0|1 2019-06-25 19:05:10,415|MF|app-20190625190429-0202|3|4| END| 41.98|D.Disks found | 2.38| 35849|1 2019-06-25 19:05:10,415|MF|app-20190625190429-0202|3|4|START| 41.98|E.Disks partitioned | 0.00| 0|1 2019-06-25 19:05:11,252|MF|app-20190625190429-0202|3|4| END| 42.81|E.Disks partitioned | 0.84| 52317|1 2019-06-25 19:05:11,252|MF|app-20190625190429-0202|3|4|START| 42.81|F.Maximal disks found | 0.00| 0|1 2019-06-25 19:05:11,253|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:05:11,253|Cell area: 1055533.7681000116 2019-06-25 19:05:38,513|MF|app-20190625190429-0202|3|4| END| 70.07|F.Maximal disks found | 27.26| 10110|1 2019-06-25 19:05:38,513|MAXIMALS|app-20190625190429-0202|4|3|110.0|3|450|31.546|10110 2019-06-25 19:05:38,916|FF|app-20190625190429-0202|3|4| END| 70.48|1.Maximal disks found | 31.95| 10110|1 2019-06-25 19:05:38,916|FF|app-20190625190429-0202|3|4|START| 70.48|2.Join done | 0.00| 0|1 2019-06-25 19:05:41,454|FF|app-20190625190429-0202|3|4| END| 73.02|2.Join done | 2.54| 21993|1 2019-06-25 19:05:41,454|FF|app-20190625190429-0202|3|4|START| 73.02|3.Flocks to report | 0.00| 0|1 2019-06-25 19:05:41,890|FF|app-20190625190429-0202|3|4| END| 73.45|3.Flocks to report | 0.44| 0|1 2019-06-25 19:05:41,890|FF|app-20190625190429-0202|3|4|START| 73.45|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 19:05:41,924|FF|app-20190625190429-0202|3|4| END| 73.49|4.Flocks prunned by expansion | 0.03| 0|1 2019-06-25 19:05:41,924|FF|app-20190625190429-0202|3|4|START| 73.49|5.Flocks reported | 0.00| 0|1 2019-06-25 19:05:41,929|FF|app-20190625190429-0202|3|4| END| 73.49|5.Flocks reported | 0.01| 0|1 2019-06-25 19:05:41,929|FF|app-20190625190429-0202|3|4|START| 73.49|6.Candidates indexed | 0.00| 0|1 2019-06-25 19:05:43,489|FF|app-20190625190429-0202|3|4| END| 75.05|6.Candidates indexed | 1.56| 22599|1 2019-06-25 19:05:43,489|FF|app-20190625190429-0202|3|4|START| 75.05|1.Maximal disks found | 0.00| 0|2 2019-06-25 19:05:43,490|MF|app-20190625190429-0202|3|4|START| 75.05|A.Points indexed | 0.00| 0|2 2019-06-25 19:05:43,548|MF|app-20190625190429-0202|3|4| END| 75.11|A.Points indexed | 0.06| 18394|2 2019-06-25 19:05:43,548|MF|app-20190625190429-0202|3|4|START| 75.11|B.Pairs found | 0.00| 0|2 2019-06-25 19:05:43,977|MF|app-20190625190429-0202|3|4| END| 75.54|B.Pairs found | 0.43| 40566|2 2019-06-25 19:05:43,977|MF|app-20190625190429-0202|3|4|START| 75.54|C.Centers found | 0.00| 0|2 2019-06-25 19:05:44,455|MF|app-20190625190429-0202|3|4| END| 76.02|C.Centers found | 0.48| 81132|2 2019-06-25 19:05:44,456|MF|app-20190625190429-0202|3|4|START| 76.02|D.Disks found | 0.00| 0|2 2019-06-25 19:05:46,682|MF|app-20190625190429-0202|3|4| END| 78.24|D.Disks found | 2.23| 36353|2 2019-06-25 19:05:46,682|MF|app-20190625190429-0202|3|4|START| 78.24|E.Disks partitioned | 0.00| 0|2 2019-06-25 19:05:47,467|MF|app-20190625190429-0202|3|4| END| 79.03|E.Disks partitioned | 0.79| 53134|2 2019-06-25 19:05:47,468|MF|app-20190625190429-0202|3|4|START| 79.03|F.Maximal disks found | 0.00| 0|2 2019-06-25 19:05:47,468|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:05:47,468|Cell area: 1055533.7681000116 2019-06-25 19:06:15,366|MF|app-20190625190429-0202|3|4| END|106.93|F.Maximal disks found | 27.90| 10342|2 2019-06-25 19:06:15,367|MAXIMALS|app-20190625190429-0202|4|3|110.0|3|450|31.877|10342 2019-06-25 19:06:15,802|FF|app-20190625190429-0202|3|4| END|107.36|1.Maximal disks found | 32.31| 10342|2 2019-06-25 19:06:15,802|FF|app-20190625190429-0202|3|4|START|107.36|2.Join done | 0.00| 0|2 2019-06-25 19:06:30,352|FF|app-20190625190429-0202|3|4| END|121.91|2.Join done | 14.55| 45000|2 2019-06-25 19:06:30,352|FF|app-20190625190429-0202|3|4|START|121.91|3.Flocks to report | 0.00| 0|2 2019-06-25 19:06:32,431|FF|app-20190625190429-0202|3|4| END|123.99|3.Flocks to report | 2.08| 38432|2 2019-06-25 19:06:32,431|FF|app-20190625190429-0202|3|4|START|123.99|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 19:06:32,472|FF|app-20190625190429-0202|3|4|START|124.03|4a.Making expansions | 0.00| 0|2 2019-06-25 19:06:33,599|FF|app-20190625190429-0202|3|4| END|125.16|4a.Making expansions | 1.13| 47628|2 2019-06-25 19:06:33,599|FF|app-20190625190429-0202|3|4|START|125.16|4b.Finding maximals | 0.00| 0|2 2019-06-25 19:07:22,130|FF|app-20190625190429-0202|3|4| END|173.69|4b.Finding maximals | 48.53| 6601|2 2019-06-25 19:07:22,409|FF|app-20190625190429-0202|3|4| END|173.97|4.Flocks prunned by expansion | 49.98| 6601|2 2019-06-25 19:07:22,409|FF|app-20190625190429-0202|3|4|START|173.97|5.Flocks reported | 0.00| 0|2 2019-06-25 19:07:22,899|FF|app-20190625190429-0202|3|4| END|174.46|5.Flocks reported | 0.49| 6601|2 2019-06-25 19:07:22,900|FF|app-20190625190429-0202|3|4|START|174.46|6.Candidates indexed | 0.00| 0|2 2019-06-25 19:07:26,141|FF|app-20190625190429-0202|3|4| END|177.70|6.Candidates indexed | 3.24| 13819|2 2019-06-25 19:07:26,141|FF|app-20190625190429-0202|3|4|START|177.70|1.Maximal disks found | 0.00| 0|3 2019-06-25 19:07:26,141|MF|app-20190625190429-0202|3|4|START|177.70|A.Points indexed | 0.00| 0|3 2019-06-25 19:07:26,215|MF|app-20190625190429-0202|3|4| END|177.78|A.Points indexed | 0.07| 18548|3 2019-06-25 19:07:26,215|MF|app-20190625190429-0202|3|4|START|177.78|B.Pairs found | 0.00| 0|3 2019-06-25 19:07:27,074|MF|app-20190625190429-0202|3|4| END|178.64|B.Pairs found | 0.86| 41257|3 2019-06-25 19:07:27,074|MF|app-20190625190429-0202|3|4|START|178.64|C.Centers found | 0.00| 0|3 2019-06-25 19:07:27,873|MF|app-20190625190429-0202|3|4| END|179.43|C.Centers found | 0.80| 82514|3 2019-06-25 19:07:27,873|MF|app-20190625190429-0202|3|4|START|179.43|D.Disks found | 0.00| 0|3 2019-06-25 19:07:32,774|MF|app-20190625190429-0202|3|4| END|184.34|D.Disks found | 4.90| 37087|3 2019-06-25 19:07:32,774|MF|app-20190625190429-0202|3|4|START|184.34|E.Disks partitioned | 0.00| 0|3 2019-06-25 19:07:34,429|MF|app-20190625190429-0202|3|4| END|185.99|E.Disks partitioned | 1.66| 54196|3 2019-06-25 19:07:34,429|MF|app-20190625190429-0202|3|4|START|185.99|F.Maximal disks found | 0.00| 0|3 2019-06-25 19:07:34,430|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:07:34,430|Cell area: 1055533.7681000116 2019-06-25 19:08:09,945|MF|app-20190625190429-0202|3|4| END|221.51|F.Maximal disks found | 35.52| 10503|3 2019-06-25 19:08:09,945|MAXIMALS|app-20190625190429-0202|4|3|110.0|3|450|43.804|10503 2019-06-25 19:08:10,655|FF|app-20190625190429-0202|3|4| END|222.22|1.Maximal disks found | 44.51| 10503|3 2019-06-25 19:08:10,655|FF|app-20190625190429-0202|3|4|START|222.22|2.Join done | 0.00| 0|3 2019-06-25 19:08:19,938|FF|app-20190625190429-0202|3|4| END|231.50|2.Join done | 9.28| 45190|3 2019-06-25 19:08:19,938|FF|app-20190625190429-0202|3|4|START|231.50|3.Flocks to report | 0.00| 0|3 2019-06-25 19:08:21,911|FF|app-20190625190429-0202|3|4| END|233.47|3.Flocks to report | 1.97| 38589|3 2019-06-25 19:08:21,911|FF|app-20190625190429-0202|3|4|START|233.47|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 19:08:21,953|FF|app-20190625190429-0202|3|4|START|233.51|4a.Making expansions | 0.00| 0|3 2019-06-25 19:08:23,048|FF|app-20190625190429-0202|3|4| END|234.61|4a.Making expansions | 1.10| 47925|3 2019-06-25 19:08:23,048|FF|app-20190625190429-0202|3|4|START|234.61|4b.Finding maximals | 0.00| 0|3 2019-06-25 19:09:30,460|FF|app-20190625190429-0202|3|4| END|302.02|4b.Finding maximals | 67.41| 6669|3 2019-06-25 19:09:30,761|FF|app-20190625190429-0202|3|4| END|302.32|4.Flocks prunned by expansion | 68.85| 6669|3 2019-06-25 19:09:30,761|FF|app-20190625190429-0202|3|4|START|302.32|5.Flocks reported | 0.00| 0|3 2019-06-25 19:09:31,242|FF|app-20190625190429-0202|3|4| END|302.80|5.Flocks reported | 0.48| 6669|3 2019-06-25 19:09:31,242|FF|app-20190625190429-0202|3|4|START|302.80|6.Candidates indexed | 0.00| 0|3 2019-06-25 19:09:34,536|FF|app-20190625190429-0202|3|4| END|306.10|6.Candidates indexed | 3.29| 13927|3 2019-06-25 19:09:35,331|Number of flocks: 13270 2019-06-25 19:09:35,710|PFLOCK|app-20190625190429-0202|4|3|110.0|3|3|301.15|13270 2019-06-25 19:09:36,075|FF|app-20190625190429-0202|3|4| END|307.64|Flock Finder run |301.89| 13270|3 2019-06-25 19:09:36,075|FF|app-20190625190429-0202|3|4|START|307.64|Session closed | 0.00| 0|3 2019-06-25 19:09:42,795|FF|app-20190625190429-0202|3|4| END|314.36|Session closed | 6.72| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B4_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_grid-60x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 12 --fftimestamp 4 --portui 4040 --info 2019-06-25 19:09:44,786|FF|app-00000000000000-0000|12|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 19:09:45,882|FF|app-20190625190945-0203|12|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 19:09:45,882|FF|app-20190625190945-0203|12|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 19:09:50,193|FF|app-20190625190945-0203|12|4| END| 5.39|Data read | 4.31|441504|-1 2019-06-25 19:09:50,193|FF|app-20190625190945-0203|12|4|START| 5.39|KDBTree partitioner | 0.00| 0|-1 2019-06-25 19:09:50,377|FF|app-20190625190945-0203|12|4| END| 5.58|KDBTree partitioner | 0.18| 1088|-1 2019-06-25 19:09:50,377|FF|app-20190625190945-0203|12|4|START| 5.58|MF partitioner | 0.00| 0|-1 2019-06-25 19:09:50,409|FF|app-20190625190945-0203|12|4| END| 5.61|MF partitioner | 0.03| 1800|-1 2019-06-25 19:09:50,410|FF|app-20190625190945-0203|12|4|START| 5.61|Pointset done | 0.00| 0|-1 2019-06-25 19:09:51,433|FF|app-20190625190945-0203|12|4| END| 6.63|Pointset done | 1.02| 4|-1 2019-06-25 19:09:51,433|FF|app-20190625190945-0203|12|4|START| 6.63|Flock Finder run | 0.00| 0|-1 2019-06-25 19:09:51,453|FF|app-20190625190945-0203|12|4|START| 6.65|1.Maximal disks found | 0.00| 0|0 2019-06-25 19:09:51,457|MF|app-20190625190945-0203|12|4|START| 6.65|A.Points indexed | 0.00| 0|0 2019-06-25 19:09:51,673|MF|app-20190625190945-0203|12|4| END| 6.87|A.Points indexed | 0.22| 72372|0 2019-06-25 19:09:51,673|MF|app-20190625190945-0203|12|4|START| 6.87|B.Pairs found | 0.00| 0|0 2019-06-25 19:09:53,303|MF|app-20190625190945-0203|12|4| END| 8.50|B.Pairs found | 1.63|135828|0 2019-06-25 19:09:53,303|MF|app-20190625190945-0203|12|4|START| 8.50|C.Centers found | 0.00| 0|0 2019-06-25 19:09:54,565|MF|app-20190625190945-0203|12|4| END| 9.76|C.Centers found | 1.26|271656|0 2019-06-25 19:09:54,565|MF|app-20190625190945-0203|12|4|START| 9.76|D.Disks found | 0.00| 0|0 2019-06-25 19:09:59,429|MF|app-20190625190945-0203|12|4| END| 14.63|D.Disks found | 4.86|114664|0 2019-06-25 19:09:59,429|MF|app-20190625190945-0203|12|4|START| 14.63|E.Disks partitioned | 0.00| 0|0 2019-06-25 19:10:00,977|MF|app-20190625190945-0203|12|4| END| 16.18|E.Disks partitioned | 1.55|162379|0 2019-06-25 19:10:00,978|MF|app-20190625190945-0203|12|4|START| 16.18|F.Maximal disks found | 0.00| 0|0 2019-06-25 19:10:00,981|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:10:00,981|Cell area: 1055533.7681000116 2019-06-25 19:10:12,614|MF|app-20190625190945-0203|12|4| END| 27.81|F.Maximal disks found | 11.64| 33494|0 2019-06-25 19:10:12,614|MAXIMALS|app-20190625190945-0203|4|12|100.0|3|1800|21.158|33494 2019-06-25 19:10:14,042|FF|app-20190625190945-0203|12|4| END| 29.24|1.Maximal disks found | 22.59| 33494|0 2019-06-25 19:10:14,042|FF|app-20190625190945-0203|12|4|START| 29.24|1.Maximal disks found | 0.00| 0|1 2019-06-25 19:10:14,042|MF|app-20190625190945-0203|12|4|START| 29.24|A.Points indexed | 0.00| 0|1 2019-06-25 19:10:14,150|MF|app-20190625190945-0203|12|4| END| 29.35|A.Points indexed | 0.11| 72980|1 2019-06-25 19:10:14,150|MF|app-20190625190945-0203|12|4|START| 29.35|B.Pairs found | 0.00| 0|1 2019-06-25 19:10:15,030|MF|app-20190625190945-0203|12|4| END| 30.23|B.Pairs found | 0.88|137848|1 2019-06-25 19:10:15,030|MF|app-20190625190945-0203|12|4|START| 30.23|C.Centers found | 0.00| 0|1 2019-06-25 19:10:15,859|MF|app-20190625190945-0203|12|4| END| 31.06|C.Centers found | 0.83|275696|1 2019-06-25 19:10:15,859|MF|app-20190625190945-0203|12|4|START| 31.06|D.Disks found | 0.00| 0|1 2019-06-25 19:10:19,422|MF|app-20190625190945-0203|12|4| END| 34.62|D.Disks found | 3.56|116464|1 2019-06-25 19:10:19,422|MF|app-20190625190945-0203|12|4|START| 34.62|E.Disks partitioned | 0.00| 0|1 2019-06-25 19:10:20,712|MF|app-20190625190945-0203|12|4| END| 35.91|E.Disks partitioned | 1.29|164834|1 2019-06-25 19:10:20,713|MF|app-20190625190945-0203|12|4|START| 35.91|F.Maximal disks found | 0.00| 0|1 2019-06-25 19:10:20,714|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:10:20,714|Cell area: 1055533.7681000116 2019-06-25 19:10:30,740|MF|app-20190625190945-0203|12|4| END| 45.94|F.Maximal disks found | 10.03| 34190|1 2019-06-25 19:10:30,740|MAXIMALS|app-20190625190945-0203|4|12|100.0|3|1800|16.698|34190 2019-06-25 19:10:32,098|FF|app-20190625190945-0203|12|4| END| 47.30|1.Maximal disks found | 18.06| 34190|1 2019-06-25 19:10:32,098|FF|app-20190625190945-0203|12|4|START| 47.30|2.Join done | 0.00| 0|1 2019-06-25 19:10:35,759|FF|app-20190625190945-0203|12|4| END| 50.96|2.Join done | 3.66| 68607|1 2019-06-25 19:10:35,760|FF|app-20190625190945-0203|12|4|START| 50.96|3.Flocks to report | 0.00| 0|1 2019-06-25 19:10:36,286|FF|app-20190625190945-0203|12|4| END| 51.48|3.Flocks to report | 0.53| 0|1 2019-06-25 19:10:36,286|FF|app-20190625190945-0203|12|4|START| 51.48|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 19:10:36,393|FF|app-20190625190945-0203|12|4| END| 51.59|4.Flocks prunned by expansion | 0.11| 0|1 2019-06-25 19:10:36,393|FF|app-20190625190945-0203|12|4|START| 51.59|5.Flocks reported | 0.00| 0|1 2019-06-25 19:10:36,397|FF|app-20190625190945-0203|12|4| END| 51.60|5.Flocks reported | 0.00| 0|1 2019-06-25 19:10:36,397|FF|app-20190625190945-0203|12|4|START| 51.60|6.Candidates indexed | 0.00| 0|1 2019-06-25 19:10:38,297|FF|app-20190625190945-0203|12|4| END| 53.50|6.Candidates indexed | 1.90| 70591|1 2019-06-25 19:10:38,297|FF|app-20190625190945-0203|12|4|START| 53.50|1.Maximal disks found | 0.00| 0|2 2019-06-25 19:10:38,297|MF|app-20190625190945-0203|12|4|START| 53.50|A.Points indexed | 0.00| 0|2 2019-06-25 19:10:38,405|MF|app-20190625190945-0203|12|4| END| 53.60|A.Points indexed | 0.11| 73576|2 2019-06-25 19:10:38,405|MF|app-20190625190945-0203|12|4|START| 53.60|B.Pairs found | 0.00| 0|2 2019-06-25 19:10:39,310|MF|app-20190625190945-0203|12|4| END| 54.51|B.Pairs found | 0.91|139672|2 2019-06-25 19:10:39,310|MF|app-20190625190945-0203|12|4|START| 54.51|C.Centers found | 0.00| 0|2 2019-06-25 19:10:40,138|MF|app-20190625190945-0203|12|4| END| 55.34|C.Centers found | 0.83|279344|2 2019-06-25 19:10:40,138|MF|app-20190625190945-0203|12|4|START| 55.34|D.Disks found | 0.00| 0|2 2019-06-25 19:10:43,415|MF|app-20190625190945-0203|12|4| END| 58.61|D.Disks found | 3.28|118196|2 2019-06-25 19:10:43,415|MF|app-20190625190945-0203|12|4|START| 58.61|E.Disks partitioned | 0.00| 0|2 2019-06-25 19:10:44,515|MF|app-20190625190945-0203|12|4| END| 59.71|E.Disks partitioned | 1.10|167618|2 2019-06-25 19:10:44,515|MF|app-20190625190945-0203|12|4|START| 59.71|F.Maximal disks found | 0.00| 0|2 2019-06-25 19:10:44,516|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:10:44,516|Cell area: 1055533.7681000116 2019-06-25 19:10:55,392|MF|app-20190625190945-0203|12|4| END| 70.59|F.Maximal disks found | 10.88| 34747|2 2019-06-25 19:10:55,392|MAXIMALS|app-20190625190945-0203|4|12|100.0|3|1800|17.095|34747 2019-06-25 19:10:56,743|FF|app-20190625190945-0203|12|4| END| 71.94|1.Maximal disks found | 18.45| 34747|2 2019-06-25 19:10:56,743|FF|app-20190625190945-0203|12|4|START| 71.94|2.Join done | 0.00| 0|2 2019-06-25 19:11:03,582|FF|app-20190625190945-0203|12|4| END| 78.78|2.Join done | 6.84|130916|2 2019-06-25 19:11:03,582|FF|app-20190625190945-0203|12|4|START| 78.78|3.Flocks to report | 0.00| 0|2 2019-06-25 19:11:04,358|FF|app-20190625190945-0203|12|4| END| 79.56|3.Flocks to report | 0.78|111713|2 2019-06-25 19:11:04,358|FF|app-20190625190945-0203|12|4|START| 79.56|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 19:11:04,420|FF|app-20190625190945-0203|12|4|START| 79.62|4a.Making expansions | 0.00| 0|2 2019-06-25 19:11:05,581|FF|app-20190625190945-0203|12|4| END| 80.78|4a.Making expansions | 1.16|139028|2 2019-06-25 19:11:05,581|FF|app-20190625190945-0203|12|4|START| 80.78|4b.Finding maximals | 0.00| 0|2 2019-06-25 19:11:20,828|FF|app-20190625190945-0203|12|4| END| 96.03|4b.Finding maximals | 15.25| 22788|2 2019-06-25 19:11:21,431|FF|app-20190625190945-0203|12|4| END| 96.63|4.Flocks prunned by expansion | 17.07| 22788|2 2019-06-25 19:11:21,431|FF|app-20190625190945-0203|12|4|START| 96.63|5.Flocks reported | 0.00| 0|2 2019-06-25 19:11:22,233|FF|app-20190625190945-0203|12|4| END| 97.43|5.Flocks reported | 0.80| 22788|2 2019-06-25 19:11:22,233|FF|app-20190625190945-0203|12|4|START| 97.43|6.Candidates indexed | 0.00| 0|2 2019-06-25 19:11:24,439|FF|app-20190625190945-0203|12|4| END| 99.64|6.Candidates indexed | 2.21| 44305|2 2019-06-25 19:11:24,439|FF|app-20190625190945-0203|12|4|START| 99.64|1.Maximal disks found | 0.00| 0|3 2019-06-25 19:11:24,439|MF|app-20190625190945-0203|12|4|START| 99.64|A.Points indexed | 0.00| 0|3 2019-06-25 19:11:24,540|MF|app-20190625190945-0203|12|4| END| 99.74|A.Points indexed | 0.10| 74192|3 2019-06-25 19:11:24,541|MF|app-20190625190945-0203|12|4|START| 99.74|B.Pairs found | 0.00| 0|3 2019-06-25 19:11:25,429|MF|app-20190625190945-0203|12|4| END|100.63|B.Pairs found | 0.89|142060|3 2019-06-25 19:11:25,430|MF|app-20190625190945-0203|12|4|START|100.63|C.Centers found | 0.00| 0|3 2019-06-25 19:11:26,194|MF|app-20190625190945-0203|12|4| END|101.39|C.Centers found | 0.77|284120|3 2019-06-25 19:11:26,195|MF|app-20190625190945-0203|12|4|START|101.39|D.Disks found | 0.00| 0|3 2019-06-25 19:11:29,573|MF|app-20190625190945-0203|12|4| END|104.77|D.Disks found | 3.38|120568|3 2019-06-25 19:11:29,574|MF|app-20190625190945-0203|12|4|START|104.77|E.Disks partitioned | 0.00| 0|3 2019-06-25 19:11:30,913|MF|app-20190625190945-0203|12|4| END|106.11|E.Disks partitioned | 1.34|171019|3 2019-06-25 19:11:30,913|MF|app-20190625190945-0203|12|4|START|106.11|F.Maximal disks found | 0.00| 0|3 2019-06-25 19:11:30,914|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:11:30,914|Cell area: 1055533.7681000116 2019-06-25 19:11:44,038|MF|app-20190625190945-0203|12|4| END|119.24|F.Maximal disks found | 13.13| 35397|3 2019-06-25 19:11:44,038|MAXIMALS|app-20190625190945-0203|4|12|100.0|3|1800|19.599|35397 2019-06-25 19:11:45,382|FF|app-20190625190945-0203|12|4| END|120.58|1.Maximal disks found | 20.94| 35397|3 2019-06-25 19:11:45,382|FF|app-20190625190945-0203|12|4|START|120.58|2.Join done | 0.00| 0|3 2019-06-25 19:11:49,968|FF|app-20190625190945-0203|12|4| END|125.17|2.Join done | 4.59|120801|3 2019-06-25 19:11:49,968|FF|app-20190625190945-0203|12|4|START|125.17|3.Flocks to report | 0.00| 0|3 2019-06-25 19:11:50,686|FF|app-20190625190945-0203|12|4| END|125.88|3.Flocks to report | 0.72|101397|3 2019-06-25 19:11:50,687|FF|app-20190625190945-0203|12|4|START|125.89|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 19:11:50,753|FF|app-20190625190945-0203|12|4|START|125.95|4a.Making expansions | 0.00| 0|3 2019-06-25 19:11:51,982|FF|app-20190625190945-0203|12|4| END|127.18|4a.Making expansions | 1.23|129151|3 2019-06-25 19:11:51,982|FF|app-20190625190945-0203|12|4|START|127.18|4b.Finding maximals | 0.00| 0|3 2019-06-25 19:12:04,179|FF|app-20190625190945-0203|12|4| END|139.38|4b.Finding maximals | 12.20| 23068|3 2019-06-25 19:12:04,770|FF|app-20190625190945-0203|12|4| END|139.97|4.Flocks prunned by expansion | 14.08| 23068|3 2019-06-25 19:12:04,770|FF|app-20190625190945-0203|12|4|START|139.97|5.Flocks reported | 0.00| 0|3 2019-06-25 19:12:05,602|FF|app-20190625190945-0203|12|4| END|140.80|5.Flocks reported | 0.83| 23068|3 2019-06-25 19:12:05,603|FF|app-20190625190945-0203|12|4|START|140.80|6.Candidates indexed | 0.00| 0|3 2019-06-25 19:12:07,917|FF|app-20190625190945-0203|12|4| END|143.12|6.Candidates indexed | 2.32| 44638|3 2019-06-25 19:12:09,695|Number of flocks: 45856 2019-06-25 19:12:10,953|PFLOCK|app-20190625190945-0203|4|12|100.0|3|3|138.26|45856 2019-06-25 19:12:12,199|FF|app-20190625190945-0203|12|4| END|147.40|Flock Finder run |140.77| 45856|3 2019-06-25 19:12:12,199|FF|app-20190625190945-0203|12|4|START|147.40|Session closed | 0.00| 0|3 2019-06-25 19:12:20,724|FF|app-20190625190945-0203|12|4| END|155.92|Session closed | 8.53| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 6 --fftimestamp 4 --portui 4040 --info 2019-06-25 19:12:22,545|FF|app-00000000000000-0000|6|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 19:12:23,662|FF|app-20190625191223-0204|6|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 19:12:23,663|FF|app-20190625191223-0204|6|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 19:12:27,447|FF|app-20190625191223-0204|6|4| END| 4.89|Data read | 3.79|220752|-1 2019-06-25 19:12:27,447|FF|app-20190625191223-0204|6|4|START| 4.89|KDBTree partitioner | 0.00| 0|-1 2019-06-25 19:12:27,678|FF|app-20190625191223-0204|6|4| END| 5.12|KDBTree partitioner | 0.23| 544|-1 2019-06-25 19:12:27,678|FF|app-20190625191223-0204|6|4|START| 5.12|MF partitioner | 0.00| 0|-1 2019-06-25 19:12:27,705|FF|app-20190625191223-0204|6|4| END| 5.14|MF partitioner | 0.03| 900|-1 2019-06-25 19:12:27,706|FF|app-20190625191223-0204|6|4|START| 5.14|Pointset done | 0.00| 0|-1 2019-06-25 19:12:28,727|FF|app-20190625191223-0204|6|4| END| 6.16|Pointset done | 1.02| 4|-1 2019-06-25 19:12:28,727|FF|app-20190625191223-0204|6|4|START| 6.17|Flock Finder run | 0.00| 0|-1 2019-06-25 19:12:28,751|FF|app-20190625191223-0204|6|4|START| 6.19|1.Maximal disks found | 0.00| 0|0 2019-06-25 19:12:28,754|MF|app-20190625191223-0204|6|4|START| 6.19|A.Points indexed | 0.00| 0|0 2019-06-25 19:12:28,908|MF|app-20190625191223-0204|6|4| END| 6.35|A.Points indexed | 0.16| 36186|0 2019-06-25 19:12:28,908|MF|app-20190625191223-0204|6|4|START| 6.35|B.Pairs found | 0.00| 0|0 2019-06-25 19:12:30,541|MF|app-20190625191223-0204|6|4| END| 7.98|B.Pairs found | 1.63| 67914|0 2019-06-25 19:12:30,541|MF|app-20190625191223-0204|6|4|START| 7.98|C.Centers found | 0.00| 0|0 2019-06-25 19:12:31,653|MF|app-20190625191223-0204|6|4| END| 9.09|C.Centers found | 1.11|135828|0 2019-06-25 19:12:31,653|MF|app-20190625191223-0204|6|4|START| 9.09|D.Disks found | 0.00| 0|0 2019-06-25 19:12:37,059|MF|app-20190625191223-0204|6|4| END| 14.50|D.Disks found | 5.41| 57332|0 2019-06-25 19:12:37,059|MF|app-20190625191223-0204|6|4|START| 14.50|E.Disks partitioned | 0.00| 0|0 2019-06-25 19:12:40,952|MF|app-20190625191223-0204|6|4| END| 18.39|E.Disks partitioned | 3.89| 81114|0 2019-06-25 19:12:40,953|MF|app-20190625191223-0204|6|4|START| 18.39|F.Maximal disks found | 0.00| 0|0 2019-06-25 19:12:40,955|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:12:40,955|Cell area: 1055533.7681000116 2019-06-25 19:12:53,534|MF|app-20190625191223-0204|6|4| END| 30.97|F.Maximal disks found | 12.58| 16742|0 2019-06-25 19:12:53,534|MAXIMALS|app-20190625191223-0204|4|6|100.0|3|900|24.781|16742 2019-06-25 19:12:55,094|FF|app-20190625191223-0204|6|4| END| 32.53|1.Maximal disks found | 26.34| 16742|0 2019-06-25 19:12:55,094|FF|app-20190625191223-0204|6|4|START| 32.53|1.Maximal disks found | 0.00| 0|1 2019-06-25 19:12:55,094|MF|app-20190625191223-0204|6|4|START| 32.53|A.Points indexed | 0.00| 0|1 2019-06-25 19:12:55,172|MF|app-20190625191223-0204|6|4| END| 32.61|A.Points indexed | 0.08| 36490|1 2019-06-25 19:12:55,172|MF|app-20190625191223-0204|6|4|START| 32.61|B.Pairs found | 0.00| 0|1 2019-06-25 19:12:55,927|MF|app-20190625191223-0204|6|4| END| 33.37|B.Pairs found | 0.76| 68924|1 2019-06-25 19:12:55,927|MF|app-20190625191223-0204|6|4|START| 33.37|C.Centers found | 0.00| 0|1 2019-06-25 19:12:56,698|MF|app-20190625191223-0204|6|4| END| 34.14|C.Centers found | 0.77|137848|1 2019-06-25 19:12:56,698|MF|app-20190625191223-0204|6|4|START| 34.14|D.Disks found | 0.00| 0|1 2019-06-25 19:13:00,782|MF|app-20190625191223-0204|6|4| END| 38.22|D.Disks found | 4.08| 58232|1 2019-06-25 19:13:00,782|MF|app-20190625191223-0204|6|4|START| 38.22|E.Disks partitioned | 0.00| 0|1 2019-06-25 19:13:02,847|MF|app-20190625191223-0204|6|4| END| 40.29|E.Disks partitioned | 2.07| 82341|1 2019-06-25 19:13:02,848|MF|app-20190625191223-0204|6|4|START| 40.29|F.Maximal disks found | 0.00| 0|1 2019-06-25 19:13:02,848|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:13:02,848|Cell area: 1055533.7681000116 2019-06-25 19:13:12,633|MF|app-20190625191223-0204|6|4| END| 50.07|F.Maximal disks found | 9.79| 17096|1 2019-06-25 19:13:12,633|MAXIMALS|app-20190625191223-0204|4|6|100.0|3|900|17.539|17096 2019-06-25 19:13:13,536|FF|app-20190625191223-0204|6|4| END| 50.97|1.Maximal disks found | 18.44| 17096|1 2019-06-25 19:13:13,536|FF|app-20190625191223-0204|6|4|START| 50.97|2.Join done | 0.00| 0|1 2019-06-25 19:13:18,539|FF|app-20190625191223-0204|6|4| END| 55.98|2.Join done | 5.00| 34283|1 2019-06-25 19:13:18,539|FF|app-20190625191223-0204|6|4|START| 55.98|3.Flocks to report | 0.00| 0|1 2019-06-25 19:13:19,349|FF|app-20190625191223-0204|6|4| END| 56.79|3.Flocks to report | 0.81| 0|1 2019-06-25 19:13:19,350|FF|app-20190625191223-0204|6|4|START| 56.79|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 19:13:19,394|FF|app-20190625191223-0204|6|4| END| 56.83|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 19:13:19,394|FF|app-20190625191223-0204|6|4|START| 56.83|5.Flocks reported | 0.00| 0|1 2019-06-25 19:13:19,400|FF|app-20190625191223-0204|6|4| END| 56.84|5.Flocks reported | 0.01| 0|1 2019-06-25 19:13:19,400|FF|app-20190625191223-0204|6|4|START| 56.84|6.Candidates indexed | 0.00| 0|1 2019-06-25 19:13:22,833|FF|app-20190625191223-0204|6|4| END| 60.27|6.Candidates indexed | 3.43| 35275|1 2019-06-25 19:13:22,833|FF|app-20190625191223-0204|6|4|START| 60.27|1.Maximal disks found | 0.00| 0|2 2019-06-25 19:13:22,833|MF|app-20190625191223-0204|6|4|START| 60.27|A.Points indexed | 0.00| 0|2 2019-06-25 19:13:22,907|MF|app-20190625191223-0204|6|4| END| 60.35|A.Points indexed | 0.07| 36788|2 2019-06-25 19:13:22,908|MF|app-20190625191223-0204|6|4|START| 60.35|B.Pairs found | 0.00| 0|2 2019-06-25 19:13:23,744|MF|app-20190625191223-0204|6|4| END| 61.18|B.Pairs found | 0.84| 69836|2 2019-06-25 19:13:23,745|MF|app-20190625191223-0204|6|4|START| 61.18|C.Centers found | 0.00| 0|2 2019-06-25 19:13:24,519|MF|app-20190625191223-0204|6|4| END| 61.96|C.Centers found | 0.77|139672|2 2019-06-25 19:13:24,519|MF|app-20190625191223-0204|6|4|START| 61.96|D.Disks found | 0.00| 0|2 2019-06-25 19:13:28,805|MF|app-20190625191223-0204|6|4| END| 66.24|D.Disks found | 4.29| 59098|2 2019-06-25 19:13:28,805|MF|app-20190625191223-0204|6|4|START| 66.24|E.Disks partitioned | 0.00| 0|2 2019-06-25 19:13:30,660|MF|app-20190625191223-0204|6|4| END| 68.10|E.Disks partitioned | 1.86| 83724|2 2019-06-25 19:13:30,660|MF|app-20190625191223-0204|6|4|START| 68.10|F.Maximal disks found | 0.00| 0|2 2019-06-25 19:13:30,660|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:13:30,660|Cell area: 1055533.7681000116 2019-06-25 19:13:41,569|MF|app-20190625191223-0204|6|4| END| 79.01|F.Maximal disks found | 10.91| 17376|2 2019-06-25 19:13:41,569|MAXIMALS|app-20190625191223-0204|4|6|100.0|3|900|18.736|17376 2019-06-25 19:13:42,471|FF|app-20190625191223-0204|6|4| END| 79.91|1.Maximal disks found | 19.64| 17376|2 2019-06-25 19:13:42,471|FF|app-20190625191223-0204|6|4|START| 79.91|2.Join done | 0.00| 0|2 2019-06-25 19:13:53,669|FF|app-20190625191223-0204|6|4| END| 91.11|2.Join done | 11.20| 65349|2 2019-06-25 19:13:53,670|FF|app-20190625191223-0204|6|4|START| 91.11|3.Flocks to report | 0.00| 0|2 2019-06-25 19:13:55,184|FF|app-20190625191223-0204|6|4| END| 92.62|3.Flocks to report | 1.51| 55752|2 2019-06-25 19:13:55,184|FF|app-20190625191223-0204|6|4|START| 92.62|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 19:13:55,225|FF|app-20190625191223-0204|6|4|START| 92.66|4a.Making expansions | 0.00| 0|2 2019-06-25 19:13:56,422|FF|app-20190625191223-0204|6|4| END| 93.86|4a.Making expansions | 1.20| 69363|2 2019-06-25 19:13:56,422|FF|app-20190625191223-0204|6|4|START| 93.86|4b.Finding maximals | 0.00| 0|2 2019-06-25 19:14:10,321|FF|app-20190625191223-0204|6|4| END|107.76|4b.Finding maximals | 13.90| 11394|2 2019-06-25 19:14:10,680|FF|app-20190625191223-0204|6|4| END|108.12|4.Flocks prunned by expansion | 15.50| 11394|2 2019-06-25 19:14:10,680|FF|app-20190625191223-0204|6|4|START|108.12|5.Flocks reported | 0.00| 0|2 2019-06-25 19:14:11,227|FF|app-20190625191223-0204|6|4| END|108.67|5.Flocks reported | 0.55| 11394|2 2019-06-25 19:14:11,228|FF|app-20190625191223-0204|6|4|START|108.67|6.Candidates indexed | 0.00| 0|2 2019-06-25 19:14:13,825|FF|app-20190625191223-0204|6|4| END|111.26|6.Candidates indexed | 2.60| 22156|2 2019-06-25 19:14:13,825|FF|app-20190625191223-0204|6|4|START|111.26|1.Maximal disks found | 0.00| 0|3 2019-06-25 19:14:13,825|MF|app-20190625191223-0204|6|4|START|111.26|A.Points indexed | 0.00| 0|3 2019-06-25 19:14:13,895|MF|app-20190625191223-0204|6|4| END|111.33|A.Points indexed | 0.07| 37096|3 2019-06-25 19:14:13,895|MF|app-20190625191223-0204|6|4|START|111.33|B.Pairs found | 0.00| 0|3 2019-06-25 19:14:14,509|MF|app-20190625191223-0204|6|4| END|111.95|B.Pairs found | 0.61| 71030|3 2019-06-25 19:14:14,509|MF|app-20190625191223-0204|6|4|START|111.95|C.Centers found | 0.00| 0|3 2019-06-25 19:14:15,183|MF|app-20190625191223-0204|6|4| END|112.62|C.Centers found | 0.67|142060|3 2019-06-25 19:14:15,183|MF|app-20190625191223-0204|6|4|START|112.62|D.Disks found | 0.00| 0|3 2019-06-25 19:14:18,815|MF|app-20190625191223-0204|6|4| END|116.25|D.Disks found | 3.63| 60284|3 2019-06-25 19:14:18,815|MF|app-20190625191223-0204|6|4|START|116.25|E.Disks partitioned | 0.00| 0|3 2019-06-25 19:14:20,811|MF|app-20190625191223-0204|6|4| END|118.25|E.Disks partitioned | 2.00| 85409|3 2019-06-25 19:14:20,811|MF|app-20190625191223-0204|6|4|START|118.25|F.Maximal disks found | 0.00| 0|3 2019-06-25 19:14:20,811|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:14:20,811|Cell area: 1055533.7681000116 2019-06-25 19:14:33,217|MF|app-20190625191223-0204|6|4| END|130.66|F.Maximal disks found | 12.41| 17693|3 2019-06-25 19:14:33,217|MAXIMALS|app-20190625191223-0204|4|6|100.0|3|900|19.392|17693 2019-06-25 19:14:34,123|FF|app-20190625191223-0204|6|4| END|131.56|1.Maximal disks found | 20.30| 17693|3 2019-06-25 19:14:34,123|FF|app-20190625191223-0204|6|4|START|131.56|2.Join done | 0.00| 0|3 2019-06-25 19:14:41,604|FF|app-20190625191223-0204|6|4| END|139.04|2.Join done | 7.48| 60349|3 2019-06-25 19:14:41,604|FF|app-20190625191223-0204|6|4|START|139.04|3.Flocks to report | 0.00| 0|3 2019-06-25 19:14:43,207|FF|app-20190625191223-0204|6|4| END|140.65|3.Flocks to report | 1.60| 50613|3 2019-06-25 19:14:43,207|FF|app-20190625191223-0204|6|4|START|140.65|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 19:14:43,256|FF|app-20190625191223-0204|6|4|START|140.69|4a.Making expansions | 0.00| 0|3 2019-06-25 19:14:44,528|FF|app-20190625191223-0204|6|4| END|141.97|4a.Making expansions | 1.27| 64334|3 2019-06-25 19:14:44,528|FF|app-20190625191223-0204|6|4|START|141.97|4b.Finding maximals | 0.00| 0|3 2019-06-25 19:14:55,774|FF|app-20190625191223-0204|6|4| END|153.21|4b.Finding maximals | 11.25| 11534|3 2019-06-25 19:14:56,146|FF|app-20190625191223-0204|6|4| END|153.58|4.Flocks prunned by expansion | 12.94| 11534|3 2019-06-25 19:14:56,146|FF|app-20190625191223-0204|6|4|START|153.58|5.Flocks reported | 0.00| 0|3 2019-06-25 19:14:56,794|FF|app-20190625191223-0204|6|4| END|154.23|5.Flocks reported | 0.65| 11534|3 2019-06-25 19:14:56,794|FF|app-20190625191223-0204|6|4|START|154.23|6.Candidates indexed | 0.00| 0|3 2019-06-25 19:14:59,379|FF|app-20190625191223-0204|6|4| END|156.82|6.Candidates indexed | 2.59| 22352|3 2019-06-25 19:15:00,738|Number of flocks: 22928 2019-06-25 19:15:01,562|PFLOCK|app-20190625191223-0204|4|6|100.0|3|3|152.01|22928 2019-06-25 19:15:02,311|FF|app-20190625191223-0204|6|4| END|159.75|Flock Finder run |153.58| 22928|3 2019-06-25 19:15:02,311|FF|app-20190625191223-0204|6|4|START|159.75|Session closed | 0.00| 0|3 2019-06-25 19:15:08,995|FF|app-20190625191223-0204|6|4| END|166.43|Session closed | 6.68| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 3 --fftimestamp 4 --portui 4040 --info 2019-06-25 19:15:10,969|FF|app-00000000000000-0000|3|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 19:15:12,074|FF|app-20190625191511-0205|3|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 19:15:12,074|FF|app-20190625191511-0205|3|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 19:15:15,811|FF|app-20190625191511-0205|3|4| END| 4.83|Data read | 3.74|110376|-1 2019-06-25 19:15:15,811|FF|app-20190625191511-0205|3|4|START| 4.83|KDBTree partitioner | 0.00| 0|-1 2019-06-25 19:15:15,929|FF|app-20190625191511-0205|3|4| END| 4.94|KDBTree partitioner | 0.12| 272|-1 2019-06-25 19:15:15,929|FF|app-20190625191511-0205|3|4|START| 4.94|MF partitioner | 0.00| 0|-1 2019-06-25 19:15:15,940|FF|app-20190625191511-0205|3|4| END| 4.95|MF partitioner | 0.01| 450|-1 2019-06-25 19:15:15,940|FF|app-20190625191511-0205|3|4|START| 4.95|Pointset done | 0.00| 0|-1 2019-06-25 19:15:16,764|FF|app-20190625191511-0205|3|4| END| 5.78|Pointset done | 0.82| 4|-1 2019-06-25 19:15:16,764|FF|app-20190625191511-0205|3|4|START| 5.78|Flock Finder run | 0.00| 0|-1 2019-06-25 19:15:16,782|FF|app-20190625191511-0205|3|4|START| 5.80|1.Maximal disks found | 0.00| 0|0 2019-06-25 19:15:16,785|MF|app-20190625191511-0205|3|4|START| 5.80|A.Points indexed | 0.00| 0|0 2019-06-25 19:15:16,934|MF|app-20190625191511-0205|3|4| END| 5.95|A.Points indexed | 0.15| 18093|0 2019-06-25 19:15:16,934|MF|app-20190625191511-0205|3|4|START| 5.95|B.Pairs found | 0.00| 0|0 2019-06-25 19:15:18,323|MF|app-20190625191511-0205|3|4| END| 7.34|B.Pairs found | 1.39| 33957|0 2019-06-25 19:15:18,323|MF|app-20190625191511-0205|3|4|START| 7.34|C.Centers found | 0.00| 0|0 2019-06-25 19:15:19,166|MF|app-20190625191511-0205|3|4| END| 8.18|C.Centers found | 0.84| 67914|0 2019-06-25 19:15:19,166|MF|app-20190625191511-0205|3|4|START| 8.18|D.Disks found | 0.00| 0|0 2019-06-25 19:15:22,347|MF|app-20190625191511-0205|3|4| END| 11.36|D.Disks found | 3.18| 28666|0 2019-06-25 19:15:22,347|MF|app-20190625191511-0205|3|4|START| 11.36|E.Disks partitioned | 0.00| 0|0 2019-06-25 19:15:23,236|MF|app-20190625191511-0205|3|4| END| 12.25|E.Disks partitioned | 0.89| 40550|0 2019-06-25 19:15:23,236|MF|app-20190625191511-0205|3|4|START| 12.25|F.Maximal disks found | 0.00| 0|0 2019-06-25 19:15:23,238|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:15:23,238|Cell area: 1055533.7681000116 2019-06-25 19:15:33,295|MF|app-20190625191511-0205|3|4| END| 22.31|F.Maximal disks found | 10.06| 8371|0 2019-06-25 19:15:33,295|MAXIMALS|app-20190625191511-0205|4|3|100.0|3|450|16.51|8371 2019-06-25 19:15:33,789|FF|app-20190625191511-0205|3|4| END| 22.80|1.Maximal disks found | 17.01| 8371|0 2019-06-25 19:15:33,789|FF|app-20190625191511-0205|3|4|START| 22.80|1.Maximal disks found | 0.00| 0|1 2019-06-25 19:15:33,789|MF|app-20190625191511-0205|3|4|START| 22.80|A.Points indexed | 0.00| 0|1 2019-06-25 19:15:33,855|MF|app-20190625191511-0205|3|4| END| 22.87|A.Points indexed | 0.07| 18245|1 2019-06-25 19:15:33,855|MF|app-20190625191511-0205|3|4|START| 22.87|B.Pairs found | 0.00| 0|1 2019-06-25 19:15:34,322|MF|app-20190625191511-0205|3|4| END| 23.34|B.Pairs found | 0.47| 34462|1 2019-06-25 19:15:34,322|MF|app-20190625191511-0205|3|4|START| 23.34|C.Centers found | 0.00| 0|1 2019-06-25 19:15:34,846|MF|app-20190625191511-0205|3|4| END| 23.86|C.Centers found | 0.52| 68924|1 2019-06-25 19:15:34,846|MF|app-20190625191511-0205|3|4|START| 23.86|D.Disks found | 0.00| 0|1 2019-06-25 19:15:37,104|MF|app-20190625191511-0205|3|4| END| 26.12|D.Disks found | 2.26| 29116|1 2019-06-25 19:15:37,104|MF|app-20190625191511-0205|3|4|START| 26.12|E.Disks partitioned | 0.00| 0|1 2019-06-25 19:15:37,914|MF|app-20190625191511-0205|3|4| END| 26.93|E.Disks partitioned | 0.81| 41162|1 2019-06-25 19:15:37,914|MF|app-20190625191511-0205|3|4|START| 26.93|F.Maximal disks found | 0.00| 0|1 2019-06-25 19:15:37,914|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:15:37,914|Cell area: 1055533.7681000116 2019-06-25 19:15:47,908|MF|app-20190625191511-0205|3|4| END| 36.92|F.Maximal disks found | 9.99| 8547|1 2019-06-25 19:15:47,908|MAXIMALS|app-20190625191511-0205|4|3|100.0|3|450|14.119|8547 2019-06-25 19:15:48,341|FF|app-20190625191511-0205|3|4| END| 37.36|1.Maximal disks found | 14.55| 8547|1 2019-06-25 19:15:48,341|FF|app-20190625191511-0205|3|4|START| 37.36|2.Join done | 0.00| 0|1 2019-06-25 19:15:50,389|FF|app-20190625191511-0205|3|4| END| 39.40|2.Join done | 2.05| 17137|1 2019-06-25 19:15:50,389|FF|app-20190625191511-0205|3|4|START| 39.40|3.Flocks to report | 0.00| 0|1 2019-06-25 19:15:50,765|FF|app-20190625191511-0205|3|4| END| 39.78|3.Flocks to report | 0.38| 0|1 2019-06-25 19:15:50,765|FF|app-20190625191511-0205|3|4|START| 39.78|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 19:15:50,796|FF|app-20190625191511-0205|3|4| END| 39.81|4.Flocks prunned by expansion | 0.03| 0|1 2019-06-25 19:15:50,796|FF|app-20190625191511-0205|3|4|START| 39.81|5.Flocks reported | 0.00| 0|1 2019-06-25 19:15:50,801|FF|app-20190625191511-0205|3|4| END| 39.82|5.Flocks reported | 0.01| 0|1 2019-06-25 19:15:50,801|FF|app-20190625191511-0205|3|4|START| 39.82|6.Candidates indexed | 0.00| 0|1 2019-06-25 19:15:52,131|FF|app-20190625191511-0205|3|4| END| 41.15|6.Candidates indexed | 1.33| 17633|1 2019-06-25 19:15:52,131|FF|app-20190625191511-0205|3|4|START| 41.15|1.Maximal disks found | 0.00| 0|2 2019-06-25 19:15:52,131|MF|app-20190625191511-0205|3|4|START| 41.15|A.Points indexed | 0.00| 0|2 2019-06-25 19:15:52,189|MF|app-20190625191511-0205|3|4| END| 41.20|A.Points indexed | 0.06| 18394|2 2019-06-25 19:15:52,189|MF|app-20190625191511-0205|3|4|START| 41.20|B.Pairs found | 0.00| 0|2 2019-06-25 19:15:52,630|MF|app-20190625191511-0205|3|4| END| 41.64|B.Pairs found | 0.44| 34918|2 2019-06-25 19:15:52,630|MF|app-20190625191511-0205|3|4|START| 41.64|C.Centers found | 0.00| 0|2 2019-06-25 19:15:53,104|MF|app-20190625191511-0205|3|4| END| 42.12|C.Centers found | 0.47| 69836|2 2019-06-25 19:15:53,104|MF|app-20190625191511-0205|3|4|START| 42.12|D.Disks found | 0.00| 0|2 2019-06-25 19:15:55,316|MF|app-20190625191511-0205|3|4| END| 44.33|D.Disks found | 2.21| 29549|2 2019-06-25 19:15:55,316|MF|app-20190625191511-0205|3|4|START| 44.33|E.Disks partitioned | 0.00| 0|2 2019-06-25 19:15:56,004|MF|app-20190625191511-0205|3|4| END| 45.02|E.Disks partitioned | 0.69| 41840|2 2019-06-25 19:15:56,004|MF|app-20190625191511-0205|3|4|START| 45.02|F.Maximal disks found | 0.00| 0|2 2019-06-25 19:15:56,004|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:15:56,004|Cell area: 1055533.7681000116 2019-06-25 19:16:05,584|MF|app-20190625191511-0205|3|4| END| 54.60|F.Maximal disks found | 9.58| 8685|2 2019-06-25 19:16:05,584|MAXIMALS|app-20190625191511-0205|4|3|100.0|3|450|13.453|8685 2019-06-25 19:16:05,984|FF|app-20190625191511-0205|3|4| END| 55.00|1.Maximal disks found | 13.85| 8685|2 2019-06-25 19:16:05,984|FF|app-20190625191511-0205|3|4|START| 55.00|2.Join done | 0.00| 0|2 2019-06-25 19:16:12,458|FF|app-20190625191511-0205|3|4| END| 61.47|2.Join done | 6.47| 32677|2 2019-06-25 19:16:12,458|FF|app-20190625191511-0205|3|4|START| 61.47|3.Flocks to report | 0.00| 0|2 2019-06-25 19:16:13,296|FF|app-20190625191511-0205|3|4| END| 62.31|3.Flocks to report | 0.84| 27878|2 2019-06-25 19:16:13,296|FF|app-20190625191511-0205|3|4|START| 62.31|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 19:16:13,328|FF|app-20190625191511-0205|3|4|START| 62.34|4a.Making expansions | 0.00| 0|2 2019-06-25 19:16:13,904|FF|app-20190625191511-0205|3|4| END| 62.92|4a.Making expansions | 0.58| 34672|2 2019-06-25 19:16:13,904|FF|app-20190625191511-0205|3|4|START| 62.92|4b.Finding maximals | 0.00| 0|2 2019-06-25 19:16:28,517|FF|app-20190625191511-0205|3|4| END| 77.53|4b.Finding maximals | 14.61| 5697|2 2019-06-25 19:16:28,731|FF|app-20190625191511-0205|3|4| END| 77.75|4.Flocks prunned by expansion | 15.44| 5697|2 2019-06-25 19:16:28,732|FF|app-20190625191511-0205|3|4|START| 77.75|5.Flocks reported | 0.00| 0|2 2019-06-25 19:16:29,036|FF|app-20190625191511-0205|3|4| END| 78.05|5.Flocks reported | 0.31| 5697|2 2019-06-25 19:16:29,036|FF|app-20190625191511-0205|3|4|START| 78.05|6.Candidates indexed | 0.00| 0|2 2019-06-25 19:16:30,636|FF|app-20190625191511-0205|3|4| END| 79.65|6.Candidates indexed | 1.60| 11079|2 2019-06-25 19:16:30,637|FF|app-20190625191511-0205|3|4|START| 79.65|1.Maximal disks found | 0.00| 0|3 2019-06-25 19:16:30,637|MF|app-20190625191511-0205|3|4|START| 79.65|A.Points indexed | 0.00| 0|3 2019-06-25 19:16:30,686|MF|app-20190625191511-0205|3|4| END| 79.70|A.Points indexed | 0.05| 18548|3 2019-06-25 19:16:30,686|MF|app-20190625191511-0205|3|4|START| 79.70|B.Pairs found | 0.00| 0|3 2019-06-25 19:16:31,617|MF|app-20190625191511-0205|3|4| END| 80.63|B.Pairs found | 0.93| 35515|3 2019-06-25 19:16:31,617|MF|app-20190625191511-0205|3|4|START| 80.63|C.Centers found | 0.00| 0|3 2019-06-25 19:16:32,386|MF|app-20190625191511-0205|3|4| END| 81.40|C.Centers found | 0.77| 71030|3 2019-06-25 19:16:32,386|MF|app-20190625191511-0205|3|4|START| 81.40|D.Disks found | 0.00| 0|3 2019-06-25 19:16:37,127|MF|app-20190625191511-0205|3|4| END| 86.14|D.Disks found | 4.74| 30142|3 2019-06-25 19:16:37,127|MF|app-20190625191511-0205|3|4|START| 86.14|E.Disks partitioned | 0.00| 0|3 2019-06-25 19:16:38,663|MF|app-20190625191511-0205|3|4| END| 87.68|E.Disks partitioned | 1.54| 42665|3 2019-06-25 19:16:38,663|MF|app-20190625191511-0205|3|4|START| 87.68|F.Maximal disks found | 0.00| 0|3 2019-06-25 19:16:38,664|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:16:38,664|Cell area: 1055533.7681000116 2019-06-25 19:16:50,847|MF|app-20190625191511-0205|3|4| END| 99.86|F.Maximal disks found | 12.18| 8846|3 2019-06-25 19:16:50,847|MAXIMALS|app-20190625191511-0205|4|3|100.0|3|450|20.21|8846 2019-06-25 19:16:51,544|FF|app-20190625191511-0205|3|4| END|100.56|1.Maximal disks found | 20.91| 8846|3 2019-06-25 19:16:51,544|FF|app-20190625191511-0205|3|4|START|100.56|2.Join done | 0.00| 0|3 2019-06-25 19:16:57,948|FF|app-20190625191511-0205|3|4| END|106.96|2.Join done | 6.40| 30191|3 2019-06-25 19:16:57,948|FF|app-20190625191511-0205|3|4|START|106.96|3.Flocks to report | 0.00| 0|3 2019-06-25 19:16:59,397|FF|app-20190625191511-0205|3|4| END|108.41|3.Flocks to report | 1.45| 25329|3 2019-06-25 19:16:59,397|FF|app-20190625191511-0205|3|4|START|108.41|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 19:16:59,437|FF|app-20190625191511-0205|3|4|START|108.45|4a.Making expansions | 0.00| 0|3 2019-06-25 19:17:00,410|FF|app-20190625191511-0205|3|4| END|109.42|4a.Making expansions | 0.97| 32170|3 2019-06-25 19:17:00,410|FF|app-20190625191511-0205|3|4|START|109.42|4b.Finding maximals | 0.00| 0|3 2019-06-25 19:17:10,235|FF|app-20190625191511-0205|3|4| END|119.25|4b.Finding maximals | 9.83| 5767|3 2019-06-25 19:17:10,524|FF|app-20190625191511-0205|3|4| END|119.54|4.Flocks prunned by expansion | 11.13| 5767|3 2019-06-25 19:17:10,524|FF|app-20190625191511-0205|3|4|START|119.54|5.Flocks reported | 0.00| 0|3 2019-06-25 19:17:10,970|FF|app-20190625191511-0205|3|4| END|119.98|5.Flocks reported | 0.45| 5767|3 2019-06-25 19:17:10,970|FF|app-20190625191511-0205|3|4|START|119.98|6.Candidates indexed | 0.00| 0|3 2019-06-25 19:17:13,878|FF|app-20190625191511-0205|3|4| END|122.89|6.Candidates indexed | 2.91| 11171|3 2019-06-25 19:17:14,794|Number of flocks: 11464 2019-06-25 19:17:15,260|PFLOCK|app-20190625191511-0205|4|3|100.0|3|3|118.03|11464 2019-06-25 19:17:15,714|FF|app-20190625191511-0205|3|4| END|124.73|Flock Finder run |118.95| 11464|3 2019-06-25 19:17:15,714|FF|app-20190625191511-0205|3|4|START|124.73|Session closed | 0.00| 0|3 2019-06-25 19:17:22,626|FF|app-20190625191511-0205|3|4| END|131.64|Session closed | 6.91| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B4_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_grid-60x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 12 --fftimestamp 4 --portui 4040 --info 2019-06-25 19:17:24,616|FF|app-00000000000000-0000|12|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 19:17:25,708|FF|app-20190625191725-0206|12|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 19:17:25,709|FF|app-20190625191725-0206|12|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 19:17:29,941|FF|app-20190625191725-0206|12|4| END| 5.31|Data read | 4.23|441504|-1 2019-06-25 19:17:29,942|FF|app-20190625191725-0206|12|4|START| 5.31|KDBTree partitioner | 0.00| 0|-1 2019-06-25 19:17:30,120|FF|app-20190625191725-0206|12|4| END| 5.49|KDBTree partitioner | 0.18| 1088|-1 2019-06-25 19:17:30,120|FF|app-20190625191725-0206|12|4|START| 5.49|MF partitioner | 0.00| 0|-1 2019-06-25 19:17:30,153|FF|app-20190625191725-0206|12|4| END| 5.52|MF partitioner | 0.03| 1800|-1 2019-06-25 19:17:30,153|FF|app-20190625191725-0206|12|4|START| 5.52|Pointset done | 0.00| 0|-1 2019-06-25 19:17:31,226|FF|app-20190625191725-0206|12|4| END| 6.59|Pointset done | 1.07| 4|-1 2019-06-25 19:17:31,226|FF|app-20190625191725-0206|12|4|START| 6.59|Flock Finder run | 0.00| 0|-1 2019-06-25 19:17:31,249|FF|app-20190625191725-0206|12|4|START| 6.62|1.Maximal disks found | 0.00| 0|0 2019-06-25 19:17:31,253|MF|app-20190625191725-0206|12|4|START| 6.62|A.Points indexed | 0.00| 0|0 2019-06-25 19:17:31,459|MF|app-20190625191725-0206|12|4| END| 6.83|A.Points indexed | 0.21| 72372|0 2019-06-25 19:17:31,459|MF|app-20190625191725-0206|12|4|START| 6.83|B.Pairs found | 0.00| 0|0 2019-06-25 19:17:33,390|MF|app-20190625191725-0206|12|4| END| 8.76|B.Pairs found | 1.93|157616|0 2019-06-25 19:17:33,390|MF|app-20190625191725-0206|12|4|START| 8.76|C.Centers found | 0.00| 0|0 2019-06-25 19:17:34,596|MF|app-20190625191725-0206|12|4| END| 9.96|C.Centers found | 1.21|315232|0 2019-06-25 19:17:34,597|MF|app-20190625191725-0206|12|4|START| 9.97|D.Disks found | 0.00| 0|0 2019-06-25 19:17:39,411|MF|app-20190625191725-0206|12|4| END| 14.78|D.Disks found | 4.81|140916|0 2019-06-25 19:17:39,411|MF|app-20190625191725-0206|12|4|START| 14.78|E.Disks partitioned | 0.00| 0|0 2019-06-25 19:17:41,117|MF|app-20190625191725-0206|12|4| END| 16.49|E.Disks partitioned | 1.71|206209|0 2019-06-25 19:17:41,117|MF|app-20190625191725-0206|12|4|START| 16.49|F.Maximal disks found | 0.00| 0|0 2019-06-25 19:17:41,119|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:17:41,119|Cell area: 1055533.7681000116 2019-06-25 19:18:06,797|MF|app-20190625191725-0206|12|4| END| 42.17|F.Maximal disks found | 25.68| 40009|0 2019-06-25 19:18:06,797|MAXIMALS|app-20190625191725-0206|4|12|110.0|3|1800|35.545|40009 2019-06-25 19:18:08,177|FF|app-20190625191725-0206|12|4| END| 43.55|1.Maximal disks found | 36.93| 40009|0 2019-06-25 19:18:08,177|FF|app-20190625191725-0206|12|4|START| 43.55|1.Maximal disks found | 0.00| 0|1 2019-06-25 19:18:08,177|MF|app-20190625191725-0206|12|4|START| 43.55|A.Points indexed | 0.00| 0|1 2019-06-25 19:18:08,312|MF|app-20190625191725-0206|12|4| END| 43.68|A.Points indexed | 0.14| 72980|1 2019-06-25 19:18:08,312|MF|app-20190625191725-0206|12|4|START| 43.68|B.Pairs found | 0.00| 0|1 2019-06-25 19:18:09,104|MF|app-20190625191725-0206|12|4| END| 44.47|B.Pairs found | 0.79|159996|1 2019-06-25 19:18:09,104|MF|app-20190625191725-0206|12|4|START| 44.47|C.Centers found | 0.00| 0|1 2019-06-25 19:18:09,917|MF|app-20190625191725-0206|12|4| END| 45.29|C.Centers found | 0.81|319992|1 2019-06-25 19:18:09,917|MF|app-20190625191725-0206|12|4|START| 45.29|D.Disks found | 0.00| 0|1 2019-06-25 19:18:13,444|MF|app-20190625191725-0206|12|4| END| 48.81|D.Disks found | 3.53|143396|1 2019-06-25 19:18:13,444|MF|app-20190625191725-0206|12|4|START| 48.81|E.Disks partitioned | 0.00| 0|1 2019-06-25 19:18:14,842|MF|app-20190625191725-0206|12|4| END| 50.21|E.Disks partitioned | 1.40|209660|1 2019-06-25 19:18:14,842|MF|app-20190625191725-0206|12|4|START| 50.21|F.Maximal disks found | 0.00| 0|1 2019-06-25 19:18:14,843|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:18:14,843|Cell area: 1055533.7681000116 2019-06-25 19:18:41,671|MF|app-20190625191725-0206|12|4| END| 77.04|F.Maximal disks found | 26.83| 40432|1 2019-06-25 19:18:41,671|MAXIMALS|app-20190625191725-0206|4|12|110.0|3|1800|33.494|40432 2019-06-25 19:18:43,024|FF|app-20190625191725-0206|12|4| END| 78.39|1.Maximal disks found | 34.85| 40432|1 2019-06-25 19:18:43,025|FF|app-20190625191725-0206|12|4|START| 78.39|2.Join done | 0.00| 0|1 2019-06-25 19:18:46,976|FF|app-20190625191725-0206|12|4| END| 82.34|2.Join done | 3.95| 87506|1 2019-06-25 19:18:46,977|FF|app-20190625191725-0206|12|4|START| 82.34|3.Flocks to report | 0.00| 0|1 2019-06-25 19:18:47,576|FF|app-20190625191725-0206|12|4| END| 82.94|3.Flocks to report | 0.60| 0|1 2019-06-25 19:18:47,576|FF|app-20190625191725-0206|12|4|START| 82.94|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 19:18:47,635|FF|app-20190625191725-0206|12|4| END| 83.00|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 19:18:47,635|FF|app-20190625191725-0206|12|4|START| 83.00|5.Flocks reported | 0.00| 0|1 2019-06-25 19:18:47,640|FF|app-20190625191725-0206|12|4| END| 83.01|5.Flocks reported | 0.01| 0|1 2019-06-25 19:18:47,641|FF|app-20190625191725-0206|12|4|START| 83.01|6.Candidates indexed | 0.00| 0|1 2019-06-25 19:18:49,838|FF|app-20190625191725-0206|12|4| END| 85.21|6.Candidates indexed | 2.20| 89925|1 2019-06-25 19:18:49,838|FF|app-20190625191725-0206|12|4|START| 85.21|1.Maximal disks found | 0.00| 0|2 2019-06-25 19:18:49,838|MF|app-20190625191725-0206|12|4|START| 85.21|A.Points indexed | 0.00| 0|2 2019-06-25 19:18:49,946|MF|app-20190625191725-0206|12|4| END| 85.31|A.Points indexed | 0.11| 73576|2 2019-06-25 19:18:49,946|MF|app-20190625191725-0206|12|4|START| 85.31|B.Pairs found | 0.00| 0|2 2019-06-25 19:18:50,724|MF|app-20190625191725-0206|12|4| END| 86.09|B.Pairs found | 0.78|162264|2 2019-06-25 19:18:50,724|MF|app-20190625191725-0206|12|4|START| 86.09|C.Centers found | 0.00| 0|2 2019-06-25 19:18:51,552|MF|app-20190625191725-0206|12|4| END| 86.92|C.Centers found | 0.83|324528|2 2019-06-25 19:18:51,552|MF|app-20190625191725-0206|12|4|START| 86.92|D.Disks found | 0.00| 0|2 2019-06-25 19:18:54,987|MF|app-20190625191725-0206|12|4| END| 90.36|D.Disks found | 3.44|145412|2 2019-06-25 19:18:54,987|MF|app-20190625191725-0206|12|4|START| 90.36|E.Disks partitioned | 0.00| 0|2 2019-06-25 19:18:56,296|MF|app-20190625191725-0206|12|4| END| 91.66|E.Disks partitioned | 1.31|212798|2 2019-06-25 19:18:56,296|MF|app-20190625191725-0206|12|4|START| 91.66|F.Maximal disks found | 0.00| 0|2 2019-06-25 19:18:56,297|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:18:56,297|Cell area: 1055533.7681000116 2019-06-25 19:19:23,252|MF|app-20190625191725-0206|12|4| END|118.62|F.Maximal disks found | 26.96| 41347|2 2019-06-25 19:19:23,253|MAXIMALS|app-20190625191725-0206|4|12|110.0|3|1800|33.415|41347 2019-06-25 19:19:24,615|FF|app-20190625191725-0206|12|4| END|119.98|1.Maximal disks found | 34.78| 41347|2 2019-06-25 19:19:24,615|FF|app-20190625191725-0206|12|4|START|119.98|2.Join done | 0.00| 0|2 2019-06-25 19:19:34,737|FF|app-20190625191725-0206|12|4| END|130.11|2.Join done | 10.12|179268|2 2019-06-25 19:19:34,737|FF|app-20190625191725-0206|12|4|START|130.11|3.Flocks to report | 0.00| 0|2 2019-06-25 19:19:35,690|FF|app-20190625191725-0206|12|4| END|131.06|3.Flocks to report | 0.95|153105|2 2019-06-25 19:19:35,690|FF|app-20190625191725-0206|12|4|START|131.06|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 19:19:35,748|FF|app-20190625191725-0206|12|4|START|131.12|4a.Making expansions | 0.00| 0|2 2019-06-25 19:19:36,770|FF|app-20190625191725-0206|12|4| END|132.14|4a.Making expansions | 1.02|191307|2 2019-06-25 19:19:36,770|FF|app-20190625191725-0206|12|4|START|132.14|4b.Finding maximals | 0.00| 0|2 2019-06-25 19:20:23,007|FF|app-20190625191725-0206|12|4| END|178.38|4b.Finding maximals | 46.24| 26404|2 2019-06-25 19:20:23,687|FF|app-20190625191725-0206|12|4| END|179.06|4.Flocks prunned by expansion | 48.00| 26404|2 2019-06-25 19:20:23,687|FF|app-20190625191725-0206|12|4|START|179.06|5.Flocks reported | 0.00| 0|2 2019-06-25 19:20:24,460|FF|app-20190625191725-0206|12|4| END|179.83|5.Flocks reported | 0.77| 26404|2 2019-06-25 19:20:24,461|FF|app-20190625191725-0206|12|4|START|179.83|6.Candidates indexed | 0.00| 0|2 2019-06-25 19:20:26,917|FF|app-20190625191725-0206|12|4| END|182.29|6.Candidates indexed | 2.46| 55147|2 2019-06-25 19:20:26,917|FF|app-20190625191725-0206|12|4|START|182.29|1.Maximal disks found | 0.00| 0|3 2019-06-25 19:20:26,917|MF|app-20190625191725-0206|12|4|START|182.29|A.Points indexed | 0.00| 0|3 2019-06-25 19:20:27,019|MF|app-20190625191725-0206|12|4| END|182.39|A.Points indexed | 0.10| 74192|3 2019-06-25 19:20:27,019|MF|app-20190625191725-0206|12|4|START|182.39|B.Pairs found | 0.00| 0|3 2019-06-25 19:20:27,952|MF|app-20190625191725-0206|12|4| END|183.32|B.Pairs found | 0.93|165028|3 2019-06-25 19:20:27,952|MF|app-20190625191725-0206|12|4|START|183.32|C.Centers found | 0.00| 0|3 2019-06-25 19:20:28,705|MF|app-20190625191725-0206|12|4| END|184.07|C.Centers found | 0.75|330056|3 2019-06-25 19:20:28,705|MF|app-20190625191725-0206|12|4|START|184.07|D.Disks found | 0.00| 0|3 2019-06-25 19:20:32,055|MF|app-20190625191725-0206|12|4| END|187.42|D.Disks found | 3.35|148348|3 2019-06-25 19:20:32,055|MF|app-20190625191725-0206|12|4|START|187.42|E.Disks partitioned | 0.00| 0|3 2019-06-25 19:20:33,303|MF|app-20190625191725-0206|12|4| END|188.67|E.Disks partitioned | 1.25|217088|3 2019-06-25 19:20:33,303|MF|app-20190625191725-0206|12|4|START|188.67|F.Maximal disks found | 0.00| 0|3 2019-06-25 19:20:33,304|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:20:33,304|Cell area: 1055533.7681000116 2019-06-25 19:21:06,946|MF|app-20190625191725-0206|12|4| END|222.31|F.Maximal disks found | 33.64| 42012|3 2019-06-25 19:21:06,946|MAXIMALS|app-20190625191725-0206|4|12|110.0|3|1800|40.029|42012 2019-06-25 19:21:08,317|FF|app-20190625191725-0206|12|4| END|223.69|1.Maximal disks found | 41.40| 42012|3 2019-06-25 19:21:08,317|FF|app-20190625191725-0206|12|4|START|223.69|2.Join done | 0.00| 0|3 2019-06-25 19:21:14,885|FF|app-20190625191725-0206|12|4| END|230.25|2.Join done | 6.57|179709|3 2019-06-25 19:21:14,885|FF|app-20190625191725-0206|12|4|START|230.25|3.Flocks to report | 0.00| 0|3 2019-06-25 19:21:15,782|FF|app-20190625191725-0206|12|4| END|231.15|3.Flocks to report | 0.90|153488|3 2019-06-25 19:21:15,782|FF|app-20190625191725-0206|12|4|START|231.15|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 19:21:15,847|FF|app-20190625191725-0206|12|4|START|231.22|4a.Making expansions | 0.00| 0|3 2019-06-25 19:21:16,969|FF|app-20190625191725-0206|12|4| END|232.34|4a.Making expansions | 1.12|191742|3 2019-06-25 19:21:16,969|FF|app-20190625191725-0206|12|4|START|232.34|4b.Finding maximals | 0.00| 0|3 2019-06-25 19:22:24,358|FF|app-20190625191725-0206|12|4| END|299.73|4b.Finding maximals | 67.39| 26676|3 2019-06-25 19:22:24,958|FF|app-20190625191725-0206|12|4| END|300.33|4.Flocks prunned by expansion | 69.18| 26676|3 2019-06-25 19:22:24,958|FF|app-20190625191725-0206|12|4|START|300.33|5.Flocks reported | 0.00| 0|3 2019-06-25 19:22:25,828|FF|app-20190625191725-0206|12|4| END|301.20|5.Flocks reported | 0.87| 26676|3 2019-06-25 19:22:25,828|FF|app-20190625191725-0206|12|4|START|301.20|6.Candidates indexed | 0.00| 0|3 2019-06-25 19:22:28,369|FF|app-20190625191725-0206|12|4| END|303.74|6.Candidates indexed | 2.54| 55524|3 2019-06-25 19:22:30,169|Number of flocks: 53080 2019-06-25 19:22:31,399|PFLOCK|app-20190625191725-0206|4|12|110.0|3|3|298.94|53080 2019-06-25 19:22:32,620|FF|app-20190625191725-0206|12|4| END|307.99|Flock Finder run |301.39| 53080|3 2019-06-25 19:22:32,620|FF|app-20190625191725-0206|12|4|START|307.99|Session closed | 0.00| 0|3 2019-06-25 19:22:43,219|FF|app-20190625191725-0206|12|4| END|318.59|Session closed | 10.60| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 6 --fftimestamp 4 --portui 4040 --info 2019-06-25 19:22:44,874|FF|app-00000000000000-0000|6|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 19:22:45,979|FF|app-20190625192245-0207|6|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 19:22:45,979|FF|app-20190625192245-0207|6|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 19:22:49,891|FF|app-20190625192245-0207|6|4| END| 5.00|Data read | 3.91|220752|-1 2019-06-25 19:22:49,891|FF|app-20190625192245-0207|6|4|START| 5.00|KDBTree partitioner | 0.00| 0|-1 2019-06-25 19:22:50,182|FF|app-20190625192245-0207|6|4| END| 5.29|KDBTree partitioner | 0.29| 544|-1 2019-06-25 19:22:50,183|FF|app-20190625192245-0207|6|4|START| 5.29|MF partitioner | 0.00| 0|-1 2019-06-25 19:22:50,200|FF|app-20190625192245-0207|6|4| END| 5.31|MF partitioner | 0.02| 900|-1 2019-06-25 19:22:50,200|FF|app-20190625192245-0207|6|4|START| 5.31|Pointset done | 0.00| 0|-1 2019-06-25 19:22:51,176|FF|app-20190625192245-0207|6|4| END| 6.29|Pointset done | 0.98| 4|-1 2019-06-25 19:22:51,176|FF|app-20190625192245-0207|6|4|START| 6.29|Flock Finder run | 0.00| 0|-1 2019-06-25 19:22:51,198|FF|app-20190625192245-0207|6|4|START| 6.31|1.Maximal disks found | 0.00| 0|0 2019-06-25 19:22:51,201|MF|app-20190625192245-0207|6|4|START| 6.31|A.Points indexed | 0.00| 0|0 2019-06-25 19:22:51,371|MF|app-20190625192245-0207|6|4| END| 6.48|A.Points indexed | 0.17| 36186|0 2019-06-25 19:22:51,371|MF|app-20190625192245-0207|6|4|START| 6.48|B.Pairs found | 0.00| 0|0 2019-06-25 19:22:52,952|MF|app-20190625192245-0207|6|4| END| 8.06|B.Pairs found | 1.58| 78808|0 2019-06-25 19:22:52,952|MF|app-20190625192245-0207|6|4|START| 8.06|C.Centers found | 0.00| 0|0 2019-06-25 19:22:53,855|MF|app-20190625192245-0207|6|4| END| 8.97|C.Centers found | 0.90|157616|0 2019-06-25 19:22:53,855|MF|app-20190625192245-0207|6|4|START| 8.97|D.Disks found | 0.00| 0|0 2019-06-25 19:22:59,577|MF|app-20190625192245-0207|6|4| END| 14.69|D.Disks found | 5.72| 70458|0 2019-06-25 19:22:59,577|MF|app-20190625192245-0207|6|4|START| 14.69|E.Disks partitioned | 0.00| 0|0 2019-06-25 19:23:03,805|MF|app-20190625192245-0207|6|4| END| 18.92|E.Disks partitioned | 4.23|103004|0 2019-06-25 19:23:03,805|MF|app-20190625192245-0207|6|4|START| 18.92|F.Maximal disks found | 0.00| 0|0 2019-06-25 19:23:03,807|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:23:03,807|Cell area: 1055533.7681000116 2019-06-25 19:23:33,324|MF|app-20190625192245-0207|6|4| END| 48.43|F.Maximal disks found | 29.52| 20001|0 2019-06-25 19:23:33,324|MAXIMALS|app-20190625192245-0207|4|6|110.0|3|900|42.123|20001 2019-06-25 19:23:34,927|FF|app-20190625192245-0207|6|4| END| 50.04|1.Maximal disks found | 43.73| 20001|0 2019-06-25 19:23:34,927|FF|app-20190625192245-0207|6|4|START| 50.04|1.Maximal disks found | 0.00| 0|1 2019-06-25 19:23:34,928|MF|app-20190625192245-0207|6|4|START| 50.04|A.Points indexed | 0.00| 0|1 2019-06-25 19:23:35,002|MF|app-20190625192245-0207|6|4| END| 50.11|A.Points indexed | 0.08| 36490|1 2019-06-25 19:23:35,002|MF|app-20190625192245-0207|6|4|START| 50.11|B.Pairs found | 0.00| 0|1 2019-06-25 19:23:35,716|MF|app-20190625192245-0207|6|4| END| 50.83|B.Pairs found | 0.71| 79998|1 2019-06-25 19:23:35,716|MF|app-20190625192245-0207|6|4|START| 50.83|C.Centers found | 0.00| 0|1 2019-06-25 19:23:36,547|MF|app-20190625192245-0207|6|4| END| 51.66|C.Centers found | 0.83|159996|1 2019-06-25 19:23:36,547|MF|app-20190625192245-0207|6|4|START| 51.66|D.Disks found | 0.00| 0|1 2019-06-25 19:23:40,812|MF|app-20190625192245-0207|6|4| END| 55.92|D.Disks found | 4.27| 71698|1 2019-06-25 19:23:40,812|MF|app-20190625192245-0207|6|4|START| 55.92|E.Disks partitioned | 0.00| 0|1 2019-06-25 19:23:43,059|MF|app-20190625192245-0207|6|4| END| 58.17|E.Disks partitioned | 2.25|104758|1 2019-06-25 19:23:43,059|MF|app-20190625192245-0207|6|4|START| 58.17|F.Maximal disks found | 0.00| 0|1 2019-06-25 19:23:43,060|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:23:43,060|Cell area: 1055533.7681000116 2019-06-25 19:24:10,987|MF|app-20190625192245-0207|6|4| END| 86.10|F.Maximal disks found | 27.93| 20222|1 2019-06-25 19:24:10,987|MAXIMALS|app-20190625192245-0207|4|6|110.0|3|900|36.06|20222 2019-06-25 19:24:11,965|FF|app-20190625192245-0207|6|4| END| 87.08|1.Maximal disks found | 37.04| 20222|1 2019-06-25 19:24:11,965|FF|app-20190625192245-0207|6|4|START| 87.08|2.Join done | 0.00| 0|1 2019-06-25 19:24:17,828|FF|app-20190625192245-0207|6|4| END| 92.94|2.Join done | 5.86| 43837|1 2019-06-25 19:24:17,828|FF|app-20190625192245-0207|6|4|START| 92.94|3.Flocks to report | 0.00| 0|1 2019-06-25 19:24:18,873|FF|app-20190625192245-0207|6|4| END| 93.98|3.Flocks to report | 1.05| 0|1 2019-06-25 19:24:18,873|FF|app-20190625192245-0207|6|4|START| 93.98|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 19:24:18,917|FF|app-20190625192245-0207|6|4| END| 94.03|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 19:24:18,917|FF|app-20190625192245-0207|6|4|START| 94.03|5.Flocks reported | 0.00| 0|1 2019-06-25 19:24:18,922|FF|app-20190625192245-0207|6|4| END| 94.03|5.Flocks reported | 0.01| 0|1 2019-06-25 19:24:18,923|FF|app-20190625192245-0207|6|4|START| 94.03|6.Candidates indexed | 0.00| 0|1 2019-06-25 19:24:23,063|FF|app-20190625192245-0207|6|4| END| 98.17|6.Candidates indexed | 4.14| 45047|1 2019-06-25 19:24:23,063|FF|app-20190625192245-0207|6|4|START| 98.17|1.Maximal disks found | 0.00| 0|2 2019-06-25 19:24:23,063|MF|app-20190625192245-0207|6|4|START| 98.17|A.Points indexed | 0.00| 0|2 2019-06-25 19:24:23,137|MF|app-20190625192245-0207|6|4| END| 98.25|A.Points indexed | 0.07| 36788|2 2019-06-25 19:24:23,137|MF|app-20190625192245-0207|6|4|START| 98.25|B.Pairs found | 0.00| 0|2 2019-06-25 19:24:23,948|MF|app-20190625192245-0207|6|4| END| 99.06|B.Pairs found | 0.81| 81132|2 2019-06-25 19:24:23,949|MF|app-20190625192245-0207|6|4|START| 99.06|C.Centers found | 0.00| 0|2 2019-06-25 19:24:24,621|MF|app-20190625192245-0207|6|4| END| 99.73|C.Centers found | 0.67|162264|2 2019-06-25 19:24:24,621|MF|app-20190625192245-0207|6|4|START| 99.73|D.Disks found | 0.00| 0|2 2019-06-25 19:24:28,337|MF|app-20190625192245-0207|6|4| END|103.45|D.Disks found | 3.72| 72706|2 2019-06-25 19:24:28,337|MF|app-20190625192245-0207|6|4|START|103.45|E.Disks partitioned | 0.00| 0|2 2019-06-25 19:24:29,880|MF|app-20190625192245-0207|6|4| END|104.99|E.Disks partitioned | 1.54|106347|2 2019-06-25 19:24:29,880|MF|app-20190625192245-0207|6|4|START|104.99|F.Maximal disks found | 0.00| 0|2 2019-06-25 19:24:29,880|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:24:29,880|Cell area: 1055533.7681000116 2019-06-25 19:24:57,347|MF|app-20190625192245-0207|6|4| END|132.46|F.Maximal disks found | 27.47| 20682|2 2019-06-25 19:24:57,347|MAXIMALS|app-20190625192245-0207|4|6|110.0|3|900|34.284|20682 2019-06-25 19:24:58,102|FF|app-20190625192245-0207|6|4| END|133.21|1.Maximal disks found | 35.04| 20682|2 2019-06-25 19:24:58,102|FF|app-20190625192245-0207|6|4|START|133.21|2.Join done | 0.00| 0|2 2019-06-25 19:25:14,520|FF|app-20190625192245-0207|6|4| END|149.63|2.Join done | 16.42| 89740|2 2019-06-25 19:25:14,520|FF|app-20190625192245-0207|6|4|START|149.63|3.Flocks to report | 0.00| 0|2 2019-06-25 19:25:16,550|FF|app-20190625192245-0207|6|4| END|151.66|3.Flocks to report | 2.03| 76643|2 2019-06-25 19:25:16,550|FF|app-20190625192245-0207|6|4|START|151.66|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 19:25:16,595|FF|app-20190625192245-0207|6|4|START|151.71|4a.Making expansions | 0.00| 0|2 2019-06-25 19:25:17,895|FF|app-20190625192245-0207|6|4| END|153.01|4a.Making expansions | 1.30| 95670|2 2019-06-25 19:25:17,895|FF|app-20190625192245-0207|6|4|START|153.01|4b.Finding maximals | 0.00| 0|2 2019-06-25 19:26:06,111|FF|app-20190625192245-0207|6|4| END|201.22|4b.Finding maximals | 48.22| 13202|2 2019-06-25 19:26:06,479|FF|app-20190625192245-0207|6|4| END|201.59|4.Flocks prunned by expansion | 49.93| 13202|2 2019-06-25 19:26:06,479|FF|app-20190625192245-0207|6|4|START|201.59|5.Flocks reported | 0.00| 0|2 2019-06-25 19:26:07,116|FF|app-20190625192245-0207|6|4| END|202.23|5.Flocks reported | 0.64| 13202|2 2019-06-25 19:26:07,116|FF|app-20190625192245-0207|6|4|START|202.23|6.Candidates indexed | 0.00| 0|2 2019-06-25 19:26:09,822|FF|app-20190625192245-0207|6|4| END|204.93|6.Candidates indexed | 2.71| 27595|2 2019-06-25 19:26:09,822|FF|app-20190625192245-0207|6|4|START|204.93|1.Maximal disks found | 0.00| 0|3 2019-06-25 19:26:09,822|MF|app-20190625192245-0207|6|4|START|204.93|A.Points indexed | 0.00| 0|3 2019-06-25 19:26:09,908|MF|app-20190625192245-0207|6|4| END|205.02|A.Points indexed | 0.09| 37096|3 2019-06-25 19:26:09,908|MF|app-20190625192245-0207|6|4|START|205.02|B.Pairs found | 0.00| 0|3 2019-06-25 19:26:10,738|MF|app-20190625192245-0207|6|4| END|205.85|B.Pairs found | 0.83| 82514|3 2019-06-25 19:26:10,738|MF|app-20190625192245-0207|6|4|START|205.85|C.Centers found | 0.00| 0|3 2019-06-25 19:26:11,727|MF|app-20190625192245-0207|6|4| END|206.84|C.Centers found | 0.99|165028|3 2019-06-25 19:26:11,727|MF|app-20190625192245-0207|6|4|START|206.84|D.Disks found | 0.00| 0|3 2019-06-25 19:26:16,625|MF|app-20190625192245-0207|6|4| END|211.74|D.Disks found | 4.90| 74174|3 2019-06-25 19:26:16,625|MF|app-20190625192245-0207|6|4|START|211.74|E.Disks partitioned | 0.00| 0|3 2019-06-25 19:26:18,761|MF|app-20190625192245-0207|6|4| END|213.87|E.Disks partitioned | 2.14|108468|3 2019-06-25 19:26:18,762|MF|app-20190625192245-0207|6|4|START|213.87|F.Maximal disks found | 0.00| 0|3 2019-06-25 19:26:18,762|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:26:18,762|Cell area: 1055533.7681000116 2019-06-25 19:26:53,602|MF|app-20190625192245-0207|6|4| END|248.71|F.Maximal disks found | 34.84| 21009|3 2019-06-25 19:26:53,602|MAXIMALS|app-20190625192245-0207|4|6|110.0|3|900|43.78|21009 2019-06-25 19:26:54,522|FF|app-20190625192245-0207|6|4| END|249.63|1.Maximal disks found | 44.70| 21009|3 2019-06-25 19:26:54,522|FF|app-20190625192245-0207|6|4|START|249.63|2.Join done | 0.00| 0|3 2019-06-25 19:27:06,845|FF|app-20190625192245-0207|6|4| END|261.96|2.Join done | 12.32| 90003|3 2019-06-25 19:27:06,845|FF|app-20190625192245-0207|6|4|START|261.96|3.Flocks to report | 0.00| 0|3 2019-06-25 19:27:08,791|FF|app-20190625192245-0207|6|4| END|263.90|3.Flocks to report | 1.95| 76861|3 2019-06-25 19:27:08,791|FF|app-20190625192245-0207|6|4|START|263.90|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 19:27:08,857|FF|app-20190625192245-0207|6|4|START|263.97|4a.Making expansions | 0.00| 0|3 2019-06-25 19:27:10,314|FF|app-20190625192245-0207|6|4| END|265.42|4a.Making expansions | 1.46| 95560|3 2019-06-25 19:27:10,314|FF|app-20190625192245-0207|6|4|START|265.42|4b.Finding maximals | 0.00| 0|3 2019-06-25 19:28:14,017|FF|app-20190625192245-0207|6|4| END|329.13|4b.Finding maximals | 63.70| 13338|3 2019-06-25 19:28:14,418|FF|app-20190625192245-0207|6|4| END|329.53|4.Flocks prunned by expansion | 65.63| 13338|3 2019-06-25 19:28:14,418|FF|app-20190625192245-0207|6|4|START|329.53|5.Flocks reported | 0.00| 0|3 2019-06-25 19:28:15,022|FF|app-20190625192245-0207|6|4| END|330.13|5.Flocks reported | 0.60| 13338|3 2019-06-25 19:28:15,023|FF|app-20190625192245-0207|6|4|START|330.13|6.Candidates indexed | 0.00| 0|3 2019-06-25 19:28:17,964|FF|app-20190625192245-0207|6|4| END|333.07|6.Candidates indexed | 2.94| 27789|3 2019-06-25 19:28:19,312|Number of flocks: 26540 2019-06-25 19:28:20,423|PFLOCK|app-20190625192245-0207|4|6|110.0|3|3|328.14|26540 2019-06-25 19:28:21,197|FF|app-20190625192245-0207|6|4| END|336.31|Flock Finder run |330.02| 26540|3 2019-06-25 19:28:21,197|FF|app-20190625192245-0207|6|4|START|336.31|Session closed | 0.00| 0|3 2019-06-25 19:28:28,143|FF|app-20190625192245-0207|6|4| END|343.25|Session closed | 6.95| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --p_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_KDBTree.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 3 --fftimestamp 4 --portui 4040 --info 2019-06-25 19:28:30,079|FF|app-00000000000000-0000|3|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 19:28:31,172|FF|app-20190625192830-0208|3|4| END| 1.08|Session start | 1.09| 0|-1 2019-06-25 19:28:31,172|FF|app-20190625192830-0208|3|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 19:28:34,909|FF|app-20190625192830-0208|3|4| END| 4.81|Data read | 3.74|110376|-1 2019-06-25 19:28:34,910|FF|app-20190625192830-0208|3|4|START| 4.81|KDBTree partitioner | 0.00| 0|-1 2019-06-25 19:28:35,012|FF|app-20190625192830-0208|3|4| END| 4.92|KDBTree partitioner | 0.10| 272|-1 2019-06-25 19:28:35,012|FF|app-20190625192830-0208|3|4|START| 4.92|MF partitioner | 0.00| 0|-1 2019-06-25 19:28:35,021|FF|app-20190625192830-0208|3|4| END| 4.93|MF partitioner | 0.01| 450|-1 2019-06-25 19:28:35,021|FF|app-20190625192830-0208|3|4|START| 4.93|Pointset done | 0.00| 0|-1 2019-06-25 19:28:35,697|FF|app-20190625192830-0208|3|4| END| 5.60|Pointset done | 0.68| 4|-1 2019-06-25 19:28:35,698|FF|app-20190625192830-0208|3|4|START| 5.60|Flock Finder run | 0.00| 0|-1 2019-06-25 19:28:35,723|FF|app-20190625192830-0208|3|4|START| 5.63|1.Maximal disks found | 0.00| 0|0 2019-06-25 19:28:35,727|MF|app-20190625192830-0208|3|4|START| 5.63|A.Points indexed | 0.00| 0|0 2019-06-25 19:28:35,892|MF|app-20190625192830-0208|3|4| END| 5.80|A.Points indexed | 0.17| 18093|0 2019-06-25 19:28:35,892|MF|app-20190625192830-0208|3|4|START| 5.80|B.Pairs found | 0.00| 0|0 2019-06-25 19:28:37,352|MF|app-20190625192830-0208|3|4| END| 7.26|B.Pairs found | 1.46| 39404|0 2019-06-25 19:28:37,353|MF|app-20190625192830-0208|3|4|START| 7.26|C.Centers found | 0.00| 0|0 2019-06-25 19:28:38,237|MF|app-20190625192830-0208|3|4| END| 8.14|C.Centers found | 0.89| 78808|0 2019-06-25 19:28:38,238|MF|app-20190625192830-0208|3|4|START| 8.14|D.Disks found | 0.00| 0|0 2019-06-25 19:28:41,559|MF|app-20190625192830-0208|3|4| END| 11.46|D.Disks found | 3.32| 35229|0 2019-06-25 19:28:41,559|MF|app-20190625192830-0208|3|4|START| 11.46|E.Disks partitioned | 0.00| 0|0 2019-06-25 19:28:42,602|MF|app-20190625192830-0208|3|4| END| 12.51|E.Disks partitioned | 1.04| 51442|0 2019-06-25 19:28:42,602|MF|app-20190625192830-0208|3|4|START| 12.51|F.Maximal disks found | 0.00| 0|0 2019-06-25 19:28:42,603|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:28:42,603|Cell area: 1055533.7681000116 2019-06-25 19:29:09,089|MF|app-20190625192830-0208|3|4| END| 38.99|F.Maximal disks found | 26.49| 10001|0 2019-06-25 19:29:09,089|MAXIMALS|app-20190625192830-0208|4|3|110.0|3|450|33.363|10001 2019-06-25 19:29:09,618|FF|app-20190625192830-0208|3|4| END| 39.52|1.Maximal disks found | 33.90| 10001|0 2019-06-25 19:29:09,618|FF|app-20190625192830-0208|3|4|START| 39.52|1.Maximal disks found | 0.00| 0|1 2019-06-25 19:29:09,618|MF|app-20190625192830-0208|3|4|START| 39.52|A.Points indexed | 0.00| 0|1 2019-06-25 19:29:09,690|MF|app-20190625192830-0208|3|4| END| 39.59|A.Points indexed | 0.07| 18245|1 2019-06-25 19:29:09,690|MF|app-20190625192830-0208|3|4|START| 39.59|B.Pairs found | 0.00| 0|1 2019-06-25 19:29:10,184|MF|app-20190625192830-0208|3|4| END| 40.09|B.Pairs found | 0.49| 39999|1 2019-06-25 19:29:10,184|MF|app-20190625192830-0208|3|4|START| 40.09|C.Centers found | 0.00| 0|1 2019-06-25 19:29:10,724|MF|app-20190625192830-0208|3|4| END| 40.63|C.Centers found | 0.54| 79998|1 2019-06-25 19:29:10,725|MF|app-20190625192830-0208|3|4|START| 40.63|D.Disks found | 0.00| 0|1 2019-06-25 19:29:13,096|MF|app-20190625192830-0208|3|4| END| 43.00|D.Disks found | 2.37| 35849|1 2019-06-25 19:29:13,096|MF|app-20190625192830-0208|3|4|START| 43.00|E.Disks partitioned | 0.00| 0|1 2019-06-25 19:29:13,872|MF|app-20190625192830-0208|3|4| END| 43.78|E.Disks partitioned | 0.78| 52317|1 2019-06-25 19:29:13,872|MF|app-20190625192830-0208|3|4|START| 43.78|F.Maximal disks found | 0.00| 0|1 2019-06-25 19:29:13,873|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:29:13,873|Cell area: 1055533.7681000116 2019-06-25 19:29:41,160|MF|app-20190625192830-0208|3|4| END| 71.06|F.Maximal disks found | 27.29| 10110|1 2019-06-25 19:29:41,160|MAXIMALS|app-20190625192830-0208|4|3|110.0|3|450|31.542|10110 2019-06-25 19:29:41,615|FF|app-20190625192830-0208|3|4| END| 71.52|1.Maximal disks found | 32.00| 10110|1 2019-06-25 19:29:41,615|FF|app-20190625192830-0208|3|4|START| 71.52|2.Join done | 0.00| 0|1 2019-06-25 19:29:43,965|FF|app-20190625192830-0208|3|4| END| 73.87|2.Join done | 2.35| 21993|1 2019-06-25 19:29:43,966|FF|app-20190625192830-0208|3|4|START| 73.87|3.Flocks to report | 0.00| 0|1 2019-06-25 19:29:44,439|FF|app-20190625192830-0208|3|4| END| 74.34|3.Flocks to report | 0.47| 0|1 2019-06-25 19:29:44,439|FF|app-20190625192830-0208|3|4|START| 74.34|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 19:29:44,467|FF|app-20190625192830-0208|3|4| END| 74.37|4.Flocks prunned by expansion | 0.03| 0|1 2019-06-25 19:29:44,468|FF|app-20190625192830-0208|3|4|START| 74.37|5.Flocks reported | 0.00| 0|1 2019-06-25 19:29:44,472|FF|app-20190625192830-0208|3|4| END| 74.38|5.Flocks reported | 0.00| 0|1 2019-06-25 19:29:44,472|FF|app-20190625192830-0208|3|4|START| 74.38|6.Candidates indexed | 0.00| 0|1 2019-06-25 19:29:46,023|FF|app-20190625192830-0208|3|4| END| 75.93|6.Candidates indexed | 1.55| 22599|1 2019-06-25 19:29:46,023|FF|app-20190625192830-0208|3|4|START| 75.93|1.Maximal disks found | 0.00| 0|2 2019-06-25 19:29:46,023|MF|app-20190625192830-0208|3|4|START| 75.93|A.Points indexed | 0.00| 0|2 2019-06-25 19:29:46,082|MF|app-20190625192830-0208|3|4| END| 75.99|A.Points indexed | 0.06| 18394|2 2019-06-25 19:29:46,082|MF|app-20190625192830-0208|3|4|START| 75.99|B.Pairs found | 0.00| 0|2 2019-06-25 19:29:46,534|MF|app-20190625192830-0208|3|4| END| 76.44|B.Pairs found | 0.45| 40566|2 2019-06-25 19:29:46,534|MF|app-20190625192830-0208|3|4|START| 76.44|C.Centers found | 0.00| 0|2 2019-06-25 19:29:46,982|MF|app-20190625192830-0208|3|4| END| 76.89|C.Centers found | 0.45| 81132|2 2019-06-25 19:29:46,982|MF|app-20190625192830-0208|3|4|START| 76.89|D.Disks found | 0.00| 0|2 2019-06-25 19:29:49,243|MF|app-20190625192830-0208|3|4| END| 79.15|D.Disks found | 2.26| 36353|2 2019-06-25 19:29:49,243|MF|app-20190625192830-0208|3|4|START| 79.15|E.Disks partitioned | 0.00| 0|2 2019-06-25 19:29:49,986|MF|app-20190625192830-0208|3|4| END| 79.89|E.Disks partitioned | 0.74| 53134|2 2019-06-25 19:29:49,986|MF|app-20190625192830-0208|3|4|START| 79.89|F.Maximal disks found | 0.00| 0|2 2019-06-25 19:29:49,987|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:29:49,987|Cell area: 1055533.7681000116 2019-06-25 19:30:15,953|MF|app-20190625192830-0208|3|4| END|105.86|F.Maximal disks found | 25.97| 10342|2 2019-06-25 19:30:15,953|MAXIMALS|app-20190625192830-0208|4|3|110.0|3|450|29.93|10342 2019-06-25 19:30:16,339|FF|app-20190625192830-0208|3|4| END|106.24|1.Maximal disks found | 30.32| 10342|2 2019-06-25 19:30:16,340|FF|app-20190625192830-0208|3|4|START|106.24|2.Join done | 0.00| 0|2 2019-06-25 19:30:29,233|FF|app-20190625192830-0208|3|4| END|119.14|2.Join done | 12.89| 45000|2 2019-06-25 19:30:29,233|FF|app-20190625192830-0208|3|4|START|119.14|3.Flocks to report | 0.00| 0|2 2019-06-25 19:30:31,029|FF|app-20190625192830-0208|3|4| END|120.93|3.Flocks to report | 1.80| 38432|2 2019-06-25 19:30:31,029|FF|app-20190625192830-0208|3|4|START|120.93|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 19:30:31,068|FF|app-20190625192830-0208|3|4|START|120.97|4a.Making expansions | 0.00| 0|2 2019-06-25 19:30:32,138|FF|app-20190625192830-0208|3|4| END|122.04|4a.Making expansions | 1.07| 48135|2 2019-06-25 19:30:32,138|FF|app-20190625192830-0208|3|4|START|122.04|4b.Finding maximals | 0.00| 0|2 2019-06-25 19:31:19,668|FF|app-20190625192830-0208|3|4| END|169.57|4b.Finding maximals | 47.53| 6601|2 2019-06-25 19:31:19,959|FF|app-20190625192830-0208|3|4| END|169.86|4.Flocks prunned by expansion | 48.93| 6601|2 2019-06-25 19:31:19,959|FF|app-20190625192830-0208|3|4|START|169.86|5.Flocks reported | 0.00| 0|2 2019-06-25 19:31:20,479|FF|app-20190625192830-0208|3|4| END|170.38|5.Flocks reported | 0.52| 6601|2 2019-06-25 19:31:20,479|FF|app-20190625192830-0208|3|4|START|170.38|6.Candidates indexed | 0.00| 0|2 2019-06-25 19:31:23,613|FF|app-20190625192830-0208|3|4| END|173.52|6.Candidates indexed | 3.13| 13819|2 2019-06-25 19:31:23,613|FF|app-20190625192830-0208|3|4|START|173.52|1.Maximal disks found | 0.00| 0|3 2019-06-25 19:31:23,613|MF|app-20190625192830-0208|3|4|START|173.52|A.Points indexed | 0.00| 0|3 2019-06-25 19:31:23,663|MF|app-20190625192830-0208|3|4| END|173.57|A.Points indexed | 0.05| 18548|3 2019-06-25 19:31:23,663|MF|app-20190625192830-0208|3|4|START|173.57|B.Pairs found | 0.00| 0|3 2019-06-25 19:31:24,546|MF|app-20190625192830-0208|3|4| END|174.45|B.Pairs found | 0.88| 41257|3 2019-06-25 19:31:24,546|MF|app-20190625192830-0208|3|4|START|174.45|C.Centers found | 0.00| 0|3 2019-06-25 19:31:25,309|MF|app-20190625192830-0208|3|4| END|175.21|C.Centers found | 0.76| 82514|3 2019-06-25 19:31:25,309|MF|app-20190625192830-0208|3|4|START|175.21|D.Disks found | 0.00| 0|3 2019-06-25 19:31:30,130|MF|app-20190625192830-0208|3|4| END|180.03|D.Disks found | 4.82| 37087|3 2019-06-25 19:31:30,130|MF|app-20190625192830-0208|3|4|START|180.03|E.Disks partitioned | 0.00| 0|3 2019-06-25 19:31:31,806|MF|app-20190625192830-0208|3|4| END|181.71|E.Disks partitioned | 1.68| 54196|3 2019-06-25 19:31:31,806|MF|app-20190625192830-0208|3|4|START|181.71|F.Maximal disks found | 0.00| 0|3 2019-06-25 19:31:31,806|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 19:31:31,806|Cell area: 1055533.7681000116 2019-06-25 19:32:07,369|MF|app-20190625192830-0208|3|4| END|217.27|F.Maximal disks found | 35.56| 10503|3 2019-06-25 19:32:07,369|MAXIMALS|app-20190625192830-0208|4|3|110.0|3|450|43.756|10503 2019-06-25 19:32:08,078|FF|app-20190625192830-0208|3|4| END|217.98|1.Maximal disks found | 44.47| 10503|3 2019-06-25 19:32:08,078|FF|app-20190625192830-0208|3|4|START|217.98|2.Join done | 0.00| 0|3 2019-06-25 19:32:18,189|FF|app-20190625192830-0208|3|4| END|228.09|2.Join done | 10.11| 45190|3 2019-06-25 19:32:18,189|FF|app-20190625192830-0208|3|4|START|228.09|3.Flocks to report | 0.00| 0|3 2019-06-25 19:32:19,991|FF|app-20190625192830-0208|3|4| END|229.90|3.Flocks to report | 1.80| 38589|3 2019-06-25 19:32:19,992|FF|app-20190625192830-0208|3|4|START|229.90|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 19:32:20,034|FF|app-20190625192830-0208|3|4|START|229.94|4a.Making expansions | 0.00| 0|3 2019-06-25 19:32:21,160|FF|app-20190625192830-0208|3|4| END|231.06|4a.Making expansions | 1.13| 47925|3 2019-06-25 19:32:21,160|FF|app-20190625192830-0208|3|4|START|231.06|4b.Finding maximals | 0.00| 0|3 2019-06-25 19:33:29,555|FF|app-20190625192830-0208|3|4| END|299.46|4b.Finding maximals | 68.40| 6669|3 2019-06-25 19:33:29,842|FF|app-20190625192830-0208|3|4| END|299.75|4.Flocks prunned by expansion | 69.85| 6669|3 2019-06-25 19:33:29,842|FF|app-20190625192830-0208|3|4|START|299.75|5.Flocks reported | 0.00| 0|3 2019-06-25 19:33:30,319|FF|app-20190625192830-0208|3|4| END|300.22|5.Flocks reported | 0.48| 6669|3 2019-06-25 19:33:30,319|FF|app-20190625192830-0208|3|4|START|300.22|6.Candidates indexed | 0.00| 0|3 2019-06-25 19:33:33,523|FF|app-20190625192830-0208|3|4| END|303.43|6.Candidates indexed | 3.20| 13927|3 2019-06-25 19:33:34,573|Number of flocks: 13270 2019-06-25 19:33:34,943|PFLOCK|app-20190625192830-0208|4|3|110.0|3|3|298.88|13270 2019-06-25 19:33:35,386|FF|app-20190625192830-0208|3|4| END|305.29|Flock Finder run |299.69| 13270|3 2019-06-25 19:33:35,386|FF|app-20190625192830-0208|3|4|START|305.29|Session closed | 0.00| 0|3 2019-06-25 19:33:42,255|FF|app-20190625192830-0208|3|4| END|312.16|Session closed | 6.87| 0|3