spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B4_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_grid-60x30.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 12 --fftimestamp 4 --portui 4040 --info 2019-06-25 00:15:35,096|FF|app-00000000000000-0000|12|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 00:15:36,227|FF|app-20190625001535-0073|12|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 00:15:36,227|FF|app-20190625001535-0073|12|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 00:15:39,303|FF|app-20190625001535-0073|12|4|START| 4.19|KDBTree partitioner | 0.00| 0|-1 2019-06-25 00:15:40,689|Sample size: 441504 2019-06-25 00:15:40,980|FF|app-20190625001535-0073|12|4| END| 5.87|KDBTree partitioner | 1.68| 1112|-1 2019-06-25 00:15:40,980|FF|app-20190625001535-0073|12|4|START| 5.87|MF partitioner | 0.00| 0|-1 2019-06-25 00:15:41,030|FF|app-20190625001535-0073|12|4| END| 5.92|MF partitioner | 0.05| 1800|-1 2019-06-25 00:15:42,697|FF|app-20190625001535-0073|12|4| END| 7.58|MF partitioner | 1.72|441504|-1 2019-06-25 00:15:42,697|FF|app-20190625001535-0073|12|4|START| 7.58|Flock Finder run | 0.00| 0|-1 2019-06-25 00:15:42,714|FF|app-20190625001535-0073|12|4|START| 7.60|1.Maximal disks found | 0.00| 0|0 2019-06-25 00:15:42,716|MF|app-20190625001535-0073|12|4|START| 7.60|A.Points indexed | 0.00| 0|0 2019-06-25 00:15:43,044|MF|app-20190625001535-0073|12|4| END| 7.93|A.Points indexed | 0.33| 72372|0 2019-06-25 00:15:43,044|MF|app-20190625001535-0073|12|4|START| 7.93|B.Pairs found | 0.00| 0|0 2019-06-25 00:15:44,880|MF|app-20190625001535-0073|12|4| END| 9.77|B.Pairs found | 1.84|135828|0 2019-06-25 00:15:44,880|MF|app-20190625001535-0073|12|4|START| 9.77|C.Centers found | 0.00| 0|0 2019-06-25 00:15:46,170|MF|app-20190625001535-0073|12|4| END| 11.06|C.Centers found | 1.29|271656|0 2019-06-25 00:15:46,171|MF|app-20190625001535-0073|12|4|START| 11.06|D.Disks found | 0.00| 0|0 2019-06-25 00:15:50,705|MF|app-20190625001535-0073|12|4| END| 15.59|D.Disks found | 4.53|114664|0 2019-06-25 00:15:50,705|MF|app-20190625001535-0073|12|4|START| 15.59|E.Disks partitioned | 0.00| 0|0 2019-06-25 00:15:52,234|MF|app-20190625001535-0073|12|4| END| 17.12|E.Disks partitioned | 1.53|162379|0 2019-06-25 00:15:52,234|MF|app-20190625001535-0073|12|4|START| 17.12|F.Maximal disks found | 0.00| 0|0 2019-06-25 00:15:52,237|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:15:52,237|Cell area: 1055533.7681000116 2019-06-25 00:16:02,716|MF|app-20190625001535-0073|12|4| END| 27.60|F.Maximal disks found | 10.48| 33494|0 2019-06-25 00:16:02,716|MAXIMALS|app-20190625001535-0073|4|12|100.0|3|1800|20.0|33494 2019-06-25 00:16:04,139|FF|app-20190625001535-0073|12|4| END| 29.03|1.Maximal disks found | 21.43| 33494|0 2019-06-25 00:16:04,139|FF|app-20190625001535-0073|12|4|START| 29.03|1.Maximal disks found | 0.00| 0|1 2019-06-25 00:16:04,139|MF|app-20190625001535-0073|12|4|START| 29.03|A.Points indexed | 0.00| 0|1 2019-06-25 00:16:04,269|MF|app-20190625001535-0073|12|4| END| 29.16|A.Points indexed | 0.13| 72980|1 2019-06-25 00:16:04,269|MF|app-20190625001535-0073|12|4|START| 29.16|B.Pairs found | 0.00| 0|1 2019-06-25 00:16:05,069|MF|app-20190625001535-0073|12|4| END| 29.96|B.Pairs found | 0.80|137848|1 2019-06-25 00:16:05,069|MF|app-20190625001535-0073|12|4|START| 29.96|C.Centers found | 0.00| 0|1 2019-06-25 00:16:05,916|MF|app-20190625001535-0073|12|4| END| 30.80|C.Centers found | 0.85|275696|1 2019-06-25 00:16:05,916|MF|app-20190625001535-0073|12|4|START| 30.80|D.Disks found | 0.00| 0|1 2019-06-25 00:16:09,463|MF|app-20190625001535-0073|12|4| END| 34.35|D.Disks found | 3.55|116464|1 2019-06-25 00:16:09,463|MF|app-20190625001535-0073|12|4|START| 34.35|E.Disks partitioned | 0.00| 0|1 2019-06-25 00:16:10,600|MF|app-20190625001535-0073|12|4| END| 35.49|E.Disks partitioned | 1.14|164834|1 2019-06-25 00:16:10,600|MF|app-20190625001535-0073|12|4|START| 35.49|F.Maximal disks found | 0.00| 0|1 2019-06-25 00:16:10,601|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:16:10,601|Cell area: 1055533.7681000116 2019-06-25 00:16:20,337|MF|app-20190625001535-0073|12|4| END| 45.22|F.Maximal disks found | 9.74| 34190|1 2019-06-25 00:16:20,337|MAXIMALS|app-20190625001535-0073|4|12|100.0|3|1800|16.198|34190 2019-06-25 00:16:21,688|FF|app-20190625001535-0073|12|4| END| 46.58|1.Maximal disks found | 17.55| 34190|1 2019-06-25 00:16:21,688|FF|app-20190625001535-0073|12|4|START| 46.58|2.Join done | 0.00| 0|1 2019-06-25 00:16:25,412|FF|app-20190625001535-0073|12|4| END| 50.30|2.Join done | 3.72| 68607|1 2019-06-25 00:16:25,412|FF|app-20190625001535-0073|12|4|START| 50.30|3.Flocks to report | 0.00| 0|1 2019-06-25 00:16:25,944|FF|app-20190625001535-0073|12|4| END| 50.83|3.Flocks to report | 0.53| 0|1 2019-06-25 00:16:25,944|FF|app-20190625001535-0073|12|4|START| 50.83|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 00:16:26,007|FF|app-20190625001535-0073|12|4| END| 50.89|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 00:16:26,007|FF|app-20190625001535-0073|12|4|START| 50.89|5.Flocks reported | 0.00| 0|1 2019-06-25 00:16:26,012|FF|app-20190625001535-0073|12|4| END| 50.90|5.Flocks reported | 0.01| 0|1 2019-06-25 00:16:26,012|FF|app-20190625001535-0073|12|4|START| 50.90|6.Candidates indexed | 0.00| 0|1 2019-06-25 00:16:27,983|FF|app-20190625001535-0073|12|4| END| 52.87|6.Candidates indexed | 1.97| 70591|1 2019-06-25 00:16:27,983|FF|app-20190625001535-0073|12|4|START| 52.87|1.Maximal disks found | 0.00| 0|2 2019-06-25 00:16:27,983|MF|app-20190625001535-0073|12|4|START| 52.87|A.Points indexed | 0.00| 0|2 2019-06-25 00:16:28,114|MF|app-20190625001535-0073|12|4| END| 53.00|A.Points indexed | 0.13| 73576|2 2019-06-25 00:16:28,114|MF|app-20190625001535-0073|12|4|START| 53.00|B.Pairs found | 0.00| 0|2 2019-06-25 00:16:28,970|MF|app-20190625001535-0073|12|4| END| 53.86|B.Pairs found | 0.86|139672|2 2019-06-25 00:16:28,970|MF|app-20190625001535-0073|12|4|START| 53.86|C.Centers found | 0.00| 0|2 2019-06-25 00:16:29,800|MF|app-20190625001535-0073|12|4| END| 54.69|C.Centers found | 0.83|279344|2 2019-06-25 00:16:29,800|MF|app-20190625001535-0073|12|4|START| 54.69|D.Disks found | 0.00| 0|2 2019-06-25 00:16:33,160|MF|app-20190625001535-0073|12|4| END| 58.05|D.Disks found | 3.36|118196|2 2019-06-25 00:16:33,160|MF|app-20190625001535-0073|12|4|START| 58.05|E.Disks partitioned | 0.00| 0|2 2019-06-25 00:16:34,576|MF|app-20190625001535-0073|12|4| END| 59.46|E.Disks partitioned | 1.42|167618|2 2019-06-25 00:16:34,576|MF|app-20190625001535-0073|12|4|START| 59.46|F.Maximal disks found | 0.00| 0|2 2019-06-25 00:16:34,577|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:16:34,578|Cell area: 1055533.7681000116 2019-06-25 00:16:44,637|MF|app-20190625001535-0073|12|4| END| 69.52|F.Maximal disks found | 10.06| 34747|2 2019-06-25 00:16:44,637|MAXIMALS|app-20190625001535-0073|4|12|100.0|3|1800|16.654|34747 2019-06-25 00:16:45,978|FF|app-20190625001535-0073|12|4| END| 70.87|1.Maximal disks found | 18.00| 34747|2 2019-06-25 00:16:45,978|FF|app-20190625001535-0073|12|4|START| 70.87|2.Join done | 0.00| 0|2 2019-06-25 00:16:52,271|FF|app-20190625001535-0073|12|4| END| 77.16|2.Join done | 6.29|130915|2 2019-06-25 00:16:52,271|FF|app-20190625001535-0073|12|4|START| 77.16|3.Flocks to report | 0.00| 0|2 2019-06-25 00:16:53,076|FF|app-20190625001535-0073|12|4| END| 77.96|3.Flocks to report | 0.81|111712|2 2019-06-25 00:16:53,076|FF|app-20190625001535-0073|12|4|START| 77.96|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 00:16:53,141|FF|app-20190625001535-0073|12|4|START| 78.03|4a.Making expansions | 0.00| 0|2 2019-06-25 00:16:54,130|FF|app-20190625001535-0073|12|4| END| 79.02|4a.Making expansions | 0.99|138981|2 2019-06-25 00:16:54,130|FF|app-20190625001535-0073|12|4|START| 79.02|4b.Finding maximals | 0.00| 0|2 2019-06-25 00:17:10,195|FF|app-20190625001535-0073|12|4| END| 95.08|4b.Finding maximals | 16.07| 22788|2 2019-06-25 00:17:10,796|FF|app-20190625001535-0073|12|4| END| 95.68|4.Flocks prunned by expansion | 17.72| 22788|2 2019-06-25 00:17:10,797|FF|app-20190625001535-0073|12|4|START| 95.68|5.Flocks reported | 0.00| 0|2 2019-06-25 00:17:11,549|FF|app-20190625001535-0073|12|4| END| 96.44|5.Flocks reported | 0.75| 22788|2 2019-06-25 00:17:11,549|FF|app-20190625001535-0073|12|4|START| 96.44|6.Candidates indexed | 0.00| 0|2 2019-06-25 00:17:13,804|FF|app-20190625001535-0073|12|4| END| 98.69|6.Candidates indexed | 2.26| 44305|2 2019-06-25 00:17:13,804|FF|app-20190625001535-0073|12|4|START| 98.69|1.Maximal disks found | 0.00| 0|3 2019-06-25 00:17:13,804|MF|app-20190625001535-0073|12|4|START| 98.69|A.Points indexed | 0.00| 0|3 2019-06-25 00:17:13,925|MF|app-20190625001535-0073|12|4| END| 98.81|A.Points indexed | 0.12| 74192|3 2019-06-25 00:17:13,925|MF|app-20190625001535-0073|12|4|START| 98.81|B.Pairs found | 0.00| 0|3 2019-06-25 00:17:14,631|MF|app-20190625001535-0073|12|4| END| 99.52|B.Pairs found | 0.71|142060|3 2019-06-25 00:17:14,631|MF|app-20190625001535-0073|12|4|START| 99.52|C.Centers found | 0.00| 0|3 2019-06-25 00:17:15,433|MF|app-20190625001535-0073|12|4| END|100.32|C.Centers found | 0.80|284120|3 2019-06-25 00:17:15,433|MF|app-20190625001535-0073|12|4|START|100.32|D.Disks found | 0.00| 0|3 2019-06-25 00:17:18,784|MF|app-20190625001535-0073|12|4| END|103.67|D.Disks found | 3.35|120568|3 2019-06-25 00:17:18,784|MF|app-20190625001535-0073|12|4|START|103.67|E.Disks partitioned | 0.00| 0|3 2019-06-25 00:17:20,360|MF|app-20190625001535-0073|12|4| END|105.25|E.Disks partitioned | 1.58|171019|3 2019-06-25 00:17:20,360|MF|app-20190625001535-0073|12|4|START|105.25|F.Maximal disks found | 0.00| 0|3 2019-06-25 00:17:20,361|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:17:20,361|Cell area: 1055533.7681000116 2019-06-25 00:17:32,477|MF|app-20190625001535-0073|12|4| END|117.36|F.Maximal disks found | 12.12| 35397|3 2019-06-25 00:17:32,477|MAXIMALS|app-20190625001535-0073|4|12|100.0|3|1800|18.673|35397 2019-06-25 00:17:33,838|FF|app-20190625001535-0073|12|4| END|118.73|1.Maximal disks found | 20.03| 35397|3 2019-06-25 00:17:33,838|FF|app-20190625001535-0073|12|4|START|118.73|2.Join done | 0.00| 0|3 2019-06-25 00:17:38,404|FF|app-20190625001535-0073|12|4| END|123.29|2.Join done | 4.57|120805|3 2019-06-25 00:17:38,404|FF|app-20190625001535-0073|12|4|START|123.29|3.Flocks to report | 0.00| 0|3 2019-06-25 00:17:39,140|FF|app-20190625001535-0073|12|4| END|124.03|3.Flocks to report | 0.74|101401|3 2019-06-25 00:17:39,140|FF|app-20190625001535-0073|12|4|START|124.03|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 00:17:39,202|FF|app-20190625001535-0073|12|4|START|124.09|4a.Making expansions | 0.00| 0|3 2019-06-25 00:17:40,539|FF|app-20190625001535-0073|12|4| END|125.43|4a.Making expansions | 1.34|129201|3 2019-06-25 00:17:40,539|FF|app-20190625001535-0073|12|4|START|125.43|4b.Finding maximals | 0.00| 0|3 2019-06-25 00:17:52,107|FF|app-20190625001535-0073|12|4| END|136.99|4b.Finding maximals | 11.57| 23068|3 2019-06-25 00:17:52,699|FF|app-20190625001535-0073|12|4| END|137.59|4.Flocks prunned by expansion | 13.56| 23068|3 2019-06-25 00:17:52,699|FF|app-20190625001535-0073|12|4|START|137.59|5.Flocks reported | 0.00| 0|3 2019-06-25 00:17:53,520|FF|app-20190625001535-0073|12|4| END|138.41|5.Flocks reported | 0.82| 23068|3 2019-06-25 00:17:53,520|FF|app-20190625001535-0073|12|4|START|138.41|6.Candidates indexed | 0.00| 0|3 2019-06-25 00:17:55,839|FF|app-20190625001535-0073|12|4| END|140.73|6.Candidates indexed | 2.32| 44638|3 2019-06-25 00:17:57,608|Number of flocks: 45856 2019-06-25 00:17:58,887|PFLOCK|app-20190625001535-0073|4|12|100.0|3|3|134.91|45856 2019-06-25 00:18:00,207|FF|app-20190625001535-0073|12|4| END|145.09|Flock Finder run |137.51| 45856|3 2019-06-25 00:18:00,208|FF|app-20190625001535-0073|12|4|START|145.09|Session closed | 0.00| 0|3 2019-06-25 00:18:07,868|FF|app-20190625001535-0073|12|4| END|152.76|Session closed | 7.66| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 6 --fftimestamp 4 --portui 4040 --info 2019-06-25 00:18:09,886|FF|app-00000000000000-0000|6|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 00:18:11,023|FF|app-20190625001810-0074|6|4| END| 1.12|Session start | 1.14| 0|-1 2019-06-25 00:18:11,024|FF|app-20190625001810-0074|6|4|START| 1.12|Data read | 0.00| 0|-1 2019-06-25 00:18:14,007|FF|app-20190625001810-0074|6|4|START| 4.10|KDBTree partitioner | 0.00| 0|-1 2019-06-25 00:18:15,104|Sample size: 220752 2019-06-25 00:18:15,277|FF|app-20190625001810-0074|6|4| END| 5.37|KDBTree partitioner | 1.27| 554|-1 2019-06-25 00:18:15,277|FF|app-20190625001810-0074|6|4|START| 5.37|MF partitioner | 0.00| 0|-1 2019-06-25 00:18:15,327|FF|app-20190625001810-0074|6|4| END| 5.42|MF partitioner | 0.05| 900|-1 2019-06-25 00:18:17,024|FF|app-20190625001810-0074|6|4| END| 7.12|MF partitioner | 1.75|220752|-1 2019-06-25 00:18:17,024|FF|app-20190625001810-0074|6|4|START| 7.12|Flock Finder run | 0.00| 0|-1 2019-06-25 00:18:17,045|FF|app-20190625001810-0074|6|4|START| 7.14|1.Maximal disks found | 0.00| 0|0 2019-06-25 00:18:17,049|MF|app-20190625001810-0074|6|4|START| 7.15|A.Points indexed | 0.00| 0|0 2019-06-25 00:18:17,227|MF|app-20190625001810-0074|6|4| END| 7.32|A.Points indexed | 0.18| 36186|0 2019-06-25 00:18:17,227|MF|app-20190625001810-0074|6|4|START| 7.32|B.Pairs found | 0.00| 0|0 2019-06-25 00:18:18,760|MF|app-20190625001810-0074|6|4| END| 8.86|B.Pairs found | 1.53| 67914|0 2019-06-25 00:18:18,760|MF|app-20190625001810-0074|6|4|START| 8.86|C.Centers found | 0.00| 0|0 2019-06-25 00:18:19,744|MF|app-20190625001810-0074|6|4| END| 9.84|C.Centers found | 0.98|135828|0 2019-06-25 00:18:19,744|MF|app-20190625001810-0074|6|4|START| 9.84|D.Disks found | 0.00| 0|0 2019-06-25 00:18:24,218|MF|app-20190625001810-0074|6|4| END| 14.32|D.Disks found | 4.47| 57332|0 2019-06-25 00:18:24,218|MF|app-20190625001810-0074|6|4|START| 14.32|E.Disks partitioned | 0.00| 0|0 2019-06-25 00:18:26,572|MF|app-20190625001810-0074|6|4| END| 16.67|E.Disks partitioned | 2.35| 81114|0 2019-06-25 00:18:26,572|MF|app-20190625001810-0074|6|4|START| 16.67|F.Maximal disks found | 0.00| 0|0 2019-06-25 00:18:26,573|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:18:26,573|Cell area: 1055533.7681000116 2019-06-25 00:18:37,187|MF|app-20190625001810-0074|6|4| END| 27.28|F.Maximal disks found | 10.62| 16742|0 2019-06-25 00:18:37,188|MAXIMALS|app-20190625001810-0074|4|6|100.0|3|900|20.139|16742 2019-06-25 00:18:38,224|FF|app-20190625001810-0074|6|4| END| 28.32|1.Maximal disks found | 21.18| 16742|0 2019-06-25 00:18:38,224|FF|app-20190625001810-0074|6|4|START| 28.32|1.Maximal disks found | 0.00| 0|1 2019-06-25 00:18:38,224|MF|app-20190625001810-0074|6|4|START| 28.32|A.Points indexed | 0.00| 0|1 2019-06-25 00:18:38,372|MF|app-20190625001810-0074|6|4| END| 28.47|A.Points indexed | 0.15| 36490|1 2019-06-25 00:18:38,372|MF|app-20190625001810-0074|6|4|START| 28.47|B.Pairs found | 0.00| 0|1 2019-06-25 00:18:39,049|MF|app-20190625001810-0074|6|4| END| 29.15|B.Pairs found | 0.68| 68924|1 2019-06-25 00:18:39,049|MF|app-20190625001810-0074|6|4|START| 29.15|C.Centers found | 0.00| 0|1 2019-06-25 00:18:39,774|MF|app-20190625001810-0074|6|4| END| 29.87|C.Centers found | 0.73|137848|1 2019-06-25 00:18:39,774|MF|app-20190625001810-0074|6|4|START| 29.87|D.Disks found | 0.00| 0|1 2019-06-25 00:18:43,432|MF|app-20190625001810-0074|6|4| END| 33.53|D.Disks found | 3.66| 58232|1 2019-06-25 00:18:43,433|MF|app-20190625001810-0074|6|4|START| 33.53|E.Disks partitioned | 0.00| 0|1 2019-06-25 00:18:45,303|MF|app-20190625001810-0074|6|4| END| 35.40|E.Disks partitioned | 1.87| 82341|1 2019-06-25 00:18:45,303|MF|app-20190625001810-0074|6|4|START| 35.40|F.Maximal disks found | 0.00| 0|1 2019-06-25 00:18:45,303|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:18:45,303|Cell area: 1055533.7681000116 2019-06-25 00:18:55,716|MF|app-20190625001810-0074|6|4| END| 45.81|F.Maximal disks found | 10.41| 17096|1 2019-06-25 00:18:55,716|MAXIMALS|app-20190625001810-0074|4|6|100.0|3|900|17.492|17096 2019-06-25 00:18:56,670|FF|app-20190625001810-0074|6|4| END| 46.77|1.Maximal disks found | 18.45| 17096|1 2019-06-25 00:18:56,670|FF|app-20190625001810-0074|6|4|START| 46.77|2.Join done | 0.00| 0|1 2019-06-25 00:19:01,751|FF|app-20190625001810-0074|6|4| END| 51.85|2.Join done | 5.08| 34283|1 2019-06-25 00:19:01,751|FF|app-20190625001810-0074|6|4|START| 51.85|3.Flocks to report | 0.00| 0|1 2019-06-25 00:19:02,552|FF|app-20190625001810-0074|6|4| END| 52.65|3.Flocks to report | 0.80| 0|1 2019-06-25 00:19:02,553|FF|app-20190625001810-0074|6|4|START| 52.65|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 00:19:02,596|FF|app-20190625001810-0074|6|4| END| 52.69|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 00:19:02,596|FF|app-20190625001810-0074|6|4|START| 52.69|5.Flocks reported | 0.00| 0|1 2019-06-25 00:19:02,600|FF|app-20190625001810-0074|6|4| END| 52.70|5.Flocks reported | 0.00| 0|1 2019-06-25 00:19:02,601|FF|app-20190625001810-0074|6|4|START| 52.70|6.Candidates indexed | 0.00| 0|1 2019-06-25 00:19:06,157|FF|app-20190625001810-0074|6|4| END| 56.25|6.Candidates indexed | 3.56| 35275|1 2019-06-25 00:19:06,157|FF|app-20190625001810-0074|6|4|START| 56.25|1.Maximal disks found | 0.00| 0|2 2019-06-25 00:19:06,157|MF|app-20190625001810-0074|6|4|START| 56.25|A.Points indexed | 0.00| 0|2 2019-06-25 00:19:06,244|MF|app-20190625001810-0074|6|4| END| 56.34|A.Points indexed | 0.09| 36788|2 2019-06-25 00:19:06,244|MF|app-20190625001810-0074|6|4|START| 56.34|B.Pairs found | 0.00| 0|2 2019-06-25 00:19:07,086|MF|app-20190625001810-0074|6|4| END| 57.18|B.Pairs found | 0.84| 69836|2 2019-06-25 00:19:07,087|MF|app-20190625001810-0074|6|4|START| 57.18|C.Centers found | 0.00| 0|2 2019-06-25 00:19:08,053|MF|app-20190625001810-0074|6|4| END| 58.15|C.Centers found | 0.97|139672|2 2019-06-25 00:19:08,053|MF|app-20190625001810-0074|6|4|START| 58.15|D.Disks found | 0.00| 0|2 2019-06-25 00:19:12,637|MF|app-20190625001810-0074|6|4| END| 62.73|D.Disks found | 4.58| 59098|2 2019-06-25 00:19:12,637|MF|app-20190625001810-0074|6|4|START| 62.73|E.Disks partitioned | 0.00| 0|2 2019-06-25 00:19:14,569|MF|app-20190625001810-0074|6|4| END| 64.67|E.Disks partitioned | 1.93| 83724|2 2019-06-25 00:19:14,569|MF|app-20190625001810-0074|6|4|START| 64.67|F.Maximal disks found | 0.00| 0|2 2019-06-25 00:19:14,569|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:19:14,569|Cell area: 1055533.7681000116 2019-06-25 00:19:25,013|MF|app-20190625001810-0074|6|4| END| 75.11|F.Maximal disks found | 10.44| 17376|2 2019-06-25 00:19:25,013|MAXIMALS|app-20190625001810-0074|4|6|100.0|3|900|18.856|17376 2019-06-25 00:19:25,926|FF|app-20190625001810-0074|6|4| END| 76.02|1.Maximal disks found | 19.77| 17376|2 2019-06-25 00:19:25,926|FF|app-20190625001810-0074|6|4|START| 76.02|2.Join done | 0.00| 0|2 2019-06-25 00:19:35,674|FF|app-20190625001810-0074|6|4| END| 85.77|2.Join done | 9.75| 65355|2 2019-06-25 00:19:35,674|FF|app-20190625001810-0074|6|4|START| 85.77|3.Flocks to report | 0.00| 0|2 2019-06-25 00:19:37,199|FF|app-20190625001810-0074|6|4| END| 87.30|3.Flocks to report | 1.53| 55758|2 2019-06-25 00:19:37,199|FF|app-20190625001810-0074|6|4|START| 87.30|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 00:19:37,242|FF|app-20190625001810-0074|6|4|START| 87.34|4a.Making expansions | 0.00| 0|2 2019-06-25 00:19:38,443|FF|app-20190625001810-0074|6|4| END| 88.54|4a.Making expansions | 1.20| 69277|2 2019-06-25 00:19:38,443|FF|app-20190625001810-0074|6|4|START| 88.54|4b.Finding maximals | 0.00| 0|2 2019-06-25 00:19:52,177|FF|app-20190625001810-0074|6|4| END|102.27|4b.Finding maximals | 13.73| 11394|2 2019-06-25 00:19:52,545|FF|app-20190625001810-0074|6|4| END|102.64|4.Flocks prunned by expansion | 15.35| 11394|2 2019-06-25 00:19:52,545|FF|app-20190625001810-0074|6|4|START|102.64|5.Flocks reported | 0.00| 0|2 2019-06-25 00:19:53,165|FF|app-20190625001810-0074|6|4| END|103.26|5.Flocks reported | 0.62| 11394|2 2019-06-25 00:19:53,165|FF|app-20190625001810-0074|6|4|START|103.26|6.Candidates indexed | 0.00| 0|2 2019-06-25 00:19:56,088|FF|app-20190625001810-0074|6|4| END|106.19|6.Candidates indexed | 2.92| 22156|2 2019-06-25 00:19:56,088|FF|app-20190625001810-0074|6|4|START|106.19|1.Maximal disks found | 0.00| 0|3 2019-06-25 00:19:56,088|MF|app-20190625001810-0074|6|4|START|106.19|A.Points indexed | 0.00| 0|3 2019-06-25 00:19:56,168|MF|app-20190625001810-0074|6|4| END|106.27|A.Points indexed | 0.08| 37096|3 2019-06-25 00:19:56,168|MF|app-20190625001810-0074|6|4|START|106.27|B.Pairs found | 0.00| 0|3 2019-06-25 00:19:56,887|MF|app-20190625001810-0074|6|4| END|106.98|B.Pairs found | 0.72| 71030|3 2019-06-25 00:19:56,887|MF|app-20190625001810-0074|6|4|START|106.98|C.Centers found | 0.00| 0|3 2019-06-25 00:19:57,676|MF|app-20190625001810-0074|6|4| END|107.77|C.Centers found | 0.79|142060|3 2019-06-25 00:19:57,676|MF|app-20190625001810-0074|6|4|START|107.77|D.Disks found | 0.00| 0|3 2019-06-25 00:20:02,728|MF|app-20190625001810-0074|6|4| END|112.82|D.Disks found | 5.05| 60284|3 2019-06-25 00:20:02,728|MF|app-20190625001810-0074|6|4|START|112.83|E.Disks partitioned | 0.00| 0|3 2019-06-25 00:20:04,750|MF|app-20190625001810-0074|6|4| END|114.85|E.Disks partitioned | 2.02| 85409|3 2019-06-25 00:20:04,750|MF|app-20190625001810-0074|6|4|START|114.85|F.Maximal disks found | 0.00| 0|3 2019-06-25 00:20:04,751|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:20:04,751|Cell area: 1055533.7681000116 2019-06-25 00:20:17,356|MF|app-20190625001810-0074|6|4| END|127.45|F.Maximal disks found | 12.61| 17693|3 2019-06-25 00:20:17,356|MAXIMALS|app-20190625001810-0074|4|6|100.0|3|900|21.268|17693 2019-06-25 00:20:18,333|FF|app-20190625001810-0074|6|4| END|128.43|1.Maximal disks found | 22.25| 17693|3 2019-06-25 00:20:18,333|FF|app-20190625001810-0074|6|4|START|128.43|2.Join done | 0.00| 0|3 2019-06-25 00:20:25,588|FF|app-20190625001810-0074|6|4| END|135.69|2.Join done | 7.26| 60351|3 2019-06-25 00:20:25,588|FF|app-20190625001810-0074|6|4|START|135.69|3.Flocks to report | 0.00| 0|3 2019-06-25 00:20:27,010|FF|app-20190625001810-0074|6|4| END|137.11|3.Flocks to report | 1.42| 50615|3 2019-06-25 00:20:27,010|FF|app-20190625001810-0074|6|4|START|137.11|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 00:20:27,053|FF|app-20190625001810-0074|6|4|START|137.15|4a.Making expansions | 0.00| 0|3 2019-06-25 00:20:28,402|FF|app-20190625001810-0074|6|4| END|138.50|4a.Making expansions | 1.35| 64351|3 2019-06-25 00:20:28,402|FF|app-20190625001810-0074|6|4|START|138.50|4b.Finding maximals | 0.00| 0|3 2019-06-25 00:20:38,576|FF|app-20190625001810-0074|6|4| END|148.67|4b.Finding maximals | 10.17| 11534|3 2019-06-25 00:20:38,967|FF|app-20190625001810-0074|6|4| END|149.06|4.Flocks prunned by expansion | 11.96| 11534|3 2019-06-25 00:20:38,967|FF|app-20190625001810-0074|6|4|START|149.06|5.Flocks reported | 0.00| 0|3 2019-06-25 00:20:39,549|FF|app-20190625001810-0074|6|4| END|149.65|5.Flocks reported | 0.58| 11534|3 2019-06-25 00:20:39,549|FF|app-20190625001810-0074|6|4|START|149.65|6.Candidates indexed | 0.00| 0|3 2019-06-25 00:20:42,196|FF|app-20190625001810-0074|6|4| END|152.29|6.Candidates indexed | 2.65| 22352|3 2019-06-25 00:20:43,237|Number of flocks: 22928 2019-06-25 00:20:43,895|PFLOCK|app-20190625001810-0074|4|6|100.0|3|3|146.21|22928 2019-06-25 00:20:44,509|FF|app-20190625001810-0074|6|4| END|154.61|Flock Finder run |147.49| 22928|3 2019-06-25 00:20:44,509|FF|app-20190625001810-0074|6|4|START|154.61|Session closed | 0.00| 0|3 2019-06-25 00:20:50,969|FF|app-20190625001810-0074|6|4| END|161.07|Session closed | 6.46| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 3 --fftimestamp 4 --portui 4040 --info 2019-06-25 00:20:52,910|FF|app-00000000000000-0000|3|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 00:20:53,995|FF|app-20190625002053-0075|3|4| END| 1.07|Session start | 1.09| 0|-1 2019-06-25 00:20:53,995|FF|app-20190625002053-0075|3|4|START| 1.07|Data read | 0.00| 0|-1 2019-06-25 00:20:57,029|FF|app-20190625002053-0075|3|4|START| 4.10|KDBTree partitioner | 0.00| 0|-1 2019-06-25 00:20:57,658|Sample size: 110376 2019-06-25 00:20:57,734|FF|app-20190625002053-0075|3|4| END| 4.81|KDBTree partitioner | 0.71| 274|-1 2019-06-25 00:20:57,735|FF|app-20190625002053-0075|3|4|START| 4.81|MF partitioner | 0.00| 0|-1 2019-06-25 00:20:57,760|FF|app-20190625002053-0075|3|4| END| 4.83|MF partitioner | 0.03| 450|-1 2019-06-25 00:20:59,229|FF|app-20190625002053-0075|3|4| END| 6.30|MF partitioner | 1.50|110376|-1 2019-06-25 00:20:59,229|FF|app-20190625002053-0075|3|4|START| 6.30|Flock Finder run | 0.00| 0|-1 2019-06-25 00:20:59,246|FF|app-20190625002053-0075|3|4|START| 6.32|1.Maximal disks found | 0.00| 0|0 2019-06-25 00:20:59,249|MF|app-20190625002053-0075|3|4|START| 6.32|A.Points indexed | 0.00| 0|0 2019-06-25 00:20:59,396|MF|app-20190625002053-0075|3|4| END| 6.47|A.Points indexed | 0.15| 18093|0 2019-06-25 00:20:59,396|MF|app-20190625002053-0075|3|4|START| 6.47|B.Pairs found | 0.00| 0|0 2019-06-25 00:21:00,550|MF|app-20190625002053-0075|3|4| END| 7.62|B.Pairs found | 1.15| 33957|0 2019-06-25 00:21:00,550|MF|app-20190625002053-0075|3|4|START| 7.62|C.Centers found | 0.00| 0|0 2019-06-25 00:21:01,396|MF|app-20190625002053-0075|3|4| END| 8.47|C.Centers found | 0.85| 67914|0 2019-06-25 00:21:01,396|MF|app-20190625002053-0075|3|4|START| 8.47|D.Disks found | 0.00| 0|0 2019-06-25 00:21:04,643|MF|app-20190625002053-0075|3|4| END| 11.72|D.Disks found | 3.25| 28666|0 2019-06-25 00:21:04,643|MF|app-20190625002053-0075|3|4|START| 11.72|E.Disks partitioned | 0.00| 0|0 2019-06-25 00:21:05,728|MF|app-20190625002053-0075|3|4| END| 12.80|E.Disks partitioned | 1.09| 40550|0 2019-06-25 00:21:05,728|MF|app-20190625002053-0075|3|4|START| 12.80|F.Maximal disks found | 0.00| 0|0 2019-06-25 00:21:05,729|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:21:05,729|Cell area: 1055533.7681000116 2019-06-25 00:21:16,004|MF|app-20190625002053-0075|3|4| END| 23.08|F.Maximal disks found | 10.28| 8371|0 2019-06-25 00:21:16,004|MAXIMALS|app-20190625002053-0075|4|3|100.0|3|450|16.756|8371 2019-06-25 00:21:16,509|FF|app-20190625002053-0075|3|4| END| 23.58|1.Maximal disks found | 17.26| 8371|0 2019-06-25 00:21:16,509|FF|app-20190625002053-0075|3|4|START| 23.58|1.Maximal disks found | 0.00| 0|1 2019-06-25 00:21:16,509|MF|app-20190625002053-0075|3|4|START| 23.58|A.Points indexed | 0.00| 0|1 2019-06-25 00:21:16,587|MF|app-20190625002053-0075|3|4| END| 23.66|A.Points indexed | 0.08| 18245|1 2019-06-25 00:21:16,587|MF|app-20190625002053-0075|3|4|START| 23.66|B.Pairs found | 0.00| 0|1 2019-06-25 00:21:17,071|MF|app-20190625002053-0075|3|4| END| 24.15|B.Pairs found | 0.48| 34462|1 2019-06-25 00:21:17,071|MF|app-20190625002053-0075|3|4|START| 24.15|C.Centers found | 0.00| 0|1 2019-06-25 00:21:17,598|MF|app-20190625002053-0075|3|4| END| 24.67|C.Centers found | 0.53| 68924|1 2019-06-25 00:21:17,598|MF|app-20190625002053-0075|3|4|START| 24.67|D.Disks found | 0.00| 0|1 2019-06-25 00:21:19,903|MF|app-20190625002053-0075|3|4| END| 26.98|D.Disks found | 2.31| 29116|1 2019-06-25 00:21:19,904|MF|app-20190625002053-0075|3|4|START| 26.98|E.Disks partitioned | 0.00| 0|1 2019-06-25 00:21:20,664|MF|app-20190625002053-0075|3|4| END| 27.74|E.Disks partitioned | 0.76| 41162|1 2019-06-25 00:21:20,664|MF|app-20190625002053-0075|3|4|START| 27.74|F.Maximal disks found | 0.00| 0|1 2019-06-25 00:21:20,665|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:21:20,665|Cell area: 1055533.7681000116 2019-06-25 00:21:30,019|MF|app-20190625002053-0075|3|4| END| 37.09|F.Maximal disks found | 9.36| 8547|1 2019-06-25 00:21:30,019|MAXIMALS|app-20190625002053-0075|4|3|100.0|3|450|13.51|8547 2019-06-25 00:21:30,459|FF|app-20190625002053-0075|3|4| END| 37.53|1.Maximal disks found | 13.95| 8547|1 2019-06-25 00:21:30,459|FF|app-20190625002053-0075|3|4|START| 37.53|2.Join done | 0.00| 0|1 2019-06-25 00:21:32,584|FF|app-20190625002053-0075|3|4| END| 39.66|2.Join done | 2.13| 17137|1 2019-06-25 00:21:32,584|FF|app-20190625002053-0075|3|4|START| 39.66|3.Flocks to report | 0.00| 0|1 2019-06-25 00:21:32,936|FF|app-20190625002053-0075|3|4| END| 40.01|3.Flocks to report | 0.35| 0|1 2019-06-25 00:21:32,936|FF|app-20190625002053-0075|3|4|START| 40.01|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 00:21:32,965|FF|app-20190625002053-0075|3|4| END| 40.04|4.Flocks prunned by expansion | 0.03| 0|1 2019-06-25 00:21:32,965|FF|app-20190625002053-0075|3|4|START| 40.04|5.Flocks reported | 0.00| 0|1 2019-06-25 00:21:32,970|FF|app-20190625002053-0075|3|4| END| 40.04|5.Flocks reported | 0.01| 0|1 2019-06-25 00:21:32,970|FF|app-20190625002053-0075|3|4|START| 40.04|6.Candidates indexed | 0.00| 0|1 2019-06-25 00:21:34,319|FF|app-20190625002053-0075|3|4| END| 41.39|6.Candidates indexed | 1.35| 17633|1 2019-06-25 00:21:34,319|FF|app-20190625002053-0075|3|4|START| 41.39|1.Maximal disks found | 0.00| 0|2 2019-06-25 00:21:34,320|MF|app-20190625002053-0075|3|4|START| 41.39|A.Points indexed | 0.00| 0|2 2019-06-25 00:21:34,382|MF|app-20190625002053-0075|3|4| END| 41.46|A.Points indexed | 0.06| 18394|2 2019-06-25 00:21:34,382|MF|app-20190625002053-0075|3|4|START| 41.46|B.Pairs found | 0.00| 0|2 2019-06-25 00:21:34,799|MF|app-20190625002053-0075|3|4| END| 41.87|B.Pairs found | 0.42| 34918|2 2019-06-25 00:21:34,800|MF|app-20190625002053-0075|3|4|START| 41.87|C.Centers found | 0.00| 0|2 2019-06-25 00:21:35,293|MF|app-20190625002053-0075|3|4| END| 42.37|C.Centers found | 0.49| 69836|2 2019-06-25 00:21:35,293|MF|app-20190625002053-0075|3|4|START| 42.37|D.Disks found | 0.00| 0|2 2019-06-25 00:21:37,417|MF|app-20190625002053-0075|3|4| END| 44.49|D.Disks found | 2.12| 29549|2 2019-06-25 00:21:37,417|MF|app-20190625002053-0075|3|4|START| 44.49|E.Disks partitioned | 0.00| 0|2 2019-06-25 00:21:38,089|MF|app-20190625002053-0075|3|4| END| 45.16|E.Disks partitioned | 0.67| 41840|2 2019-06-25 00:21:38,089|MF|app-20190625002053-0075|3|4|START| 45.16|F.Maximal disks found | 0.00| 0|2 2019-06-25 00:21:38,089|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:21:38,089|Cell area: 1055533.7681000116 2019-06-25 00:21:47,836|MF|app-20190625002053-0075|3|4| END| 54.91|F.Maximal disks found | 9.75| 8685|2 2019-06-25 00:21:47,836|MAXIMALS|app-20190625002053-0075|4|3|100.0|3|450|13.516|8685 2019-06-25 00:21:48,241|FF|app-20190625002053-0075|3|4| END| 55.32|1.Maximal disks found | 13.92| 8685|2 2019-06-25 00:21:48,241|FF|app-20190625002053-0075|3|4|START| 55.32|2.Join done | 0.00| 0|2 2019-06-25 00:21:54,009|FF|app-20190625002053-0075|3|4| END| 61.08|2.Join done | 5.77| 32678|2 2019-06-25 00:21:54,010|FF|app-20190625002053-0075|3|4|START| 61.08|3.Flocks to report | 0.00| 0|2 2019-06-25 00:21:54,845|FF|app-20190625002053-0075|3|4| END| 61.92|3.Flocks to report | 0.84| 27879|2 2019-06-25 00:21:54,845|FF|app-20190625002053-0075|3|4|START| 61.92|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 00:21:54,876|FF|app-20190625002053-0075|3|4|START| 61.95|4a.Making expansions | 0.00| 0|2 2019-06-25 00:21:55,448|FF|app-20190625002053-0075|3|4| END| 62.52|4a.Making expansions | 0.57| 34685|2 2019-06-25 00:21:55,448|FF|app-20190625002053-0075|3|4|START| 62.52|4b.Finding maximals | 0.00| 0|2 2019-06-25 00:22:08,715|FF|app-20190625002053-0075|3|4| END| 75.79|4b.Finding maximals | 13.27| 5697|2 2019-06-25 00:22:08,899|FF|app-20190625002053-0075|3|4| END| 75.97|4.Flocks prunned by expansion | 14.05| 5697|2 2019-06-25 00:22:08,899|FF|app-20190625002053-0075|3|4|START| 75.97|5.Flocks reported | 0.00| 0|2 2019-06-25 00:22:09,158|FF|app-20190625002053-0075|3|4| END| 76.23|5.Flocks reported | 0.26| 5697|2 2019-06-25 00:22:09,158|FF|app-20190625002053-0075|3|4|START| 76.23|6.Candidates indexed | 0.00| 0|2 2019-06-25 00:22:10,738|FF|app-20190625002053-0075|3|4| END| 77.81|6.Candidates indexed | 1.58| 11079|2 2019-06-25 00:22:10,738|FF|app-20190625002053-0075|3|4|START| 77.81|1.Maximal disks found | 0.00| 0|3 2019-06-25 00:22:10,738|MF|app-20190625002053-0075|3|4|START| 77.81|A.Points indexed | 0.00| 0|3 2019-06-25 00:22:10,793|MF|app-20190625002053-0075|3|4| END| 77.87|A.Points indexed | 0.06| 18548|3 2019-06-25 00:22:10,793|MF|app-20190625002053-0075|3|4|START| 77.87|B.Pairs found | 0.00| 0|3 2019-06-25 00:22:11,661|MF|app-20190625002053-0075|3|4| END| 78.74|B.Pairs found | 0.87| 35515|3 2019-06-25 00:22:11,661|MF|app-20190625002053-0075|3|4|START| 78.74|C.Centers found | 0.00| 0|3 2019-06-25 00:22:12,528|MF|app-20190625002053-0075|3|4| END| 79.60|C.Centers found | 0.87| 71030|3 2019-06-25 00:22:12,528|MF|app-20190625002053-0075|3|4|START| 79.60|D.Disks found | 0.00| 0|3 2019-06-25 00:22:17,373|MF|app-20190625002053-0075|3|4| END| 84.45|D.Disks found | 4.85| 30142|3 2019-06-25 00:22:17,373|MF|app-20190625002053-0075|3|4|START| 84.45|E.Disks partitioned | 0.00| 0|3 2019-06-25 00:22:18,894|MF|app-20190625002053-0075|3|4| END| 85.97|E.Disks partitioned | 1.52| 42665|3 2019-06-25 00:22:18,895|MF|app-20190625002053-0075|3|4|START| 85.97|F.Maximal disks found | 0.00| 0|3 2019-06-25 00:22:18,895|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:22:18,895|Cell area: 1055533.7681000116 2019-06-25 00:22:31,132|MF|app-20190625002053-0075|3|4| END| 98.21|F.Maximal disks found | 12.24| 8846|3 2019-06-25 00:22:31,133|MAXIMALS|app-20190625002053-0075|4|3|100.0|3|450|20.394|8846 2019-06-25 00:22:31,832|FF|app-20190625002053-0075|3|4| END| 98.91|1.Maximal disks found | 21.09| 8846|3 2019-06-25 00:22:31,832|FF|app-20190625002053-0075|3|4|START| 98.91|2.Join done | 0.00| 0|3 2019-06-25 00:22:37,748|FF|app-20190625002053-0075|3|4| END|104.82|2.Join done | 5.92| 30191|3 2019-06-25 00:22:37,748|FF|app-20190625002053-0075|3|4|START|104.82|3.Flocks to report | 0.00| 0|3 2019-06-25 00:22:39,125|FF|app-20190625002053-0075|3|4| END|106.20|3.Flocks to report | 1.38| 25329|3 2019-06-25 00:22:39,125|FF|app-20190625002053-0075|3|4|START|106.20|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 00:22:39,170|FF|app-20190625002053-0075|3|4|START|106.24|4a.Making expansions | 0.00| 0|3 2019-06-25 00:22:40,161|FF|app-20190625002053-0075|3|4| END|107.24|4a.Making expansions | 0.99| 32170|3 2019-06-25 00:22:40,161|FF|app-20190625002053-0075|3|4|START|107.24|4b.Finding maximals | 0.00| 0|3 2019-06-25 00:22:50,393|FF|app-20190625002053-0075|3|4| END|117.47|4b.Finding maximals | 10.23| 5767|3 2019-06-25 00:22:50,676|FF|app-20190625002053-0075|3|4| END|117.75|4.Flocks prunned by expansion | 11.55| 5767|3 2019-06-25 00:22:50,676|FF|app-20190625002053-0075|3|4|START|117.75|5.Flocks reported | 0.00| 0|3 2019-06-25 00:22:51,175|FF|app-20190625002053-0075|3|4| END|118.25|5.Flocks reported | 0.50| 5767|3 2019-06-25 00:22:51,175|FF|app-20190625002053-0075|3|4|START|118.25|6.Candidates indexed | 0.00| 0|3 2019-06-25 00:22:53,929|FF|app-20190625002053-0075|3|4| END|121.00|6.Candidates indexed | 2.75| 11171|3 2019-06-25 00:22:54,757|Number of flocks: 11464 2019-06-25 00:22:55,187|PFLOCK|app-20190625002053-0075|4|3|100.0|3|3|115.53|11464 2019-06-25 00:22:55,655|FF|app-20190625002053-0075|3|4| END|122.73|Flock Finder run |116.43| 11464|3 2019-06-25 00:22:55,655|FF|app-20190625002053-0075|3|4|START|122.73|Session closed | 0.00| 0|3 2019-06-25 00:23:02,357|FF|app-20190625002053-0075|3|4| END|129.43|Session closed | 6.70| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B4_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_grid-60x30.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 12 --fftimestamp 4 --portui 4040 --info 2019-06-25 00:23:04,349|FF|app-00000000000000-0000|12|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 00:23:05,453|FF|app-20190625002305-0076|12|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 00:23:05,453|FF|app-20190625002305-0076|12|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 00:23:08,540|FF|app-20190625002305-0076|12|4|START| 4.17|KDBTree partitioner | 0.00| 0|-1 2019-06-25 00:23:09,841|Sample size: 441504 2019-06-25 00:23:10,147|FF|app-20190625002305-0076|12|4| END| 5.78|KDBTree partitioner | 1.61| 1129|-1 2019-06-25 00:23:10,147|FF|app-20190625002305-0076|12|4|START| 5.78|MF partitioner | 0.00| 0|-1 2019-06-25 00:23:10,200|FF|app-20190625002305-0076|12|4| END| 5.83|MF partitioner | 0.05| 1800|-1 2019-06-25 00:23:12,196|FF|app-20190625002305-0076|12|4| END| 7.83|MF partitioner | 2.05|441504|-1 2019-06-25 00:23:12,196|FF|app-20190625002305-0076|12|4|START| 7.83|Flock Finder run | 0.00| 0|-1 2019-06-25 00:23:12,212|FF|app-20190625002305-0076|12|4|START| 7.85|1.Maximal disks found | 0.00| 0|0 2019-06-25 00:23:12,215|MF|app-20190625002305-0076|12|4|START| 7.85|A.Points indexed | 0.00| 0|0 2019-06-25 00:23:12,456|MF|app-20190625002305-0076|12|4| END| 8.09|A.Points indexed | 0.24| 72372|0 2019-06-25 00:23:12,456|MF|app-20190625002305-0076|12|4|START| 8.09|B.Pairs found | 0.00| 0|0 2019-06-25 00:23:14,285|MF|app-20190625002305-0076|12|4| END| 9.92|B.Pairs found | 1.83|157616|0 2019-06-25 00:23:14,285|MF|app-20190625002305-0076|12|4|START| 9.92|C.Centers found | 0.00| 0|0 2019-06-25 00:23:15,519|MF|app-20190625002305-0076|12|4| END| 11.15|C.Centers found | 1.23|315232|0 2019-06-25 00:23:15,519|MF|app-20190625002305-0076|12|4|START| 11.15|D.Disks found | 0.00| 0|0 2019-06-25 00:23:20,254|MF|app-20190625002305-0076|12|4| END| 15.89|D.Disks found | 4.74|140916|0 2019-06-25 00:23:20,254|MF|app-20190625002305-0076|12|4|START| 15.89|E.Disks partitioned | 0.00| 0|0 2019-06-25 00:23:21,869|MF|app-20190625002305-0076|12|4| END| 17.50|E.Disks partitioned | 1.62|206209|0 2019-06-25 00:23:21,869|MF|app-20190625002305-0076|12|4|START| 17.50|F.Maximal disks found | 0.00| 0|0 2019-06-25 00:23:21,872|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:23:21,872|Cell area: 1055533.7681000116 2019-06-25 00:23:47,235|MF|app-20190625002305-0076|12|4| END| 42.87|F.Maximal disks found | 25.37| 40009|0 2019-06-25 00:23:47,235|MAXIMALS|app-20190625002305-0076|4|12|110.0|3|1800|35.021|40009 2019-06-25 00:23:48,640|FF|app-20190625002305-0076|12|4| END| 44.27|1.Maximal disks found | 36.43| 40009|0 2019-06-25 00:23:48,640|FF|app-20190625002305-0076|12|4|START| 44.27|1.Maximal disks found | 0.00| 0|1 2019-06-25 00:23:48,640|MF|app-20190625002305-0076|12|4|START| 44.27|A.Points indexed | 0.00| 0|1 2019-06-25 00:23:48,767|MF|app-20190625002305-0076|12|4| END| 44.40|A.Points indexed | 0.13| 72980|1 2019-06-25 00:23:48,767|MF|app-20190625002305-0076|12|4|START| 44.40|B.Pairs found | 0.00| 0|1 2019-06-25 00:23:49,637|MF|app-20190625002305-0076|12|4| END| 45.27|B.Pairs found | 0.87|159996|1 2019-06-25 00:23:49,637|MF|app-20190625002305-0076|12|4|START| 45.27|C.Centers found | 0.00| 0|1 2019-06-25 00:23:50,504|MF|app-20190625002305-0076|12|4| END| 46.14|C.Centers found | 0.87|319992|1 2019-06-25 00:23:50,504|MF|app-20190625002305-0076|12|4|START| 46.14|D.Disks found | 0.00| 0|1 2019-06-25 00:23:54,123|MF|app-20190625002305-0076|12|4| END| 49.76|D.Disks found | 3.62|143396|1 2019-06-25 00:23:54,123|MF|app-20190625002305-0076|12|4|START| 49.76|E.Disks partitioned | 0.00| 0|1 2019-06-25 00:23:55,291|MF|app-20190625002305-0076|12|4| END| 50.93|E.Disks partitioned | 1.17|209660|1 2019-06-25 00:23:55,291|MF|app-20190625002305-0076|12|4|START| 50.93|F.Maximal disks found | 0.00| 0|1 2019-06-25 00:23:55,292|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:23:55,292|Cell area: 1055533.7681000116 2019-06-25 00:24:21,307|MF|app-20190625002305-0076|12|4| END| 76.94|F.Maximal disks found | 26.02| 40432|1 2019-06-25 00:24:21,307|MAXIMALS|app-20190625002305-0076|4|12|110.0|3|1800|32.667|40432 2019-06-25 00:24:22,671|FF|app-20190625002305-0076|12|4| END| 78.31|1.Maximal disks found | 34.03| 40432|1 2019-06-25 00:24:22,671|FF|app-20190625002305-0076|12|4|START| 78.31|2.Join done | 0.00| 0|1 2019-06-25 00:24:26,806|FF|app-20190625002305-0076|12|4| END| 82.44|2.Join done | 4.14| 87506|1 2019-06-25 00:24:26,806|FF|app-20190625002305-0076|12|4|START| 82.44|3.Flocks to report | 0.00| 0|1 2019-06-25 00:24:27,467|FF|app-20190625002305-0076|12|4| END| 83.10|3.Flocks to report | 0.66| 0|1 2019-06-25 00:24:27,467|FF|app-20190625002305-0076|12|4|START| 83.10|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 00:24:27,524|FF|app-20190625002305-0076|12|4| END| 83.16|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 00:24:27,524|FF|app-20190625002305-0076|12|4|START| 83.16|5.Flocks reported | 0.00| 0|1 2019-06-25 00:24:27,528|FF|app-20190625002305-0076|12|4| END| 83.16|5.Flocks reported | 0.00| 0|1 2019-06-25 00:24:27,528|FF|app-20190625002305-0076|12|4|START| 83.16|6.Candidates indexed | 0.00| 0|1 2019-06-25 00:24:29,589|FF|app-20190625002305-0076|12|4| END| 85.22|6.Candidates indexed | 2.06| 89925|1 2019-06-25 00:24:29,590|FF|app-20190625002305-0076|12|4|START| 85.22|1.Maximal disks found | 0.00| 0|2 2019-06-25 00:24:29,590|MF|app-20190625002305-0076|12|4|START| 85.22|A.Points indexed | 0.00| 0|2 2019-06-25 00:24:29,724|MF|app-20190625002305-0076|12|4| END| 85.36|A.Points indexed | 0.13| 73576|2 2019-06-25 00:24:29,724|MF|app-20190625002305-0076|12|4|START| 85.36|B.Pairs found | 0.00| 0|2 2019-06-25 00:24:30,465|MF|app-20190625002305-0076|12|4| END| 86.10|B.Pairs found | 0.74|162264|2 2019-06-25 00:24:30,465|MF|app-20190625002305-0076|12|4|START| 86.10|C.Centers found | 0.00| 0|2 2019-06-25 00:24:31,361|MF|app-20190625002305-0076|12|4| END| 87.00|C.Centers found | 0.90|324528|2 2019-06-25 00:24:31,361|MF|app-20190625002305-0076|12|4|START| 87.00|D.Disks found | 0.00| 0|2 2019-06-25 00:24:35,013|MF|app-20190625002305-0076|12|4| END| 90.65|D.Disks found | 3.65|145412|2 2019-06-25 00:24:35,013|MF|app-20190625002305-0076|12|4|START| 90.65|E.Disks partitioned | 0.00| 0|2 2019-06-25 00:24:36,468|MF|app-20190625002305-0076|12|4| END| 92.10|E.Disks partitioned | 1.46|212798|2 2019-06-25 00:24:36,468|MF|app-20190625002305-0076|12|4|START| 92.10|F.Maximal disks found | 0.00| 0|2 2019-06-25 00:24:36,469|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:24:36,469|Cell area: 1055533.7681000116 2019-06-25 00:25:02,467|MF|app-20190625002305-0076|12|4| END|118.10|F.Maximal disks found | 26.00| 41347|2 2019-06-25 00:25:02,467|MAXIMALS|app-20190625002305-0076|4|12|110.0|3|1800|32.877|41347 2019-06-25 00:25:03,884|FF|app-20190625002305-0076|12|4| END|119.52|1.Maximal disks found | 34.29| 41347|2 2019-06-25 00:25:03,884|FF|app-20190625002305-0076|12|4|START|119.52|2.Join done | 0.00| 0|2 2019-06-25 00:25:14,187|FF|app-20190625002305-0076|12|4| END|129.82|2.Join done | 10.30|179268|2 2019-06-25 00:25:14,187|FF|app-20190625002305-0076|12|4|START|129.82|3.Flocks to report | 0.00| 0|2 2019-06-25 00:25:15,166|FF|app-20190625002305-0076|12|4| END|130.80|3.Flocks to report | 0.98|153105|2 2019-06-25 00:25:15,167|FF|app-20190625002305-0076|12|4|START|130.80|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 00:25:15,227|FF|app-20190625002305-0076|12|4|START|130.86|4a.Making expansions | 0.00| 0|2 2019-06-25 00:25:16,323|FF|app-20190625002305-0076|12|4| END|131.96|4a.Making expansions | 1.10|191252|2 2019-06-25 00:25:16,323|FF|app-20190625002305-0076|12|4|START|131.96|4b.Finding maximals | 0.00| 0|2 2019-06-25 00:26:05,769|FF|app-20190625002305-0076|12|4| END|181.40|4b.Finding maximals | 49.45| 26404|2 2019-06-25 00:26:06,371|FF|app-20190625002305-0076|12|4| END|182.01|4.Flocks prunned by expansion | 51.21| 26404|2 2019-06-25 00:26:06,371|FF|app-20190625002305-0076|12|4|START|182.01|5.Flocks reported | 0.00| 0|2 2019-06-25 00:26:07,146|FF|app-20190625002305-0076|12|4| END|182.78|5.Flocks reported | 0.78| 26404|2 2019-06-25 00:26:07,146|FF|app-20190625002305-0076|12|4|START|182.78|6.Candidates indexed | 0.00| 0|2 2019-06-25 00:26:09,549|FF|app-20190625002305-0076|12|4| END|185.18|6.Candidates indexed | 2.40| 55147|2 2019-06-25 00:26:09,550|FF|app-20190625002305-0076|12|4|START|185.18|1.Maximal disks found | 0.00| 0|3 2019-06-25 00:26:09,550|MF|app-20190625002305-0076|12|4|START|185.18|A.Points indexed | 0.00| 0|3 2019-06-25 00:26:09,667|MF|app-20190625002305-0076|12|4| END|185.30|A.Points indexed | 0.12| 74192|3 2019-06-25 00:26:09,667|MF|app-20190625002305-0076|12|4|START|185.30|B.Pairs found | 0.00| 0|3 2019-06-25 00:26:10,364|MF|app-20190625002305-0076|12|4| END|186.00|B.Pairs found | 0.70|165028|3 2019-06-25 00:26:10,364|MF|app-20190625002305-0076|12|4|START|186.00|C.Centers found | 0.00| 0|3 2019-06-25 00:26:11,209|MF|app-20190625002305-0076|12|4| END|186.84|C.Centers found | 0.85|330056|3 2019-06-25 00:26:11,209|MF|app-20190625002305-0076|12|4|START|186.84|D.Disks found | 0.00| 0|3 2019-06-25 00:26:14,659|MF|app-20190625002305-0076|12|4| END|190.29|D.Disks found | 3.45|148348|3 2019-06-25 00:26:14,659|MF|app-20190625002305-0076|12|4|START|190.29|E.Disks partitioned | 0.00| 0|3 2019-06-25 00:26:15,889|MF|app-20190625002305-0076|12|4| END|191.52|E.Disks partitioned | 1.23|217088|3 2019-06-25 00:26:15,889|MF|app-20190625002305-0076|12|4|START|191.52|F.Maximal disks found | 0.00| 0|3 2019-06-25 00:26:15,890|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:26:15,890|Cell area: 1055533.7681000116 2019-06-25 00:26:48,448|MF|app-20190625002305-0076|12|4| END|224.08|F.Maximal disks found | 32.56| 42012|3 2019-06-25 00:26:48,448|MAXIMALS|app-20190625002305-0076|4|12|110.0|3|1800|38.898|42012 2019-06-25 00:26:49,832|FF|app-20190625002305-0076|12|4| END|225.47|1.Maximal disks found | 40.28| 42012|3 2019-06-25 00:26:49,832|FF|app-20190625002305-0076|12|4|START|225.47|2.Join done | 0.00| 0|3 2019-06-25 00:26:56,218|FF|app-20190625002305-0076|12|4| END|231.85|2.Join done | 6.39|179709|3 2019-06-25 00:26:56,218|FF|app-20190625002305-0076|12|4|START|231.85|3.Flocks to report | 0.00| 0|3 2019-06-25 00:26:57,112|FF|app-20190625002305-0076|12|4| END|232.75|3.Flocks to report | 0.89|153488|3 2019-06-25 00:26:57,112|FF|app-20190625002305-0076|12|4|START|232.75|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 00:26:57,178|FF|app-20190625002305-0076|12|4|START|232.81|4a.Making expansions | 0.00| 0|3 2019-06-25 00:26:58,332|FF|app-20190625002305-0076|12|4| END|233.97|4a.Making expansions | 1.15|191656|3 2019-06-25 00:26:58,332|FF|app-20190625002305-0076|12|4|START|233.97|4b.Finding maximals | 0.00| 0|3 2019-06-25 00:28:07,362|FF|app-20190625002305-0076|12|4| END|303.00|4b.Finding maximals | 69.03| 26676|3 2019-06-25 00:28:08,043|FF|app-20190625002305-0076|12|4| END|303.68|4.Flocks prunned by expansion | 70.93| 26676|3 2019-06-25 00:28:08,043|FF|app-20190625002305-0076|12|4|START|303.68|5.Flocks reported | 0.00| 0|3 2019-06-25 00:28:08,871|FF|app-20190625002305-0076|12|4| END|304.51|5.Flocks reported | 0.83| 26676|3 2019-06-25 00:28:08,871|FF|app-20190625002305-0076|12|4|START|304.51|6.Candidates indexed | 0.00| 0|3 2019-06-25 00:28:11,365|FF|app-20190625002305-0076|12|4| END|307.00|6.Candidates indexed | 2.49| 55524|3 2019-06-25 00:28:13,155|Number of flocks: 53080 2019-06-25 00:28:14,396|PFLOCK|app-20190625002305-0076|4|12|110.0|3|3|300.96|53080 2019-06-25 00:28:15,635|FF|app-20190625002305-0076|12|4| END|311.27|Flock Finder run |303.44| 53080|3 2019-06-25 00:28:15,635|FF|app-20190625002305-0076|12|4|START|311.27|Session closed | 0.00| 0|3 2019-06-25 00:28:23,687|FF|app-20190625002305-0076|12|4| END|319.32|Session closed | 8.05| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 6 --fftimestamp 4 --portui 4040 --info 2019-06-25 00:28:25,607|FF|app-00000000000000-0000|6|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 00:28:26,709|FF|app-20190625002826-0077|6|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 00:28:26,710|FF|app-20190625002826-0077|6|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 00:28:29,690|FF|app-20190625002826-0077|6|4|START| 4.07|KDBTree partitioner | 0.00| 0|-1 2019-06-25 00:28:30,664|Sample size: 220752 2019-06-25 00:28:30,813|FF|app-20190625002826-0077|6|4| END| 5.19|KDBTree partitioner | 1.12| 565|-1 2019-06-25 00:28:30,814|FF|app-20190625002826-0077|6|4|START| 5.19|MF partitioner | 0.00| 0|-1 2019-06-25 00:28:30,865|FF|app-20190625002826-0077|6|4| END| 5.24|MF partitioner | 0.05| 900|-1 2019-06-25 00:28:32,407|FF|app-20190625002826-0077|6|4| END| 6.78|MF partitioner | 1.59|220752|-1 2019-06-25 00:28:32,407|FF|app-20190625002826-0077|6|4|START| 6.78|Flock Finder run | 0.00| 0|-1 2019-06-25 00:28:32,425|FF|app-20190625002826-0077|6|4|START| 6.80|1.Maximal disks found | 0.00| 0|0 2019-06-25 00:28:32,427|MF|app-20190625002826-0077|6|4|START| 6.80|A.Points indexed | 0.00| 0|0 2019-06-25 00:28:32,613|MF|app-20190625002826-0077|6|4| END| 6.99|A.Points indexed | 0.19| 36186|0 2019-06-25 00:28:32,613|MF|app-20190625002826-0077|6|4|START| 6.99|B.Pairs found | 0.00| 0|0 2019-06-25 00:28:34,029|MF|app-20190625002826-0077|6|4| END| 8.41|B.Pairs found | 1.42| 78808|0 2019-06-25 00:28:34,030|MF|app-20190625002826-0077|6|4|START| 8.41|C.Centers found | 0.00| 0|0 2019-06-25 00:28:35,051|MF|app-20190625002826-0077|6|4| END| 9.43|C.Centers found | 1.02|157616|0 2019-06-25 00:28:35,051|MF|app-20190625002826-0077|6|4|START| 9.43|D.Disks found | 0.00| 0|0 2019-06-25 00:28:41,009|MF|app-20190625002826-0077|6|4| END| 15.39|D.Disks found | 5.96| 70458|0 2019-06-25 00:28:41,009|MF|app-20190625002826-0077|6|4|START| 15.39|E.Disks partitioned | 0.00| 0|0 2019-06-25 00:28:45,588|MF|app-20190625002826-0077|6|4| END| 19.96|E.Disks partitioned | 4.58|103004|0 2019-06-25 00:28:45,588|MF|app-20190625002826-0077|6|4|START| 19.97|F.Maximal disks found | 0.00| 0|0 2019-06-25 00:28:45,589|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:28:45,589|Cell area: 1055533.7681000116 2019-06-25 00:29:14,480|MF|app-20190625002826-0077|6|4| END| 48.86|F.Maximal disks found | 28.89| 20001|0 2019-06-25 00:29:14,480|MAXIMALS|app-20190625002826-0077|4|6|110.0|3|900|42.053|20001 2019-06-25 00:29:16,066|FF|app-20190625002826-0077|6|4| END| 50.44|1.Maximal disks found | 43.64| 20001|0 2019-06-25 00:29:16,066|FF|app-20190625002826-0077|6|4|START| 50.44|1.Maximal disks found | 0.00| 0|1 2019-06-25 00:29:16,066|MF|app-20190625002826-0077|6|4|START| 50.44|A.Points indexed | 0.00| 0|1 2019-06-25 00:29:16,210|MF|app-20190625002826-0077|6|4| END| 50.59|A.Points indexed | 0.14| 36490|1 2019-06-25 00:29:16,210|MF|app-20190625002826-0077|6|4|START| 50.59|B.Pairs found | 0.00| 0|1 2019-06-25 00:29:16,916|MF|app-20190625002826-0077|6|4| END| 51.29|B.Pairs found | 0.71| 79998|1 2019-06-25 00:29:16,916|MF|app-20190625002826-0077|6|4|START| 51.29|C.Centers found | 0.00| 0|1 2019-06-25 00:29:17,595|MF|app-20190625002826-0077|6|4| END| 51.97|C.Centers found | 0.68|159996|1 2019-06-25 00:29:17,595|MF|app-20190625002826-0077|6|4|START| 51.97|D.Disks found | 0.00| 0|1 2019-06-25 00:29:21,807|MF|app-20190625002826-0077|6|4| END| 56.18|D.Disks found | 4.21| 71698|1 2019-06-25 00:29:21,807|MF|app-20190625002826-0077|6|4|START| 56.18|E.Disks partitioned | 0.00| 0|1 2019-06-25 00:29:24,211|MF|app-20190625002826-0077|6|4| END| 58.59|E.Disks partitioned | 2.40|104758|1 2019-06-25 00:29:24,211|MF|app-20190625002826-0077|6|4|START| 58.59|F.Maximal disks found | 0.00| 0|1 2019-06-25 00:29:24,212|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:29:24,212|Cell area: 1055533.7681000116 2019-06-25 00:29:50,487|MF|app-20190625002826-0077|6|4| END| 84.86|F.Maximal disks found | 26.28| 20222|1 2019-06-25 00:29:50,487|MAXIMALS|app-20190625002826-0077|4|6|110.0|3|900|34.421|20222 2019-06-25 00:29:51,450|FF|app-20190625002826-0077|6|4| END| 85.83|1.Maximal disks found | 35.38| 20222|1 2019-06-25 00:29:51,450|FF|app-20190625002826-0077|6|4|START| 85.83|2.Join done | 0.00| 0|1 2019-06-25 00:29:57,569|FF|app-20190625002826-0077|6|4| END| 91.95|2.Join done | 6.12| 43837|1 2019-06-25 00:29:57,569|FF|app-20190625002826-0077|6|4|START| 91.95|3.Flocks to report | 0.00| 0|1 2019-06-25 00:29:58,483|FF|app-20190625002826-0077|6|4| END| 92.86|3.Flocks to report | 0.91| 0|1 2019-06-25 00:29:58,483|FF|app-20190625002826-0077|6|4|START| 92.86|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 00:29:58,523|FF|app-20190625002826-0077|6|4| END| 92.90|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 00:29:58,523|FF|app-20190625002826-0077|6|4|START| 92.90|5.Flocks reported | 0.00| 0|1 2019-06-25 00:29:58,528|FF|app-20190625002826-0077|6|4| END| 92.91|5.Flocks reported | 0.01| 0|1 2019-06-25 00:29:58,528|FF|app-20190625002826-0077|6|4|START| 92.91|6.Candidates indexed | 0.00| 0|1 2019-06-25 00:30:02,474|FF|app-20190625002826-0077|6|4| END| 96.85|6.Candidates indexed | 3.95| 45047|1 2019-06-25 00:30:02,474|FF|app-20190625002826-0077|6|4|START| 96.85|1.Maximal disks found | 0.00| 0|2 2019-06-25 00:30:02,475|MF|app-20190625002826-0077|6|4|START| 96.85|A.Points indexed | 0.00| 0|2 2019-06-25 00:30:02,560|MF|app-20190625002826-0077|6|4| END| 96.94|A.Points indexed | 0.08| 36788|2 2019-06-25 00:30:02,560|MF|app-20190625002826-0077|6|4|START| 96.94|B.Pairs found | 0.00| 0|2 2019-06-25 00:30:03,197|MF|app-20190625002826-0077|6|4| END| 97.57|B.Pairs found | 0.64| 81132|2 2019-06-25 00:30:03,197|MF|app-20190625002826-0077|6|4|START| 97.57|C.Centers found | 0.00| 0|2 2019-06-25 00:30:03,910|MF|app-20190625002826-0077|6|4| END| 98.29|C.Centers found | 0.71|162264|2 2019-06-25 00:30:03,911|MF|app-20190625002826-0077|6|4|START| 98.29|D.Disks found | 0.00| 0|2 2019-06-25 00:30:07,774|MF|app-20190625002826-0077|6|4| END|102.15|D.Disks found | 3.86| 72706|2 2019-06-25 00:30:07,774|MF|app-20190625002826-0077|6|4|START|102.15|E.Disks partitioned | 0.00| 0|2 2019-06-25 00:30:09,274|MF|app-20190625002826-0077|6|4| END|103.65|E.Disks partitioned | 1.50|106347|2 2019-06-25 00:30:09,274|MF|app-20190625002826-0077|6|4|START|103.65|F.Maximal disks found | 0.00| 0|2 2019-06-25 00:30:09,274|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:30:09,274|Cell area: 1055533.7681000116 2019-06-25 00:30:36,440|MF|app-20190625002826-0077|6|4| END|130.82|F.Maximal disks found | 27.17| 20682|2 2019-06-25 00:30:36,440|MAXIMALS|app-20190625002826-0077|4|6|110.0|3|900|33.965|20682 2019-06-25 00:30:37,187|FF|app-20190625002826-0077|6|4| END|131.56|1.Maximal disks found | 34.71| 20682|2 2019-06-25 00:30:37,187|FF|app-20190625002826-0077|6|4|START|131.56|2.Join done | 0.00| 0|2 2019-06-25 00:30:53,474|FF|app-20190625002826-0077|6|4| END|147.85|2.Join done | 16.29| 89740|2 2019-06-25 00:30:53,474|FF|app-20190625002826-0077|6|4|START|147.85|3.Flocks to report | 0.00| 0|2 2019-06-25 00:30:55,486|FF|app-20190625002826-0077|6|4| END|149.86|3.Flocks to report | 2.01| 76643|2 2019-06-25 00:30:55,487|FF|app-20190625002826-0077|6|4|START|149.86|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 00:30:55,531|FF|app-20190625002826-0077|6|4|START|149.91|4a.Making expansions | 0.00| 0|2 2019-06-25 00:30:56,830|FF|app-20190625002826-0077|6|4| END|151.21|4a.Making expansions | 1.30| 95606|2 2019-06-25 00:30:56,830|FF|app-20190625002826-0077|6|4|START|151.21|4b.Finding maximals | 0.00| 0|2 2019-06-25 00:31:41,569|FF|app-20190625002826-0077|6|4| END|195.95|4b.Finding maximals | 44.74| 13202|2 2019-06-25 00:31:41,931|FF|app-20190625002826-0077|6|4| END|196.31|4.Flocks prunned by expansion | 46.44| 13202|2 2019-06-25 00:31:41,932|FF|app-20190625002826-0077|6|4|START|196.31|5.Flocks reported | 0.00| 0|2 2019-06-25 00:31:42,554|FF|app-20190625002826-0077|6|4| END|196.93|5.Flocks reported | 0.62| 13202|2 2019-06-25 00:31:42,554|FF|app-20190625002826-0077|6|4|START|196.93|6.Candidates indexed | 0.00| 0|2 2019-06-25 00:31:46,250|FF|app-20190625002826-0077|6|4| END|200.63|6.Candidates indexed | 3.70| 27595|2 2019-06-25 00:31:46,250|FF|app-20190625002826-0077|6|4|START|200.63|1.Maximal disks found | 0.00| 0|3 2019-06-25 00:31:46,250|MF|app-20190625002826-0077|6|4|START|200.63|A.Points indexed | 0.00| 0|3 2019-06-25 00:31:46,329|MF|app-20190625002826-0077|6|4| END|200.71|A.Points indexed | 0.08| 37096|3 2019-06-25 00:31:46,329|MF|app-20190625002826-0077|6|4|START|200.71|B.Pairs found | 0.00| 0|3 2019-06-25 00:31:46,923|MF|app-20190625002826-0077|6|4| END|201.30|B.Pairs found | 0.59| 82514|3 2019-06-25 00:31:46,923|MF|app-20190625002826-0077|6|4|START|201.30|C.Centers found | 0.00| 0|3 2019-06-25 00:31:47,712|MF|app-20190625002826-0077|6|4| END|202.09|C.Centers found | 0.79|165028|3 2019-06-25 00:31:47,712|MF|app-20190625002826-0077|6|4|START|202.09|D.Disks found | 0.00| 0|3 2019-06-25 00:31:51,217|MF|app-20190625002826-0077|6|4| END|205.59|D.Disks found | 3.51| 74174|3 2019-06-25 00:31:51,217|MF|app-20190625002826-0077|6|4|START|205.59|E.Disks partitioned | 0.00| 0|3 2019-06-25 00:31:52,747|MF|app-20190625002826-0077|6|4| END|207.12|E.Disks partitioned | 1.53|108468|3 2019-06-25 00:31:52,747|MF|app-20190625002826-0077|6|4|START|207.12|F.Maximal disks found | 0.00| 0|3 2019-06-25 00:31:52,748|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:31:52,748|Cell area: 1055533.7681000116 2019-06-25 00:32:25,677|MF|app-20190625002826-0077|6|4| END|240.05|F.Maximal disks found | 32.93| 21009|3 2019-06-25 00:32:25,677|MAXIMALS|app-20190625002826-0077|4|6|110.0|3|900|39.427|21009 2019-06-25 00:32:26,405|FF|app-20190625002826-0077|6|4| END|240.78|1.Maximal disks found | 40.16| 21009|3 2019-06-25 00:32:26,405|FF|app-20190625002826-0077|6|4|START|240.78|2.Join done | 0.00| 0|3 2019-06-25 00:32:39,204|FF|app-20190625002826-0077|6|4| END|253.58|2.Join done | 12.80| 90003|3 2019-06-25 00:32:39,204|FF|app-20190625002826-0077|6|4|START|253.58|3.Flocks to report | 0.00| 0|3 2019-06-25 00:32:41,332|FF|app-20190625002826-0077|6|4| END|255.71|3.Flocks to report | 2.13| 76861|3 2019-06-25 00:32:41,332|FF|app-20190625002826-0077|6|4|START|255.71|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 00:32:41,384|FF|app-20190625002826-0077|6|4|START|255.76|4a.Making expansions | 0.00| 0|3 2019-06-25 00:32:42,975|FF|app-20190625002826-0077|6|4| END|257.35|4a.Making expansions | 1.59| 95602|3 2019-06-25 00:32:42,975|FF|app-20190625002826-0077|6|4|START|257.35|4b.Finding maximals | 0.00| 0|3 2019-06-25 00:33:46,979|FF|app-20190625002826-0077|6|4| END|321.36|4b.Finding maximals | 64.00| 13338|3 2019-06-25 00:33:47,431|FF|app-20190625002826-0077|6|4| END|321.81|4.Flocks prunned by expansion | 66.10| 13338|3 2019-06-25 00:33:47,431|FF|app-20190625002826-0077|6|4|START|321.81|5.Flocks reported | 0.00| 0|3 2019-06-25 00:33:48,055|FF|app-20190625002826-0077|6|4| END|322.43|5.Flocks reported | 0.62| 13338|3 2019-06-25 00:33:48,055|FF|app-20190625002826-0077|6|4|START|322.43|6.Candidates indexed | 0.00| 0|3 2019-06-25 00:33:51,738|FF|app-20190625002826-0077|6|4| END|326.12|6.Candidates indexed | 3.68| 27789|3 2019-06-25 00:33:52,745|Number of flocks: 26540 2019-06-25 00:33:53,412|PFLOCK|app-20190625002826-0077|4|6|110.0|3|3|320.34|26540 2019-06-25 00:33:54,074|FF|app-20190625002826-0077|6|4| END|328.45|Flock Finder run |321.67| 26540|3 2019-06-25 00:33:54,074|FF|app-20190625002826-0077|6|4|START|328.45|Session closed | 0.00| 0|3 2019-06-25 00:34:00,532|FF|app-20190625002826-0077|6|4| END|334.91|Session closed | 6.46| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 3 --fftimestamp 4 --portui 4040 --info 2019-06-25 00:34:02,557|FF|app-00000000000000-0000|3|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 00:34:03,665|FF|app-20190625003403-0078|3|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 00:34:03,666|FF|app-20190625003403-0078|3|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 00:34:06,609|FF|app-20190625003403-0078|3|4|START| 4.04|KDBTree partitioner | 0.00| 0|-1 2019-06-25 00:34:07,277|Sample size: 110376 2019-06-25 00:34:07,355|FF|app-20190625003403-0078|3|4| END| 4.78|KDBTree partitioner | 0.75| 285|-1 2019-06-25 00:34:07,355|FF|app-20190625003403-0078|3|4|START| 4.78|MF partitioner | 0.00| 0|-1 2019-06-25 00:34:07,380|FF|app-20190625003403-0078|3|4| END| 4.81|MF partitioner | 0.03| 450|-1 2019-06-25 00:34:08,738|FF|app-20190625003403-0078|3|4| END| 6.17|MF partitioner | 1.38|110376|-1 2019-06-25 00:34:08,738|FF|app-20190625003403-0078|3|4|START| 6.17|Flock Finder run | 0.00| 0|-1 2019-06-25 00:34:08,756|FF|app-20190625003403-0078|3|4|START| 6.18|1.Maximal disks found | 0.00| 0|0 2019-06-25 00:34:08,759|MF|app-20190625003403-0078|3|4|START| 6.19|A.Points indexed | 0.00| 0|0 2019-06-25 00:34:09,093|MF|app-20190625003403-0078|3|4| END| 6.52|A.Points indexed | 0.34| 18093|0 2019-06-25 00:34:09,093|MF|app-20190625003403-0078|3|4|START| 6.52|B.Pairs found | 0.00| 0|0 2019-06-25 00:34:10,295|MF|app-20190625003403-0078|3|4| END| 7.72|B.Pairs found | 1.20| 39404|0 2019-06-25 00:34:10,295|MF|app-20190625003403-0078|3|4|START| 7.72|C.Centers found | 0.00| 0|0 2019-06-25 00:34:11,289|MF|app-20190625003403-0078|3|4| END| 8.72|C.Centers found | 0.99| 78808|0 2019-06-25 00:34:11,289|MF|app-20190625003403-0078|3|4|START| 8.72|D.Disks found | 0.00| 0|0 2019-06-25 00:34:14,685|MF|app-20190625003403-0078|3|4| END| 12.11|D.Disks found | 3.40| 35229|0 2019-06-25 00:34:14,685|MF|app-20190625003403-0078|3|4|START| 12.11|E.Disks partitioned | 0.00| 0|0 2019-06-25 00:34:15,903|MF|app-20190625003403-0078|3|4| END| 13.33|E.Disks partitioned | 1.22| 51442|0 2019-06-25 00:34:15,903|MF|app-20190625003403-0078|3|4|START| 13.33|F.Maximal disks found | 0.00| 0|0 2019-06-25 00:34:15,904|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:34:15,904|Cell area: 1055533.7681000116 2019-06-25 00:34:40,535|MF|app-20190625003403-0078|3|4| END| 37.96|F.Maximal disks found | 24.63| 10001|0 2019-06-25 00:34:40,535|MAXIMALS|app-20190625003403-0078|4|3|110.0|3|450|31.777|10001 2019-06-25 00:34:41,038|FF|app-20190625003403-0078|3|4| END| 38.47|1.Maximal disks found | 32.28| 10001|0 2019-06-25 00:34:41,038|FF|app-20190625003403-0078|3|4|START| 38.47|1.Maximal disks found | 0.00| 0|1 2019-06-25 00:34:41,038|MF|app-20190625003403-0078|3|4|START| 38.47|A.Points indexed | 0.00| 0|1 2019-06-25 00:34:41,110|MF|app-20190625003403-0078|3|4| END| 38.54|A.Points indexed | 0.07| 18245|1 2019-06-25 00:34:41,110|MF|app-20190625003403-0078|3|4|START| 38.54|B.Pairs found | 0.00| 0|1 2019-06-25 00:34:41,660|MF|app-20190625003403-0078|3|4| END| 39.09|B.Pairs found | 0.55| 39999|1 2019-06-25 00:34:41,660|MF|app-20190625003403-0078|3|4|START| 39.09|C.Centers found | 0.00| 0|1 2019-06-25 00:34:42,186|MF|app-20190625003403-0078|3|4| END| 39.61|C.Centers found | 0.53| 79998|1 2019-06-25 00:34:42,186|MF|app-20190625003403-0078|3|4|START| 39.61|D.Disks found | 0.00| 0|1 2019-06-25 00:34:44,661|MF|app-20190625003403-0078|3|4| END| 42.09|D.Disks found | 2.48| 35849|1 2019-06-25 00:34:44,661|MF|app-20190625003403-0078|3|4|START| 42.09|E.Disks partitioned | 0.00| 0|1 2019-06-25 00:34:45,571|MF|app-20190625003403-0078|3|4| END| 43.00|E.Disks partitioned | 0.91| 52317|1 2019-06-25 00:34:45,572|MF|app-20190625003403-0078|3|4|START| 43.00|F.Maximal disks found | 0.00| 0|1 2019-06-25 00:34:45,572|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:34:45,572|Cell area: 1055533.7681000116 2019-06-25 00:35:11,027|MF|app-20190625003403-0078|3|4| END| 68.45|F.Maximal disks found | 25.46| 10110|1 2019-06-25 00:35:11,027|MAXIMALS|app-20190625003403-0078|4|3|110.0|3|450|29.989|10110 2019-06-25 00:35:11,436|FF|app-20190625003403-0078|3|4| END| 68.86|1.Maximal disks found | 30.40| 10110|1 2019-06-25 00:35:11,436|FF|app-20190625003403-0078|3|4|START| 68.86|2.Join done | 0.00| 0|1 2019-06-25 00:35:13,854|FF|app-20190625003403-0078|3|4| END| 71.28|2.Join done | 2.42| 21993|1 2019-06-25 00:35:13,854|FF|app-20190625003403-0078|3|4|START| 71.28|3.Flocks to report | 0.00| 0|1 2019-06-25 00:35:14,305|FF|app-20190625003403-0078|3|4| END| 71.73|3.Flocks to report | 0.45| 0|1 2019-06-25 00:35:14,306|FF|app-20190625003403-0078|3|4|START| 71.73|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 00:35:14,333|FF|app-20190625003403-0078|3|4| END| 71.76|4.Flocks prunned by expansion | 0.03| 0|1 2019-06-25 00:35:14,333|FF|app-20190625003403-0078|3|4|START| 71.76|5.Flocks reported | 0.00| 0|1 2019-06-25 00:35:14,339|FF|app-20190625003403-0078|3|4| END| 71.77|5.Flocks reported | 0.01| 0|1 2019-06-25 00:35:14,339|FF|app-20190625003403-0078|3|4|START| 71.77|6.Candidates indexed | 0.00| 0|1 2019-06-25 00:35:15,884|FF|app-20190625003403-0078|3|4| END| 73.31|6.Candidates indexed | 1.55| 22599|1 2019-06-25 00:35:15,884|FF|app-20190625003403-0078|3|4|START| 73.31|1.Maximal disks found | 0.00| 0|2 2019-06-25 00:35:15,885|MF|app-20190625003403-0078|3|4|START| 73.31|A.Points indexed | 0.00| 0|2 2019-06-25 00:35:15,948|MF|app-20190625003403-0078|3|4| END| 73.38|A.Points indexed | 0.06| 18394|2 2019-06-25 00:35:15,948|MF|app-20190625003403-0078|3|4|START| 73.38|B.Pairs found | 0.00| 0|2 2019-06-25 00:35:16,384|MF|app-20190625003403-0078|3|4| END| 73.81|B.Pairs found | 0.44| 40566|2 2019-06-25 00:35:16,384|MF|app-20190625003403-0078|3|4|START| 73.81|C.Centers found | 0.00| 0|2 2019-06-25 00:35:16,862|MF|app-20190625003403-0078|3|4| END| 74.29|C.Centers found | 0.48| 81132|2 2019-06-25 00:35:16,862|MF|app-20190625003403-0078|3|4|START| 74.29|D.Disks found | 0.00| 0|2 2019-06-25 00:35:19,179|MF|app-20190625003403-0078|3|4| END| 76.61|D.Disks found | 2.32| 36353|2 2019-06-25 00:35:19,179|MF|app-20190625003403-0078|3|4|START| 76.61|E.Disks partitioned | 0.00| 0|2 2019-06-25 00:35:19,937|MF|app-20190625003403-0078|3|4| END| 77.36|E.Disks partitioned | 0.76| 53134|2 2019-06-25 00:35:19,937|MF|app-20190625003403-0078|3|4|START| 77.36|F.Maximal disks found | 0.00| 0|2 2019-06-25 00:35:19,937|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:35:19,937|Cell area: 1055533.7681000116 2019-06-25 00:35:45,209|MF|app-20190625003403-0078|3|4| END|102.64|F.Maximal disks found | 25.27| 10342|2 2019-06-25 00:35:45,209|MAXIMALS|app-20190625003403-0078|4|3|110.0|3|450|29.324|10342 2019-06-25 00:35:45,591|FF|app-20190625003403-0078|3|4| END|103.02|1.Maximal disks found | 29.71| 10342|2 2019-06-25 00:35:45,591|FF|app-20190625003403-0078|3|4|START|103.02|2.Join done | 0.00| 0|2 2019-06-25 00:35:59,044|FF|app-20190625003403-0078|3|4| END|116.47|2.Join done | 13.45| 45000|2 2019-06-25 00:35:59,044|FF|app-20190625003403-0078|3|4|START|116.47|3.Flocks to report | 0.00| 0|2 2019-06-25 00:36:00,948|FF|app-20190625003403-0078|3|4| END|118.38|3.Flocks to report | 1.90| 38432|2 2019-06-25 00:36:00,948|FF|app-20190625003403-0078|3|4|START|118.38|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 00:36:00,992|FF|app-20190625003403-0078|3|4|START|118.42|4a.Making expansions | 0.00| 0|2 2019-06-25 00:36:02,102|FF|app-20190625003403-0078|3|4| END|119.53|4a.Making expansions | 1.11| 48132|2 2019-06-25 00:36:02,103|FF|app-20190625003403-0078|3|4|START|119.53|4b.Finding maximals | 0.00| 0|2 2019-06-25 00:36:45,495|FF|app-20190625003403-0078|3|4| END|162.92|4b.Finding maximals | 43.39| 6601|2 2019-06-25 00:36:45,779|FF|app-20190625003403-0078|3|4| END|163.21|4.Flocks prunned by expansion | 44.83| 6601|2 2019-06-25 00:36:45,779|FF|app-20190625003403-0078|3|4|START|163.21|5.Flocks reported | 0.00| 0|2 2019-06-25 00:36:46,289|FF|app-20190625003403-0078|3|4| END|163.72|5.Flocks reported | 0.51| 6601|2 2019-06-25 00:36:46,289|FF|app-20190625003403-0078|3|4|START|163.72|6.Candidates indexed | 0.00| 0|2 2019-06-25 00:36:49,188|FF|app-20190625003403-0078|3|4| END|166.62|6.Candidates indexed | 2.90| 13819|2 2019-06-25 00:36:49,189|FF|app-20190625003403-0078|3|4|START|166.62|1.Maximal disks found | 0.00| 0|3 2019-06-25 00:36:49,189|MF|app-20190625003403-0078|3|4|START|166.62|A.Points indexed | 0.00| 0|3 2019-06-25 00:36:49,244|MF|app-20190625003403-0078|3|4| END|166.67|A.Points indexed | 0.06| 18548|3 2019-06-25 00:36:49,244|MF|app-20190625003403-0078|3|4|START|166.67|B.Pairs found | 0.00| 0|3 2019-06-25 00:36:49,811|MF|app-20190625003403-0078|3|4| END|167.24|B.Pairs found | 0.57| 41257|3 2019-06-25 00:36:49,811|MF|app-20190625003403-0078|3|4|START|167.24|C.Centers found | 0.00| 0|3 2019-06-25 00:36:50,434|MF|app-20190625003403-0078|3|4| END|167.86|C.Centers found | 0.62| 82514|3 2019-06-25 00:36:50,434|MF|app-20190625003403-0078|3|4|START|167.86|D.Disks found | 0.00| 0|3 2019-06-25 00:36:53,750|MF|app-20190625003403-0078|3|4| END|171.18|D.Disks found | 3.32| 37087|3 2019-06-25 00:36:53,751|MF|app-20190625003403-0078|3|4|START|171.18|E.Disks partitioned | 0.00| 0|3 2019-06-25 00:36:54,745|MF|app-20190625003403-0078|3|4| END|172.17|E.Disks partitioned | 0.99| 54196|3 2019-06-25 00:36:54,745|MF|app-20190625003403-0078|3|4|START|172.17|F.Maximal disks found | 0.00| 0|3 2019-06-25 00:36:54,745|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:36:54,745|Cell area: 1055533.7681000116 2019-06-25 00:37:27,258|MF|app-20190625003403-0078|3|4| END|204.69|F.Maximal disks found | 32.51| 10503|3 2019-06-25 00:37:27,258|MAXIMALS|app-20190625003403-0078|4|3|110.0|3|450|38.069|10503 2019-06-25 00:37:27,705|FF|app-20190625003403-0078|3|4| END|205.13|1.Maximal disks found | 38.52| 10503|3 2019-06-25 00:37:27,705|FF|app-20190625003403-0078|3|4|START|205.13|2.Join done | 0.00| 0|3 2019-06-25 00:37:37,496|FF|app-20190625003403-0078|3|4| END|214.92|2.Join done | 9.79| 45190|3 2019-06-25 00:37:37,496|FF|app-20190625003403-0078|3|4|START|214.92|3.Flocks to report | 0.00| 0|3 2019-06-25 00:37:39,622|FF|app-20190625003403-0078|3|4| END|217.05|3.Flocks to report | 2.13| 38589|3 2019-06-25 00:37:39,622|FF|app-20190625003403-0078|3|4|START|217.05|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 00:37:39,663|FF|app-20190625003403-0078|3|4|START|217.09|4a.Making expansions | 0.00| 0|3 2019-06-25 00:37:40,865|FF|app-20190625003403-0078|3|4| END|218.29|4a.Making expansions | 1.20| 47925|3 2019-06-25 00:37:40,865|FF|app-20190625003403-0078|3|4|START|218.29|4b.Finding maximals | 0.00| 0|3 2019-06-25 00:38:47,956|FF|app-20190625003403-0078|3|4| END|285.38|4b.Finding maximals | 67.09| 6669|3 2019-06-25 00:38:48,262|FF|app-20190625003403-0078|3|4| END|285.69|4.Flocks prunned by expansion | 68.64| 6669|3 2019-06-25 00:38:48,262|FF|app-20190625003403-0078|3|4|START|285.69|5.Flocks reported | 0.00| 0|3 2019-06-25 00:38:48,775|FF|app-20190625003403-0078|3|4| END|286.20|5.Flocks reported | 0.51| 6669|3 2019-06-25 00:38:48,775|FF|app-20190625003403-0078|3|4|START|286.20|6.Candidates indexed | 0.00| 0|3 2019-06-25 00:38:51,026|FF|app-20190625003403-0078|3|4| END|288.45|6.Candidates indexed | 2.25| 13927|3 2019-06-25 00:38:51,770|Number of flocks: 13270 2019-06-25 00:38:52,192|PFLOCK|app-20190625003403-0078|4|3|110.0|3|3|283.03|13270 2019-06-25 00:38:52,551|FF|app-20190625003403-0078|3|4| END|289.98|Flock Finder run |283.81| 13270|3 2019-06-25 00:38:52,551|FF|app-20190625003403-0078|3|4|START|289.98|Session closed | 0.00| 0|3 2019-06-25 00:38:58,821|FF|app-20190625003403-0078|3|4| END|296.25|Session closed | 6.27| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B4_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_grid-60x30.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 12 --fftimestamp 4 --portui 4040 --info 2019-06-25 00:39:00,814|FF|app-00000000000000-0000|12|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 00:39:01,929|FF|app-20190625003901-0079|12|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 00:39:01,930|FF|app-20190625003901-0079|12|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 00:39:04,933|FF|app-20190625003901-0079|12|4|START| 4.10|KDBTree partitioner | 0.00| 0|-1 2019-06-25 00:39:06,269|Sample size: 441504 2019-06-25 00:39:06,604|FF|app-20190625003901-0079|12|4| END| 5.77|KDBTree partitioner | 1.67| 1138|-1 2019-06-25 00:39:06,604|FF|app-20190625003901-0079|12|4|START| 5.77|MF partitioner | 0.00| 0|-1 2019-06-25 00:39:06,680|FF|app-20190625003901-0079|12|4| END| 5.85|MF partitioner | 0.08| 1800|-1 2019-06-25 00:39:08,408|FF|app-20190625003901-0079|12|4| END| 7.58|MF partitioner | 1.80|441504|-1 2019-06-25 00:39:08,408|FF|app-20190625003901-0079|12|4|START| 7.58|Flock Finder run | 0.00| 0|-1 2019-06-25 00:39:08,425|FF|app-20190625003901-0079|12|4|START| 7.60|1.Maximal disks found | 0.00| 0|0 2019-06-25 00:39:08,427|MF|app-20190625003901-0079|12|4|START| 7.60|A.Points indexed | 0.00| 0|0 2019-06-25 00:39:08,824|MF|app-20190625003901-0079|12|4| END| 7.99|A.Points indexed | 0.40| 72372|0 2019-06-25 00:39:08,824|MF|app-20190625003901-0079|12|4|START| 7.99|B.Pairs found | 0.00| 0|0 2019-06-25 00:39:10,683|MF|app-20190625003901-0079|12|4| END| 9.85|B.Pairs found | 1.86|135828|0 2019-06-25 00:39:10,683|MF|app-20190625003901-0079|12|4|START| 9.85|C.Centers found | 0.00| 0|0 2019-06-25 00:39:11,804|MF|app-20190625003901-0079|12|4| END| 10.97|C.Centers found | 1.12|271656|0 2019-06-25 00:39:11,804|MF|app-20190625003901-0079|12|4|START| 10.97|D.Disks found | 0.00| 0|0 2019-06-25 00:39:16,467|MF|app-20190625003901-0079|12|4| END| 15.64|D.Disks found | 4.66|114664|0 2019-06-25 00:39:16,467|MF|app-20190625003901-0079|12|4|START| 15.64|E.Disks partitioned | 0.00| 0|0 2019-06-25 00:39:18,040|MF|app-20190625003901-0079|12|4| END| 17.21|E.Disks partitioned | 1.57|162379|0 2019-06-25 00:39:18,040|MF|app-20190625003901-0079|12|4|START| 17.21|F.Maximal disks found | 0.00| 0|0 2019-06-25 00:39:18,042|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:39:18,042|Cell area: 1055533.7681000116 2019-06-25 00:39:28,716|MF|app-20190625003901-0079|12|4| END| 27.89|F.Maximal disks found | 10.68| 33494|0 2019-06-25 00:39:28,716|MAXIMALS|app-20190625003901-0079|4|12|100.0|3|1800|20.289|33494 2019-06-25 00:39:30,118|FF|app-20190625003901-0079|12|4| END| 29.29|1.Maximal disks found | 21.69| 33494|0 2019-06-25 00:39:30,118|FF|app-20190625003901-0079|12|4|START| 29.29|1.Maximal disks found | 0.00| 0|1 2019-06-25 00:39:30,118|MF|app-20190625003901-0079|12|4|START| 29.29|A.Points indexed | 0.00| 0|1 2019-06-25 00:39:30,252|MF|app-20190625003901-0079|12|4| END| 29.42|A.Points indexed | 0.13| 72980|1 2019-06-25 00:39:30,252|MF|app-20190625003901-0079|12|4|START| 29.42|B.Pairs found | 0.00| 0|1 2019-06-25 00:39:31,115|MF|app-20190625003901-0079|12|4| END| 30.29|B.Pairs found | 0.86|137848|1 2019-06-25 00:39:31,115|MF|app-20190625003901-0079|12|4|START| 30.29|C.Centers found | 0.00| 0|1 2019-06-25 00:39:31,918|MF|app-20190625003901-0079|12|4| END| 31.09|C.Centers found | 0.80|275696|1 2019-06-25 00:39:31,918|MF|app-20190625003901-0079|12|4|START| 31.09|D.Disks found | 0.00| 0|1 2019-06-25 00:39:35,422|MF|app-20190625003901-0079|12|4| END| 34.59|D.Disks found | 3.50|116464|1 2019-06-25 00:39:35,422|MF|app-20190625003901-0079|12|4|START| 34.59|E.Disks partitioned | 0.00| 0|1 2019-06-25 00:39:36,568|MF|app-20190625003901-0079|12|4| END| 35.74|E.Disks partitioned | 1.15|164834|1 2019-06-25 00:39:36,568|MF|app-20190625003901-0079|12|4|START| 35.74|F.Maximal disks found | 0.00| 0|1 2019-06-25 00:39:36,569|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:39:36,569|Cell area: 1055533.7681000116 2019-06-25 00:39:46,449|MF|app-20190625003901-0079|12|4| END| 45.62|F.Maximal disks found | 9.88| 34190|1 2019-06-25 00:39:46,450|MAXIMALS|app-20190625003901-0079|4|12|100.0|3|1800|16.331|34190 2019-06-25 00:39:47,831|FF|app-20190625003901-0079|12|4| END| 47.00|1.Maximal disks found | 17.71| 34190|1 2019-06-25 00:39:47,831|FF|app-20190625003901-0079|12|4|START| 47.00|2.Join done | 0.00| 0|1 2019-06-25 00:39:51,521|FF|app-20190625003901-0079|12|4| END| 50.69|2.Join done | 3.69| 68607|1 2019-06-25 00:39:51,522|FF|app-20190625003901-0079|12|4|START| 50.69|3.Flocks to report | 0.00| 0|1 2019-06-25 00:39:52,060|FF|app-20190625003901-0079|12|4| END| 51.23|3.Flocks to report | 0.54| 0|1 2019-06-25 00:39:52,060|FF|app-20190625003901-0079|12|4|START| 51.23|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 00:39:52,117|FF|app-20190625003901-0079|12|4| END| 51.29|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 00:39:52,117|FF|app-20190625003901-0079|12|4|START| 51.29|5.Flocks reported | 0.00| 0|1 2019-06-25 00:39:52,123|FF|app-20190625003901-0079|12|4| END| 51.29|5.Flocks reported | 0.01| 0|1 2019-06-25 00:39:52,123|FF|app-20190625003901-0079|12|4|START| 51.29|6.Candidates indexed | 0.00| 0|1 2019-06-25 00:39:54,127|FF|app-20190625003901-0079|12|4| END| 53.30|6.Candidates indexed | 2.00| 70591|1 2019-06-25 00:39:54,127|FF|app-20190625003901-0079|12|4|START| 53.30|1.Maximal disks found | 0.00| 0|2 2019-06-25 00:39:54,127|MF|app-20190625003901-0079|12|4|START| 53.30|A.Points indexed | 0.00| 0|2 2019-06-25 00:39:54,252|MF|app-20190625003901-0079|12|4| END| 53.42|A.Points indexed | 0.12| 73576|2 2019-06-25 00:39:54,252|MF|app-20190625003901-0079|12|4|START| 53.42|B.Pairs found | 0.00| 0|2 2019-06-25 00:39:54,987|MF|app-20190625003901-0079|12|4| END| 54.16|B.Pairs found | 0.74|139672|2 2019-06-25 00:39:54,987|MF|app-20190625003901-0079|12|4|START| 54.16|C.Centers found | 0.00| 0|2 2019-06-25 00:39:55,832|MF|app-20190625003901-0079|12|4| END| 55.00|C.Centers found | 0.84|279344|2 2019-06-25 00:39:55,832|MF|app-20190625003901-0079|12|4|START| 55.00|D.Disks found | 0.00| 0|2 2019-06-25 00:39:59,277|MF|app-20190625003901-0079|12|4| END| 58.45|D.Disks found | 3.45|118196|2 2019-06-25 00:39:59,277|MF|app-20190625003901-0079|12|4|START| 58.45|E.Disks partitioned | 0.00| 0|2 2019-06-25 00:40:00,446|MF|app-20190625003901-0079|12|4| END| 59.62|E.Disks partitioned | 1.17|167618|2 2019-06-25 00:40:00,447|MF|app-20190625003901-0079|12|4|START| 59.62|F.Maximal disks found | 0.00| 0|2 2019-06-25 00:40:00,448|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:40:00,448|Cell area: 1055533.7681000116 2019-06-25 00:40:11,164|MF|app-20190625003901-0079|12|4| END| 70.33|F.Maximal disks found | 10.72| 34747|2 2019-06-25 00:40:11,164|MAXIMALS|app-20190625003901-0079|4|12|100.0|3|1800|17.037|34747 2019-06-25 00:40:12,553|FF|app-20190625003901-0079|12|4| END| 71.72|1.Maximal disks found | 18.43| 34747|2 2019-06-25 00:40:12,553|FF|app-20190625003901-0079|12|4|START| 71.72|2.Join done | 0.00| 0|2 2019-06-25 00:40:18,942|FF|app-20190625003901-0079|12|4| END| 78.11|2.Join done | 6.39|130927|2 2019-06-25 00:40:18,942|FF|app-20190625003901-0079|12|4|START| 78.11|3.Flocks to report | 0.00| 0|2 2019-06-25 00:40:19,751|FF|app-20190625003901-0079|12|4| END| 78.92|3.Flocks to report | 0.81|111724|2 2019-06-25 00:40:19,751|FF|app-20190625003901-0079|12|4|START| 78.92|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 00:40:19,810|FF|app-20190625003901-0079|12|4|START| 78.98|4a.Making expansions | 0.00| 0|2 2019-06-25 00:40:21,014|FF|app-20190625003901-0079|12|4| END| 80.18|4a.Making expansions | 1.20|138955|2 2019-06-25 00:40:21,014|FF|app-20190625003901-0079|12|4|START| 80.18|4b.Finding maximals | 0.00| 0|2 2019-06-25 00:40:36,219|FF|app-20190625003901-0079|12|4| END| 95.39|4b.Finding maximals | 15.21| 22788|2 2019-06-25 00:40:36,810|FF|app-20190625003901-0079|12|4| END| 95.98|4.Flocks prunned by expansion | 17.06| 22788|2 2019-06-25 00:40:36,810|FF|app-20190625003901-0079|12|4|START| 95.98|5.Flocks reported | 0.00| 0|2 2019-06-25 00:40:37,560|FF|app-20190625003901-0079|12|4| END| 96.73|5.Flocks reported | 0.75| 22788|2 2019-06-25 00:40:37,560|FF|app-20190625003901-0079|12|4|START| 96.73|6.Candidates indexed | 0.00| 0|2 2019-06-25 00:40:39,772|FF|app-20190625003901-0079|12|4| END| 98.94|6.Candidates indexed | 2.21| 44305|2 2019-06-25 00:40:39,772|FF|app-20190625003901-0079|12|4|START| 98.94|1.Maximal disks found | 0.00| 0|3 2019-06-25 00:40:39,773|MF|app-20190625003901-0079|12|4|START| 98.94|A.Points indexed | 0.00| 0|3 2019-06-25 00:40:39,895|MF|app-20190625003901-0079|12|4| END| 99.07|A.Points indexed | 0.12| 74192|3 2019-06-25 00:40:39,895|MF|app-20190625003901-0079|12|4|START| 99.07|B.Pairs found | 0.00| 0|3 2019-06-25 00:40:40,600|MF|app-20190625003901-0079|12|4| END| 99.77|B.Pairs found | 0.71|142060|3 2019-06-25 00:40:40,601|MF|app-20190625003901-0079|12|4|START| 99.77|C.Centers found | 0.00| 0|3 2019-06-25 00:40:41,471|MF|app-20190625003901-0079|12|4| END|100.64|C.Centers found | 0.87|284120|3 2019-06-25 00:40:41,471|MF|app-20190625003901-0079|12|4|START|100.64|D.Disks found | 0.00| 0|3 2019-06-25 00:40:44,711|MF|app-20190625003901-0079|12|4| END|103.88|D.Disks found | 3.24|120568|3 2019-06-25 00:40:44,711|MF|app-20190625003901-0079|12|4|START|103.88|E.Disks partitioned | 0.00| 0|3 2019-06-25 00:40:46,231|MF|app-20190625003901-0079|12|4| END|105.40|E.Disks partitioned | 1.52|171019|3 2019-06-25 00:40:46,231|MF|app-20190625003901-0079|12|4|START|105.40|F.Maximal disks found | 0.00| 0|3 2019-06-25 00:40:46,232|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:40:46,232|Cell area: 1055533.7681000116 2019-06-25 00:40:58,792|MF|app-20190625003901-0079|12|4| END|117.96|F.Maximal disks found | 12.56| 35397|3 2019-06-25 00:40:58,792|MAXIMALS|app-20190625003901-0079|4|12|100.0|3|1800|19.02|35397 2019-06-25 00:41:00,131|FF|app-20190625003901-0079|12|4| END|119.30|1.Maximal disks found | 20.36| 35397|3 2019-06-25 00:41:00,131|FF|app-20190625003901-0079|12|4|START|119.30|2.Join done | 0.00| 0|3 2019-06-25 00:41:04,950|FF|app-20190625003901-0079|12|4| END|124.12|2.Join done | 4.82|120803|3 2019-06-25 00:41:04,950|FF|app-20190625003901-0079|12|4|START|124.12|3.Flocks to report | 0.00| 0|3 2019-06-25 00:41:05,709|FF|app-20190625003901-0079|12|4| END|124.88|3.Flocks to report | 0.76|101399|3 2019-06-25 00:41:05,709|FF|app-20190625003901-0079|12|4|START|124.88|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 00:41:05,770|FF|app-20190625003901-0079|12|4|START|124.94|4a.Making expansions | 0.00| 0|3 2019-06-25 00:41:06,785|FF|app-20190625003901-0079|12|4| END|125.96|4a.Making expansions | 1.02|129191|3 2019-06-25 00:41:06,786|FF|app-20190625003901-0079|12|4|START|125.96|4b.Finding maximals | 0.00| 0|3 2019-06-25 00:41:18,412|FF|app-20190625003901-0079|12|4| END|137.58|4b.Finding maximals | 11.63| 23068|3 2019-06-25 00:41:19,016|FF|app-20190625003901-0079|12|4| END|138.19|4.Flocks prunned by expansion | 13.31| 23068|3 2019-06-25 00:41:19,016|FF|app-20190625003901-0079|12|4|START|138.19|5.Flocks reported | 0.00| 0|3 2019-06-25 00:41:19,839|FF|app-20190625003901-0079|12|4| END|139.01|5.Flocks reported | 0.82| 23068|3 2019-06-25 00:41:19,839|FF|app-20190625003901-0079|12|4|START|139.01|6.Candidates indexed | 0.00| 0|3 2019-06-25 00:41:22,067|FF|app-20190625003901-0079|12|4| END|141.24|6.Candidates indexed | 2.23| 44638|3 2019-06-25 00:41:23,875|Number of flocks: 45856 2019-06-25 00:41:25,121|PFLOCK|app-20190625003901-0079|4|12|100.0|3|3|135.47|45856 2019-06-25 00:41:26,370|FF|app-20190625003901-0079|12|4| END|145.54|Flock Finder run |137.96| 45856|3 2019-06-25 00:41:26,370|FF|app-20190625003901-0079|12|4|START|145.54|Session closed | 0.00| 0|3 2019-06-25 00:41:36,452|FF|app-20190625003901-0079|12|4| END|155.62|Session closed | 10.08| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 6 --fftimestamp 4 --portui 4040 --info 2019-06-25 00:41:38,642|FF|app-00000000000000-0000|6|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 00:41:39,779|FF|app-20190625004139-0080|6|4| END| 1.12|Session start | 1.14| 0|-1 2019-06-25 00:41:39,779|FF|app-20190625004139-0080|6|4|START| 1.12|Data read | 0.00| 0|-1 2019-06-25 00:41:42,736|FF|app-20190625004139-0080|6|4|START| 4.08|KDBTree partitioner | 0.00| 0|-1 2019-06-25 00:41:43,713|Sample size: 220752 2019-06-25 00:41:43,861|FF|app-20190625004139-0080|6|4| END| 5.20|KDBTree partitioner | 1.13| 555|-1 2019-06-25 00:41:43,862|FF|app-20190625004139-0080|6|4|START| 5.20|MF partitioner | 0.00| 0|-1 2019-06-25 00:41:43,913|FF|app-20190625004139-0080|6|4| END| 5.25|MF partitioner | 0.05| 900|-1 2019-06-25 00:41:45,737|FF|app-20190625004139-0080|6|4| END| 7.08|MF partitioner | 1.88|220752|-1 2019-06-25 00:41:45,738|FF|app-20190625004139-0080|6|4|START| 7.08|Flock Finder run | 0.00| 0|-1 2019-06-25 00:41:45,754|FF|app-20190625004139-0080|6|4|START| 7.10|1.Maximal disks found | 0.00| 0|0 2019-06-25 00:41:45,756|MF|app-20190625004139-0080|6|4|START| 7.10|A.Points indexed | 0.00| 0|0 2019-06-25 00:41:45,923|MF|app-20190625004139-0080|6|4| END| 7.26|A.Points indexed | 0.17| 36186|0 2019-06-25 00:41:45,923|MF|app-20190625004139-0080|6|4|START| 7.26|B.Pairs found | 0.00| 0|0 2019-06-25 00:41:47,410|MF|app-20190625004139-0080|6|4| END| 8.75|B.Pairs found | 1.49| 67914|0 2019-06-25 00:41:47,410|MF|app-20190625004139-0080|6|4|START| 8.75|C.Centers found | 0.00| 0|0 2019-06-25 00:41:48,396|MF|app-20190625004139-0080|6|4| END| 9.74|C.Centers found | 0.99|135828|0 2019-06-25 00:41:48,396|MF|app-20190625004139-0080|6|4|START| 9.74|D.Disks found | 0.00| 0|0 2019-06-25 00:41:53,823|MF|app-20190625004139-0080|6|4| END| 15.16|D.Disks found | 5.43| 57332|0 2019-06-25 00:41:53,823|MF|app-20190625004139-0080|6|4|START| 15.16|E.Disks partitioned | 0.00| 0|0 2019-06-25 00:41:57,400|MF|app-20190625004139-0080|6|4| END| 18.74|E.Disks partitioned | 3.58| 81114|0 2019-06-25 00:41:57,400|MF|app-20190625004139-0080|6|4|START| 18.74|F.Maximal disks found | 0.00| 0|0 2019-06-25 00:41:57,402|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:41:57,402|Cell area: 1055533.7681000116 2019-06-25 00:42:10,142|MF|app-20190625004139-0080|6|4| END| 31.48|F.Maximal disks found | 12.74| 16742|0 2019-06-25 00:42:10,142|MAXIMALS|app-20190625004139-0080|4|6|100.0|3|900|24.386|16742 2019-06-25 00:42:11,752|FF|app-20190625004139-0080|6|4| END| 33.09|1.Maximal disks found | 26.00| 16742|0 2019-06-25 00:42:11,752|FF|app-20190625004139-0080|6|4|START| 33.09|1.Maximal disks found | 0.00| 0|1 2019-06-25 00:42:11,752|MF|app-20190625004139-0080|6|4|START| 33.09|A.Points indexed | 0.00| 0|1 2019-06-25 00:42:11,846|MF|app-20190625004139-0080|6|4| END| 33.19|A.Points indexed | 0.09| 36490|1 2019-06-25 00:42:11,846|MF|app-20190625004139-0080|6|4|START| 33.19|B.Pairs found | 0.00| 0|1 2019-06-25 00:42:13,003|MF|app-20190625004139-0080|6|4| END| 34.34|B.Pairs found | 1.16| 68924|1 2019-06-25 00:42:13,003|MF|app-20190625004139-0080|6|4|START| 34.34|C.Centers found | 0.00| 0|1 2019-06-25 00:42:14,105|MF|app-20190625004139-0080|6|4| END| 35.45|C.Centers found | 1.10|137848|1 2019-06-25 00:42:14,105|MF|app-20190625004139-0080|6|4|START| 35.45|D.Disks found | 0.00| 0|1 2019-06-25 00:42:19,157|MF|app-20190625004139-0080|6|4| END| 40.50|D.Disks found | 5.05| 58232|1 2019-06-25 00:42:19,157|MF|app-20190625004139-0080|6|4|START| 40.50|E.Disks partitioned | 0.00| 0|1 2019-06-25 00:42:21,182|MF|app-20190625004139-0080|6|4| END| 42.52|E.Disks partitioned | 2.03| 82341|1 2019-06-25 00:42:21,182|MF|app-20190625004139-0080|6|4|START| 42.52|F.Maximal disks found | 0.00| 0|1 2019-06-25 00:42:21,183|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:42:21,183|Cell area: 1055533.7681000116 2019-06-25 00:42:31,418|MF|app-20190625004139-0080|6|4| END| 52.76|F.Maximal disks found | 10.24| 17096|1 2019-06-25 00:42:31,418|MAXIMALS|app-20190625004139-0080|4|6|100.0|3|900|19.666|17096 2019-06-25 00:42:32,346|FF|app-20190625004139-0080|6|4| END| 53.69|1.Maximal disks found | 20.59| 17096|1 2019-06-25 00:42:32,346|FF|app-20190625004139-0080|6|4|START| 53.69|2.Join done | 0.00| 0|1 2019-06-25 00:42:37,760|FF|app-20190625004139-0080|6|4| END| 59.10|2.Join done | 5.41| 34283|1 2019-06-25 00:42:37,761|FF|app-20190625004139-0080|6|4|START| 59.10|3.Flocks to report | 0.00| 0|1 2019-06-25 00:42:38,614|FF|app-20190625004139-0080|6|4| END| 59.96|3.Flocks to report | 0.85| 0|1 2019-06-25 00:42:38,614|FF|app-20190625004139-0080|6|4|START| 59.96|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 00:42:38,657|FF|app-20190625004139-0080|6|4| END| 60.00|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 00:42:38,657|FF|app-20190625004139-0080|6|4|START| 60.00|5.Flocks reported | 0.00| 0|1 2019-06-25 00:42:38,663|FF|app-20190625004139-0080|6|4| END| 60.00|5.Flocks reported | 0.01| 0|1 2019-06-25 00:42:38,663|FF|app-20190625004139-0080|6|4|START| 60.00|6.Candidates indexed | 0.00| 0|1 2019-06-25 00:42:42,108|FF|app-20190625004139-0080|6|4| END| 63.45|6.Candidates indexed | 3.45| 35275|1 2019-06-25 00:42:42,108|FF|app-20190625004139-0080|6|4|START| 63.45|1.Maximal disks found | 0.00| 0|2 2019-06-25 00:42:42,108|MF|app-20190625004139-0080|6|4|START| 63.45|A.Points indexed | 0.00| 0|2 2019-06-25 00:42:42,195|MF|app-20190625004139-0080|6|4| END| 63.54|A.Points indexed | 0.09| 36788|2 2019-06-25 00:42:42,195|MF|app-20190625004139-0080|6|4|START| 63.54|B.Pairs found | 0.00| 0|2 2019-06-25 00:42:43,272|MF|app-20190625004139-0080|6|4| END| 64.61|B.Pairs found | 1.08| 69836|2 2019-06-25 00:42:43,272|MF|app-20190625004139-0080|6|4|START| 64.61|C.Centers found | 0.00| 0|2 2019-06-25 00:42:44,107|MF|app-20190625004139-0080|6|4| END| 65.45|C.Centers found | 0.84|139672|2 2019-06-25 00:42:44,107|MF|app-20190625004139-0080|6|4|START| 65.45|D.Disks found | 0.00| 0|2 2019-06-25 00:42:49,234|MF|app-20190625004139-0080|6|4| END| 70.58|D.Disks found | 5.13| 59098|2 2019-06-25 00:42:49,234|MF|app-20190625004139-0080|6|4|START| 70.58|E.Disks partitioned | 0.00| 0|2 2019-06-25 00:42:51,283|MF|app-20190625004139-0080|6|4| END| 72.62|E.Disks partitioned | 2.05| 83724|2 2019-06-25 00:42:51,284|MF|app-20190625004139-0080|6|4|START| 72.63|F.Maximal disks found | 0.00| 0|2 2019-06-25 00:42:51,284|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:42:51,284|Cell area: 1055533.7681000116 2019-06-25 00:43:02,233|MF|app-20190625004139-0080|6|4| END| 83.57|F.Maximal disks found | 10.95| 17376|2 2019-06-25 00:43:02,233|MAXIMALS|app-20190625004139-0080|4|6|100.0|3|900|20.125|17376 2019-06-25 00:43:03,140|FF|app-20190625004139-0080|6|4| END| 84.48|1.Maximal disks found | 21.03| 17376|2 2019-06-25 00:43:03,140|FF|app-20190625004139-0080|6|4|START| 84.48|2.Join done | 0.00| 0|2 2019-06-25 00:43:14,047|FF|app-20190625004139-0080|6|4| END| 95.39|2.Join done | 10.91| 65346|2 2019-06-25 00:43:14,047|FF|app-20190625004139-0080|6|4|START| 95.39|3.Flocks to report | 0.00| 0|2 2019-06-25 00:43:15,674|FF|app-20190625004139-0080|6|4| END| 97.02|3.Flocks to report | 1.63| 55749|2 2019-06-25 00:43:15,674|FF|app-20190625004139-0080|6|4|START| 97.02|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 00:43:15,720|FF|app-20190625004139-0080|6|4|START| 97.06|4a.Making expansions | 0.00| 0|2 2019-06-25 00:43:16,997|FF|app-20190625004139-0080|6|4| END| 98.34|4a.Making expansions | 1.28| 69308|2 2019-06-25 00:43:16,998|FF|app-20190625004139-0080|6|4|START| 98.34|4b.Finding maximals | 0.00| 0|2 2019-06-25 00:43:30,631|FF|app-20190625004139-0080|6|4| END|111.97|4b.Finding maximals | 13.63| 11394|2 2019-06-25 00:43:31,013|FF|app-20190625004139-0080|6|4| END|112.35|4.Flocks prunned by expansion | 15.34| 11394|2 2019-06-25 00:43:31,013|FF|app-20190625004139-0080|6|4|START|112.35|5.Flocks reported | 0.00| 0|2 2019-06-25 00:43:31,594|FF|app-20190625004139-0080|6|4| END|112.94|5.Flocks reported | 0.58| 11394|2 2019-06-25 00:43:31,594|FF|app-20190625004139-0080|6|4|START|112.94|6.Candidates indexed | 0.00| 0|2 2019-06-25 00:43:34,153|FF|app-20190625004139-0080|6|4| END|115.49|6.Candidates indexed | 2.56| 22156|2 2019-06-25 00:43:34,153|FF|app-20190625004139-0080|6|4|START|115.49|1.Maximal disks found | 0.00| 0|3 2019-06-25 00:43:34,153|MF|app-20190625004139-0080|6|4|START|115.49|A.Points indexed | 0.00| 0|3 2019-06-25 00:43:34,238|MF|app-20190625004139-0080|6|4| END|115.58|A.Points indexed | 0.09| 37096|3 2019-06-25 00:43:34,238|MF|app-20190625004139-0080|6|4|START|115.58|B.Pairs found | 0.00| 0|3 2019-06-25 00:43:35,022|MF|app-20190625004139-0080|6|4| END|116.36|B.Pairs found | 0.78| 71030|3 2019-06-25 00:43:35,022|MF|app-20190625004139-0080|6|4|START|116.36|C.Centers found | 0.00| 0|3 2019-06-25 00:43:35,905|MF|app-20190625004139-0080|6|4| END|117.25|C.Centers found | 0.88|142060|3 2019-06-25 00:43:35,905|MF|app-20190625004139-0080|6|4|START|117.25|D.Disks found | 0.00| 0|3 2019-06-25 00:43:40,272|MF|app-20190625004139-0080|6|4| END|121.61|D.Disks found | 4.37| 60284|3 2019-06-25 00:43:40,272|MF|app-20190625004139-0080|6|4|START|121.61|E.Disks partitioned | 0.00| 0|3 2019-06-25 00:43:42,074|MF|app-20190625004139-0080|6|4| END|123.42|E.Disks partitioned | 1.80| 85409|3 2019-06-25 00:43:42,074|MF|app-20190625004139-0080|6|4|START|123.42|F.Maximal disks found | 0.00| 0|3 2019-06-25 00:43:42,075|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:43:42,075|Cell area: 1055533.7681000116 2019-06-25 00:43:55,189|MF|app-20190625004139-0080|6|4| END|136.53|F.Maximal disks found | 13.12| 17693|3 2019-06-25 00:43:55,189|MAXIMALS|app-20190625004139-0080|4|6|100.0|3|900|21.036|17693 2019-06-25 00:43:56,070|FF|app-20190625004139-0080|6|4| END|137.41|1.Maximal disks found | 21.92| 17693|3 2019-06-25 00:43:56,070|FF|app-20190625004139-0080|6|4|START|137.41|2.Join done | 0.00| 0|3 2019-06-25 00:44:03,242|FF|app-20190625004139-0080|6|4| END|144.58|2.Join done | 7.17| 60351|3 2019-06-25 00:44:03,242|FF|app-20190625004139-0080|6|4|START|144.58|3.Flocks to report | 0.00| 0|3 2019-06-25 00:44:04,746|FF|app-20190625004139-0080|6|4| END|146.09|3.Flocks to report | 1.50| 50615|3 2019-06-25 00:44:04,746|FF|app-20190625004139-0080|6|4|START|146.09|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 00:44:04,791|FF|app-20190625004139-0080|6|4|START|146.13|4a.Making expansions | 0.00| 0|3 2019-06-25 00:44:06,048|FF|app-20190625004139-0080|6|4| END|147.39|4a.Making expansions | 1.26| 64379|3 2019-06-25 00:44:06,048|FF|app-20190625004139-0080|6|4|START|147.39|4b.Finding maximals | 0.00| 0|3 2019-06-25 00:44:16,145|FF|app-20190625004139-0080|6|4| END|157.49|4b.Finding maximals | 10.10| 11534|3 2019-06-25 00:44:16,544|FF|app-20190625004139-0080|6|4| END|157.89|4.Flocks prunned by expansion | 11.80| 11534|3 2019-06-25 00:44:16,544|FF|app-20190625004139-0080|6|4|START|157.89|5.Flocks reported | 0.00| 0|3 2019-06-25 00:44:17,161|FF|app-20190625004139-0080|6|4| END|158.50|5.Flocks reported | 0.62| 11534|3 2019-06-25 00:44:17,161|FF|app-20190625004139-0080|6|4|START|158.50|6.Candidates indexed | 0.00| 0|3 2019-06-25 00:44:19,553|FF|app-20190625004139-0080|6|4| END|160.89|6.Candidates indexed | 2.39| 22352|3 2019-06-25 00:44:20,550|Number of flocks: 22928 2019-06-25 00:44:21,217|PFLOCK|app-20190625004139-0080|4|6|100.0|3|3|154.81|22928 2019-06-25 00:44:21,852|FF|app-20190625004139-0080|6|4| END|163.19|Flock Finder run |156.11| 22928|3 2019-06-25 00:44:21,852|FF|app-20190625004139-0080|6|4|START|163.19|Session closed | 0.00| 0|3 2019-06-25 00:44:28,329|FF|app-20190625004139-0080|6|4| END|169.67|Session closed | 6.48| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 3 --fftimestamp 4 --portui 4040 --info 2019-06-25 00:44:30,304|FF|app-00000000000000-0000|3|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 00:44:31,412|FF|app-20190625004431-0081|3|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 00:44:31,413|FF|app-20190625004431-0081|3|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 00:44:34,262|FF|app-20190625004431-0081|3|4|START| 3.94|KDBTree partitioner | 0.00| 0|-1 2019-06-25 00:44:34,907|Sample size: 110376 2019-06-25 00:44:34,981|FF|app-20190625004431-0081|3|4| END| 4.66|KDBTree partitioner | 0.72| 277|-1 2019-06-25 00:44:34,981|FF|app-20190625004431-0081|3|4|START| 4.66|MF partitioner | 0.00| 0|-1 2019-06-25 00:44:35,005|FF|app-20190625004431-0081|3|4| END| 4.68|MF partitioner | 0.02| 450|-1 2019-06-25 00:44:36,442|FF|app-20190625004431-0081|3|4| END| 6.12|MF partitioner | 1.46|110376|-1 2019-06-25 00:44:36,443|FF|app-20190625004431-0081|3|4|START| 6.12|Flock Finder run | 0.00| 0|-1 2019-06-25 00:44:36,603|FF|app-20190625004431-0081|3|4|START| 6.28|1.Maximal disks found | 0.00| 0|0 2019-06-25 00:44:36,607|MF|app-20190625004431-0081|3|4|START| 6.29|A.Points indexed | 0.00| 0|0 2019-06-25 00:44:36,753|MF|app-20190625004431-0081|3|4| END| 6.43|A.Points indexed | 0.15| 18093|0 2019-06-25 00:44:36,753|MF|app-20190625004431-0081|3|4|START| 6.43|B.Pairs found | 0.00| 0|0 2019-06-25 00:44:37,960|MF|app-20190625004431-0081|3|4| END| 7.64|B.Pairs found | 1.21| 33957|0 2019-06-25 00:44:37,960|MF|app-20190625004431-0081|3|4|START| 7.64|C.Centers found | 0.00| 0|0 2019-06-25 00:44:38,895|MF|app-20190625004431-0081|3|4| END| 8.57|C.Centers found | 0.94| 67914|0 2019-06-25 00:44:38,895|MF|app-20190625004431-0081|3|4|START| 8.57|D.Disks found | 0.00| 0|0 2019-06-25 00:44:42,023|MF|app-20190625004431-0081|3|4| END| 11.70|D.Disks found | 3.13| 28666|0 2019-06-25 00:44:42,024|MF|app-20190625004431-0081|3|4|START| 11.70|E.Disks partitioned | 0.00| 0|0 2019-06-25 00:44:43,037|MF|app-20190625004431-0081|3|4| END| 12.72|E.Disks partitioned | 1.01| 40550|0 2019-06-25 00:44:43,037|MF|app-20190625004431-0081|3|4|START| 12.72|F.Maximal disks found | 0.00| 0|0 2019-06-25 00:44:43,039|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:44:43,039|Cell area: 1055533.7681000116 2019-06-25 00:44:53,168|MF|app-20190625004431-0081|3|4| END| 22.85|F.Maximal disks found | 10.13| 8371|0 2019-06-25 00:44:53,168|MAXIMALS|app-20190625004431-0081|4|3|100.0|3|450|16.561|8371 2019-06-25 00:44:53,694|FF|app-20190625004431-0081|3|4| END| 23.37|1.Maximal disks found | 17.09| 8371|0 2019-06-25 00:44:53,694|FF|app-20190625004431-0081|3|4|START| 23.37|1.Maximal disks found | 0.00| 0|1 2019-06-25 00:44:53,694|MF|app-20190625004431-0081|3|4|START| 23.37|A.Points indexed | 0.00| 0|1 2019-06-25 00:44:53,759|MF|app-20190625004431-0081|3|4| END| 23.44|A.Points indexed | 0.07| 18245|1 2019-06-25 00:44:53,760|MF|app-20190625004431-0081|3|4|START| 23.44|B.Pairs found | 0.00| 0|1 2019-06-25 00:44:54,243|MF|app-20190625004431-0081|3|4| END| 23.92|B.Pairs found | 0.48| 34462|1 2019-06-25 00:44:54,243|MF|app-20190625004431-0081|3|4|START| 23.92|C.Centers found | 0.00| 0|1 2019-06-25 00:44:54,769|MF|app-20190625004431-0081|3|4| END| 24.45|C.Centers found | 0.53| 68924|1 2019-06-25 00:44:54,769|MF|app-20190625004431-0081|3|4|START| 24.45|D.Disks found | 0.00| 0|1 2019-06-25 00:44:57,109|MF|app-20190625004431-0081|3|4| END| 26.79|D.Disks found | 2.34| 29116|1 2019-06-25 00:44:57,109|MF|app-20190625004431-0081|3|4|START| 26.79|E.Disks partitioned | 0.00| 0|1 2019-06-25 00:44:57,837|MF|app-20190625004431-0081|3|4| END| 27.52|E.Disks partitioned | 0.73| 41162|1 2019-06-25 00:44:57,837|MF|app-20190625004431-0081|3|4|START| 27.52|F.Maximal disks found | 0.00| 0|1 2019-06-25 00:44:57,837|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:44:57,837|Cell area: 1055533.7681000116 2019-06-25 00:45:07,170|MF|app-20190625004431-0081|3|4| END| 36.85|F.Maximal disks found | 9.33| 8547|1 2019-06-25 00:45:07,170|MAXIMALS|app-20190625004431-0081|4|3|100.0|3|450|13.476|8547 2019-06-25 00:45:07,606|FF|app-20190625004431-0081|3|4| END| 37.29|1.Maximal disks found | 13.91| 8547|1 2019-06-25 00:45:07,606|FF|app-20190625004431-0081|3|4|START| 37.29|2.Join done | 0.00| 0|1 2019-06-25 00:45:09,678|FF|app-20190625004431-0081|3|4| END| 39.36|2.Join done | 2.07| 17137|1 2019-06-25 00:45:09,678|FF|app-20190625004431-0081|3|4|START| 39.36|3.Flocks to report | 0.00| 0|1 2019-06-25 00:45:10,052|FF|app-20190625004431-0081|3|4| END| 39.73|3.Flocks to report | 0.37| 0|1 2019-06-25 00:45:10,052|FF|app-20190625004431-0081|3|4|START| 39.73|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 00:45:10,083|FF|app-20190625004431-0081|3|4| END| 39.76|4.Flocks prunned by expansion | 0.03| 0|1 2019-06-25 00:45:10,083|FF|app-20190625004431-0081|3|4|START| 39.76|5.Flocks reported | 0.00| 0|1 2019-06-25 00:45:10,087|FF|app-20190625004431-0081|3|4| END| 39.77|5.Flocks reported | 0.00| 0|1 2019-06-25 00:45:10,088|FF|app-20190625004431-0081|3|4|START| 39.77|6.Candidates indexed | 0.00| 0|1 2019-06-25 00:45:11,516|FF|app-20190625004431-0081|3|4| END| 41.19|6.Candidates indexed | 1.43| 17633|1 2019-06-25 00:45:11,516|FF|app-20190625004431-0081|3|4|START| 41.20|1.Maximal disks found | 0.00| 0|2 2019-06-25 00:45:11,516|MF|app-20190625004431-0081|3|4|START| 41.20|A.Points indexed | 0.00| 0|2 2019-06-25 00:45:11,576|MF|app-20190625004431-0081|3|4| END| 41.26|A.Points indexed | 0.06| 18394|2 2019-06-25 00:45:11,576|MF|app-20190625004431-0081|3|4|START| 41.26|B.Pairs found | 0.00| 0|2 2019-06-25 00:45:11,978|MF|app-20190625004431-0081|3|4| END| 41.66|B.Pairs found | 0.40| 34918|2 2019-06-25 00:45:11,978|MF|app-20190625004431-0081|3|4|START| 41.66|C.Centers found | 0.00| 0|2 2019-06-25 00:45:12,461|MF|app-20190625004431-0081|3|4| END| 42.14|C.Centers found | 0.48| 69836|2 2019-06-25 00:45:12,461|MF|app-20190625004431-0081|3|4|START| 42.14|D.Disks found | 0.00| 0|2 2019-06-25 00:45:14,614|MF|app-20190625004431-0081|3|4| END| 44.29|D.Disks found | 2.15| 29549|2 2019-06-25 00:45:14,614|MF|app-20190625004431-0081|3|4|START| 44.29|E.Disks partitioned | 0.00| 0|2 2019-06-25 00:45:15,270|MF|app-20190625004431-0081|3|4| END| 44.95|E.Disks partitioned | 0.66| 41840|2 2019-06-25 00:45:15,270|MF|app-20190625004431-0081|3|4|START| 44.95|F.Maximal disks found | 0.00| 0|2 2019-06-25 00:45:15,270|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:45:15,270|Cell area: 1055533.7681000116 2019-06-25 00:45:24,669|MF|app-20190625004431-0081|3|4| END| 54.35|F.Maximal disks found | 9.40| 8685|2 2019-06-25 00:45:24,669|MAXIMALS|app-20190625004431-0081|4|3|100.0|3|450|13.153|8685 2019-06-25 00:45:25,091|FF|app-20190625004431-0081|3|4| END| 54.77|1.Maximal disks found | 13.57| 8685|2 2019-06-25 00:45:25,091|FF|app-20190625004431-0081|3|4|START| 54.77|2.Join done | 0.00| 0|2 2019-06-25 00:45:30,369|FF|app-20190625004431-0081|3|4| END| 60.05|2.Join done | 5.28| 32674|2 2019-06-25 00:45:30,369|FF|app-20190625004431-0081|3|4|START| 60.05|3.Flocks to report | 0.00| 0|2 2019-06-25 00:45:31,194|FF|app-20190625004431-0081|3|4| END| 60.87|3.Flocks to report | 0.83| 27875|2 2019-06-25 00:45:31,194|FF|app-20190625004431-0081|3|4|START| 60.87|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 00:45:31,227|FF|app-20190625004431-0081|3|4|START| 60.91|4a.Making expansions | 0.00| 0|2 2019-06-25 00:45:31,790|FF|app-20190625004431-0081|3|4| END| 61.47|4a.Making expansions | 0.56| 34678|2 2019-06-25 00:45:31,791|FF|app-20190625004431-0081|3|4|START| 61.47|4b.Finding maximals | 0.00| 0|2 2019-06-25 00:45:45,049|FF|app-20190625004431-0081|3|4| END| 74.73|4b.Finding maximals | 13.26| 5697|2 2019-06-25 00:45:45,259|FF|app-20190625004431-0081|3|4| END| 74.94|4.Flocks prunned by expansion | 14.07| 5697|2 2019-06-25 00:45:45,259|FF|app-20190625004431-0081|3|4|START| 74.94|5.Flocks reported | 0.00| 0|2 2019-06-25 00:45:45,580|FF|app-20190625004431-0081|3|4| END| 75.26|5.Flocks reported | 0.32| 5697|2 2019-06-25 00:45:45,581|FF|app-20190625004431-0081|3|4|START| 75.26|6.Candidates indexed | 0.00| 0|2 2019-06-25 00:45:47,109|FF|app-20190625004431-0081|3|4| END| 76.79|6.Candidates indexed | 1.53| 11079|2 2019-06-25 00:45:47,109|FF|app-20190625004431-0081|3|4|START| 76.79|1.Maximal disks found | 0.00| 0|3 2019-06-25 00:45:47,109|MF|app-20190625004431-0081|3|4|START| 76.79|A.Points indexed | 0.00| 0|3 2019-06-25 00:45:47,163|MF|app-20190625004431-0081|3|4| END| 76.84|A.Points indexed | 0.05| 18548|3 2019-06-25 00:45:47,163|MF|app-20190625004431-0081|3|4|START| 76.84|B.Pairs found | 0.00| 0|3 2019-06-25 00:45:47,560|MF|app-20190625004431-0081|3|4| END| 77.24|B.Pairs found | 0.40| 35515|3 2019-06-25 00:45:47,560|MF|app-20190625004431-0081|3|4|START| 77.24|C.Centers found | 0.00| 0|3 2019-06-25 00:45:48,068|MF|app-20190625004431-0081|3|4| END| 77.75|C.Centers found | 0.51| 71030|3 2019-06-25 00:45:48,068|MF|app-20190625004431-0081|3|4|START| 77.75|D.Disks found | 0.00| 0|3 2019-06-25 00:45:50,127|MF|app-20190625004431-0081|3|4| END| 79.81|D.Disks found | 2.06| 30142|3 2019-06-25 00:45:50,128|MF|app-20190625004431-0081|3|4|START| 79.81|E.Disks partitioned | 0.00| 0|3 2019-06-25 00:45:50,877|MF|app-20190625004431-0081|3|4| END| 80.56|E.Disks partitioned | 0.75| 42665|3 2019-06-25 00:45:50,877|MF|app-20190625004431-0081|3|4|START| 80.56|F.Maximal disks found | 0.00| 0|3 2019-06-25 00:45:50,878|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:45:50,878|Cell area: 1055533.7681000116 2019-06-25 00:46:02,527|MF|app-20190625004431-0081|3|4| END| 92.21|F.Maximal disks found | 11.65| 8846|3 2019-06-25 00:46:02,527|MAXIMALS|app-20190625004431-0081|4|3|100.0|3|450|15.418|8846 2019-06-25 00:46:02,898|FF|app-20190625004431-0081|3|4| END| 92.58|1.Maximal disks found | 15.79| 8846|3 2019-06-25 00:46:02,898|FF|app-20190625004431-0081|3|4|START| 92.58|2.Join done | 0.00| 0|3 2019-06-25 00:46:06,047|FF|app-20190625004431-0081|3|4| END| 95.73|2.Join done | 3.15| 30193|3 2019-06-25 00:46:06,047|FF|app-20190625004431-0081|3|4|START| 95.73|3.Flocks to report | 0.00| 0|3 2019-06-25 00:46:06,610|FF|app-20190625004431-0081|3|4| END| 96.29|3.Flocks to report | 0.56| 25331|3 2019-06-25 00:46:06,611|FF|app-20190625004431-0081|3|4|START| 96.29|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 00:46:06,638|FF|app-20190625004431-0081|3|4|START| 96.32|4a.Making expansions | 0.00| 0|3 2019-06-25 00:46:07,114|FF|app-20190625004431-0081|3|4| END| 96.79|4a.Making expansions | 0.48| 32171|3 2019-06-25 00:46:07,114|FF|app-20190625004431-0081|3|4|START| 96.79|4b.Finding maximals | 0.00| 0|3 2019-06-25 00:46:17,664|FF|app-20190625004431-0081|3|4| END|107.34|4b.Finding maximals | 10.55| 5767|3 2019-06-25 00:46:17,865|FF|app-20190625004431-0081|3|4| END|107.54|4.Flocks prunned by expansion | 11.26| 5767|3 2019-06-25 00:46:17,865|FF|app-20190625004431-0081|3|4|START|107.54|5.Flocks reported | 0.00| 0|3 2019-06-25 00:46:18,091|FF|app-20190625004431-0081|3|4| END|107.77|5.Flocks reported | 0.23| 5767|3 2019-06-25 00:46:18,092|FF|app-20190625004431-0081|3|4|START|107.77|6.Candidates indexed | 0.00| 0|3 2019-06-25 00:46:19,323|FF|app-20190625004431-0081|3|4| END|109.00|6.Candidates indexed | 1.23| 11171|3 2019-06-25 00:46:19,877|Number of flocks: 11464 2019-06-25 00:46:20,245|PFLOCK|app-20190625004431-0081|4|3|100.0|3|3|103.44|11464 2019-06-25 00:46:20,586|FF|app-20190625004431-0081|3|4| END|110.27|Flock Finder run |104.14| 11464|3 2019-06-25 00:46:20,587|FF|app-20190625004431-0081|3|4|START|110.27|Session closed | 0.00| 0|3 2019-06-25 00:46:26,979|FF|app-20190625004431-0081|3|4| END|116.66|Session closed | 6.39| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B4_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_grid-60x30.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 12 --fftimestamp 4 --portui 4040 --info 2019-06-25 00:46:28,935|FF|app-00000000000000-0000|12|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 00:46:30,048|FF|app-20190625004629-0082|12|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 00:46:30,049|FF|app-20190625004629-0082|12|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 00:46:33,130|FF|app-20190625004629-0082|12|4|START| 4.18|KDBTree partitioner | 0.00| 0|-1 2019-06-25 00:46:34,238|Sample size: 441504 2019-06-25 00:46:34,514|FF|app-20190625004629-0082|12|4| END| 5.56|KDBTree partitioner | 1.38| 1115|-1 2019-06-25 00:46:34,514|FF|app-20190625004629-0082|12|4|START| 5.56|MF partitioner | 0.00| 0|-1 2019-06-25 00:46:34,578|FF|app-20190625004629-0082|12|4| END| 5.63|MF partitioner | 0.06| 1800|-1 2019-06-25 00:46:36,627|FF|app-20190625004629-0082|12|4| END| 7.68|MF partitioner | 2.11|441504|-1 2019-06-25 00:46:36,628|FF|app-20190625004629-0082|12|4|START| 7.68|Flock Finder run | 0.00| 0|-1 2019-06-25 00:46:36,644|FF|app-20190625004629-0082|12|4|START| 7.69|1.Maximal disks found | 0.00| 0|0 2019-06-25 00:46:36,646|MF|app-20190625004629-0082|12|4|START| 7.69|A.Points indexed | 0.00| 0|0 2019-06-25 00:46:36,876|MF|app-20190625004629-0082|12|4| END| 7.92|A.Points indexed | 0.23| 72372|0 2019-06-25 00:46:36,876|MF|app-20190625004629-0082|12|4|START| 7.92|B.Pairs found | 0.00| 0|0 2019-06-25 00:46:38,705|MF|app-20190625004629-0082|12|4| END| 9.75|B.Pairs found | 1.83|157616|0 2019-06-25 00:46:38,705|MF|app-20190625004629-0082|12|4|START| 9.75|C.Centers found | 0.00| 0|0 2019-06-25 00:46:39,888|MF|app-20190625004629-0082|12|4| END| 10.94|C.Centers found | 1.18|315232|0 2019-06-25 00:46:39,888|MF|app-20190625004629-0082|12|4|START| 10.94|D.Disks found | 0.00| 0|0 2019-06-25 00:46:44,649|MF|app-20190625004629-0082|12|4| END| 15.70|D.Disks found | 4.76|140916|0 2019-06-25 00:46:44,649|MF|app-20190625004629-0082|12|4|START| 15.70|E.Disks partitioned | 0.00| 0|0 2019-06-25 00:46:46,238|MF|app-20190625004629-0082|12|4| END| 17.29|E.Disks partitioned | 1.59|206209|0 2019-06-25 00:46:46,238|MF|app-20190625004629-0082|12|4|START| 17.29|F.Maximal disks found | 0.00| 0|0 2019-06-25 00:46:46,240|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:46:46,240|Cell area: 1055533.7681000116 2019-06-25 00:47:12,329|MF|app-20190625004629-0082|12|4| END| 43.38|F.Maximal disks found | 26.09| 40009|0 2019-06-25 00:47:12,329|MAXIMALS|app-20190625004629-0082|4|12|110.0|3|1800|35.683|40009 2019-06-25 00:47:13,714|FF|app-20190625004629-0082|12|4| END| 44.76|1.Maximal disks found | 37.07| 40009|0 2019-06-25 00:47:13,714|FF|app-20190625004629-0082|12|4|START| 44.76|1.Maximal disks found | 0.00| 0|1 2019-06-25 00:47:13,714|MF|app-20190625004629-0082|12|4|START| 44.76|A.Points indexed | 0.00| 0|1 2019-06-25 00:47:13,850|MF|app-20190625004629-0082|12|4| END| 44.90|A.Points indexed | 0.14| 72980|1 2019-06-25 00:47:13,850|MF|app-20190625004629-0082|12|4|START| 44.90|B.Pairs found | 0.00| 0|1 2019-06-25 00:47:14,586|MF|app-20190625004629-0082|12|4| END| 45.63|B.Pairs found | 0.74|159996|1 2019-06-25 00:47:14,586|MF|app-20190625004629-0082|12|4|START| 45.63|C.Centers found | 0.00| 0|1 2019-06-25 00:47:15,443|MF|app-20190625004629-0082|12|4| END| 46.49|C.Centers found | 0.86|319992|1 2019-06-25 00:47:15,444|MF|app-20190625004629-0082|12|4|START| 46.49|D.Disks found | 0.00| 0|1 2019-06-25 00:47:19,060|MF|app-20190625004629-0082|12|4| END| 50.11|D.Disks found | 3.62|143396|1 2019-06-25 00:47:19,060|MF|app-20190625004629-0082|12|4|START| 50.11|E.Disks partitioned | 0.00| 0|1 2019-06-25 00:47:20,276|MF|app-20190625004629-0082|12|4| END| 51.32|E.Disks partitioned | 1.22|209660|1 2019-06-25 00:47:20,276|MF|app-20190625004629-0082|12|4|START| 51.32|F.Maximal disks found | 0.00| 0|1 2019-06-25 00:47:20,277|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:47:20,277|Cell area: 1055533.7681000116 2019-06-25 00:47:48,649|MF|app-20190625004629-0082|12|4| END| 79.70|F.Maximal disks found | 28.37| 40432|1 2019-06-25 00:47:48,649|MAXIMALS|app-20190625004629-0082|4|12|110.0|3|1800|34.935|40432 2019-06-25 00:47:50,025|FF|app-20190625004629-0082|12|4| END| 81.07|1.Maximal disks found | 36.31| 40432|1 2019-06-25 00:47:50,025|FF|app-20190625004629-0082|12|4|START| 81.07|2.Join done | 0.00| 0|1 2019-06-25 00:47:54,070|FF|app-20190625004629-0082|12|4| END| 85.12|2.Join done | 4.05| 87506|1 2019-06-25 00:47:54,070|FF|app-20190625004629-0082|12|4|START| 85.12|3.Flocks to report | 0.00| 0|1 2019-06-25 00:47:54,650|FF|app-20190625004629-0082|12|4| END| 85.70|3.Flocks to report | 0.58| 0|1 2019-06-25 00:47:54,650|FF|app-20190625004629-0082|12|4|START| 85.70|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 00:47:54,712|FF|app-20190625004629-0082|12|4| END| 85.76|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 00:47:54,712|FF|app-20190625004629-0082|12|4|START| 85.76|5.Flocks reported | 0.00| 0|1 2019-06-25 00:47:54,717|FF|app-20190625004629-0082|12|4| END| 85.76|5.Flocks reported | 0.00| 0|1 2019-06-25 00:47:54,717|FF|app-20190625004629-0082|12|4|START| 85.77|6.Candidates indexed | 0.00| 0|1 2019-06-25 00:47:56,806|FF|app-20190625004629-0082|12|4| END| 87.85|6.Candidates indexed | 2.09| 89925|1 2019-06-25 00:47:56,807|FF|app-20190625004629-0082|12|4|START| 87.86|1.Maximal disks found | 0.00| 0|2 2019-06-25 00:47:56,807|MF|app-20190625004629-0082|12|4|START| 87.86|A.Points indexed | 0.00| 0|2 2019-06-25 00:47:56,936|MF|app-20190625004629-0082|12|4| END| 87.98|A.Points indexed | 0.13| 73576|2 2019-06-25 00:47:56,936|MF|app-20190625004629-0082|12|4|START| 87.98|B.Pairs found | 0.00| 0|2 2019-06-25 00:47:57,796|MF|app-20190625004629-0082|12|4| END| 88.84|B.Pairs found | 0.86|162264|2 2019-06-25 00:47:57,796|MF|app-20190625004629-0082|12|4|START| 88.84|C.Centers found | 0.00| 0|2 2019-06-25 00:47:58,633|MF|app-20190625004629-0082|12|4| END| 89.68|C.Centers found | 0.84|324528|2 2019-06-25 00:47:58,633|MF|app-20190625004629-0082|12|4|START| 89.68|D.Disks found | 0.00| 0|2 2019-06-25 00:48:02,343|MF|app-20190625004629-0082|12|4| END| 93.39|D.Disks found | 3.71|145412|2 2019-06-25 00:48:02,343|MF|app-20190625004629-0082|12|4|START| 93.39|E.Disks partitioned | 0.00| 0|2 2019-06-25 00:48:03,844|MF|app-20190625004629-0082|12|4| END| 94.89|E.Disks partitioned | 1.50|212798|2 2019-06-25 00:48:03,845|MF|app-20190625004629-0082|12|4|START| 94.89|F.Maximal disks found | 0.00| 0|2 2019-06-25 00:48:03,846|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:48:03,846|Cell area: 1055533.7681000116 2019-06-25 00:48:31,560|MF|app-20190625004629-0082|12|4| END|122.61|F.Maximal disks found | 27.72| 41347|2 2019-06-25 00:48:31,561|MAXIMALS|app-20190625004629-0082|4|12|110.0|3|1800|34.754|41347 2019-06-25 00:48:32,965|FF|app-20190625004629-0082|12|4| END|124.01|1.Maximal disks found | 36.16| 41347|2 2019-06-25 00:48:32,965|FF|app-20190625004629-0082|12|4|START|124.01|2.Join done | 0.00| 0|2 2019-06-25 00:48:43,259|FF|app-20190625004629-0082|12|4| END|134.31|2.Join done | 10.29|179268|2 2019-06-25 00:48:43,260|FF|app-20190625004629-0082|12|4|START|134.31|3.Flocks to report | 0.00| 0|2 2019-06-25 00:48:44,184|FF|app-20190625004629-0082|12|4| END|135.23|3.Flocks to report | 0.92|153105|2 2019-06-25 00:48:44,184|FF|app-20190625004629-0082|12|4|START|135.23|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 00:48:44,246|FF|app-20190625004629-0082|12|4|START|135.29|4a.Making expansions | 0.00| 0|2 2019-06-25 00:48:45,437|FF|app-20190625004629-0082|12|4| END|136.49|4a.Making expansions | 1.19|191389|2 2019-06-25 00:48:45,437|FF|app-20190625004629-0082|12|4|START|136.49|4b.Finding maximals | 0.00| 0|2 2019-06-25 00:49:33,036|FF|app-20190625004629-0082|12|4| END|184.08|4b.Finding maximals | 47.60| 26404|2 2019-06-25 00:49:33,627|FF|app-20190625004629-0082|12|4| END|184.68|4.Flocks prunned by expansion | 49.44| 26404|2 2019-06-25 00:49:33,627|FF|app-20190625004629-0082|12|4|START|184.68|5.Flocks reported | 0.00| 0|2 2019-06-25 00:49:34,378|FF|app-20190625004629-0082|12|4| END|185.43|5.Flocks reported | 0.75| 26404|2 2019-06-25 00:49:34,378|FF|app-20190625004629-0082|12|4|START|185.43|6.Candidates indexed | 0.00| 0|2 2019-06-25 00:49:36,794|FF|app-20190625004629-0082|12|4| END|187.84|6.Candidates indexed | 2.42| 55147|2 2019-06-25 00:49:36,794|FF|app-20190625004629-0082|12|4|START|187.84|1.Maximal disks found | 0.00| 0|3 2019-06-25 00:49:36,794|MF|app-20190625004629-0082|12|4|START|187.84|A.Points indexed | 0.00| 0|3 2019-06-25 00:49:36,917|MF|app-20190625004629-0082|12|4| END|187.97|A.Points indexed | 0.12| 74192|3 2019-06-25 00:49:36,917|MF|app-20190625004629-0082|12|4|START|187.97|B.Pairs found | 0.00| 0|3 2019-06-25 00:49:37,906|MF|app-20190625004629-0082|12|4| END|188.95|B.Pairs found | 0.99|165028|3 2019-06-25 00:49:37,906|MF|app-20190625004629-0082|12|4|START|188.95|C.Centers found | 0.00| 0|3 2019-06-25 00:49:38,748|MF|app-20190625004629-0082|12|4| END|189.80|C.Centers found | 0.84|330056|3 2019-06-25 00:49:38,748|MF|app-20190625004629-0082|12|4|START|189.80|D.Disks found | 0.00| 0|3 2019-06-25 00:49:42,177|MF|app-20190625004629-0082|12|4| END|193.23|D.Disks found | 3.43|148348|3 2019-06-25 00:49:42,177|MF|app-20190625004629-0082|12|4|START|193.23|E.Disks partitioned | 0.00| 0|3 2019-06-25 00:49:43,612|MF|app-20190625004629-0082|12|4| END|194.66|E.Disks partitioned | 1.44|217088|3 2019-06-25 00:49:43,612|MF|app-20190625004629-0082|12|4|START|194.66|F.Maximal disks found | 0.00| 0|3 2019-06-25 00:49:43,613|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:49:43,613|Cell area: 1055533.7681000116 2019-06-25 00:50:19,055|MF|app-20190625004629-0082|12|4| END|230.10|F.Maximal disks found | 35.44| 42012|3 2019-06-25 00:50:19,055|MAXIMALS|app-20190625004629-0082|4|12|110.0|3|1800|42.261|42012 2019-06-25 00:50:20,428|FF|app-20190625004629-0082|12|4| END|231.48|1.Maximal disks found | 43.63| 42012|3 2019-06-25 00:50:20,428|FF|app-20190625004629-0082|12|4|START|231.48|2.Join done | 0.00| 0|3 2019-06-25 00:50:26,949|FF|app-20190625004629-0082|12|4| END|238.00|2.Join done | 6.52|179709|3 2019-06-25 00:50:26,949|FF|app-20190625004629-0082|12|4|START|238.00|3.Flocks to report | 0.00| 0|3 2019-06-25 00:50:27,846|FF|app-20190625004629-0082|12|4| END|238.89|3.Flocks to report | 0.90|153488|3 2019-06-25 00:50:27,846|FF|app-20190625004629-0082|12|4|START|238.89|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 00:50:27,907|FF|app-20190625004629-0082|12|4|START|238.96|4a.Making expansions | 0.00| 0|3 2019-06-25 00:50:29,281|FF|app-20190625004629-0082|12|4| END|240.33|4a.Making expansions | 1.37|191729|3 2019-06-25 00:50:29,281|FF|app-20190625004629-0082|12|4|START|240.33|4b.Finding maximals | 0.00| 0|3 2019-06-25 00:51:41,501|FF|app-20190625004629-0082|12|4| END|312.55|4b.Finding maximals | 72.22| 26676|3 2019-06-25 00:51:42,117|FF|app-20190625004629-0082|12|4| END|313.17|4.Flocks prunned by expansion | 74.27| 26676|3 2019-06-25 00:51:42,117|FF|app-20190625004629-0082|12|4|START|313.17|5.Flocks reported | 0.00| 0|3 2019-06-25 00:51:42,979|FF|app-20190625004629-0082|12|4| END|314.03|5.Flocks reported | 0.86| 26676|3 2019-06-25 00:51:42,979|FF|app-20190625004629-0082|12|4|START|314.03|6.Candidates indexed | 0.00| 0|3 2019-06-25 00:51:45,499|FF|app-20190625004629-0082|12|4| END|316.55|6.Candidates indexed | 2.52| 55524|3 2019-06-25 00:51:47,346|Number of flocks: 53080 2019-06-25 00:51:48,594|PFLOCK|app-20190625004629-0082|4|12|110.0|3|3|310.72|53080 2019-06-25 00:51:49,876|FF|app-20190625004629-0082|12|4| END|320.92|Flock Finder run |313.25| 53080|3 2019-06-25 00:51:49,876|FF|app-20190625004629-0082|12|4|START|320.92|Session closed | 0.00| 0|3 2019-06-25 00:51:58,265|FF|app-20190625004629-0082|12|4| END|329.31|Session closed | 8.39| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 6 --fftimestamp 4 --portui 4040 --info 2019-06-25 00:52:00,003|FF|app-00000000000000-0000|6|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 00:52:01,111|FF|app-20190625005200-0083|6|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 00:52:01,112|FF|app-20190625005200-0083|6|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 00:52:04,088|FF|app-20190625005200-0083|6|4|START| 4.07|KDBTree partitioner | 0.00| 0|-1 2019-06-25 00:52:05,152|Sample size: 220752 2019-06-25 00:52:05,294|FF|app-20190625005200-0083|6|4| END| 5.27|KDBTree partitioner | 1.21| 556|-1 2019-06-25 00:52:05,294|FF|app-20190625005200-0083|6|4|START| 5.27|MF partitioner | 0.00| 0|-1 2019-06-25 00:52:05,332|FF|app-20190625005200-0083|6|4| END| 5.31|MF partitioner | 0.04| 900|-1 2019-06-25 00:52:07,073|FF|app-20190625005200-0083|6|4| END| 7.05|MF partitioner | 1.78|220752|-1 2019-06-25 00:52:07,073|FF|app-20190625005200-0083|6|4|START| 7.05|Flock Finder run | 0.00| 0|-1 2019-06-25 00:52:07,093|FF|app-20190625005200-0083|6|4|START| 7.07|1.Maximal disks found | 0.00| 0|0 2019-06-25 00:52:07,096|MF|app-20190625005200-0083|6|4|START| 7.08|A.Points indexed | 0.00| 0|0 2019-06-25 00:52:07,282|MF|app-20190625005200-0083|6|4| END| 7.26|A.Points indexed | 0.19| 36186|0 2019-06-25 00:52:07,282|MF|app-20190625005200-0083|6|4|START| 7.26|B.Pairs found | 0.00| 0|0 2019-06-25 00:52:08,895|MF|app-20190625005200-0083|6|4| END| 8.87|B.Pairs found | 1.61| 78808|0 2019-06-25 00:52:08,895|MF|app-20190625005200-0083|6|4|START| 8.87|C.Centers found | 0.00| 0|0 2019-06-25 00:52:09,977|MF|app-20190625005200-0083|6|4| END| 9.96|C.Centers found | 1.08|157616|0 2019-06-25 00:52:09,977|MF|app-20190625005200-0083|6|4|START| 9.96|D.Disks found | 0.00| 0|0 2019-06-25 00:52:14,952|MF|app-20190625005200-0083|6|4| END| 14.93|D.Disks found | 4.98| 70458|0 2019-06-25 00:52:14,953|MF|app-20190625005200-0083|6|4|START| 14.93|E.Disks partitioned | 0.00| 0|0 2019-06-25 00:52:17,331|MF|app-20190625005200-0083|6|4| END| 17.31|E.Disks partitioned | 2.38|103004|0 2019-06-25 00:52:17,331|MF|app-20190625005200-0083|6|4|START| 17.31|F.Maximal disks found | 0.00| 0|0 2019-06-25 00:52:17,333|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:52:17,333|Cell area: 1055533.7681000116 2019-06-25 00:52:43,669|MF|app-20190625005200-0083|6|4| END| 43.65|F.Maximal disks found | 26.34| 20001|0 2019-06-25 00:52:43,669|MAXIMALS|app-20190625005200-0083|4|6|110.0|3|900|36.573|20001 2019-06-25 00:52:44,659|FF|app-20190625005200-0083|6|4| END| 44.64|1.Maximal disks found | 37.57| 20001|0 2019-06-25 00:52:44,659|FF|app-20190625005200-0083|6|4|START| 44.64|1.Maximal disks found | 0.00| 0|1 2019-06-25 00:52:44,659|MF|app-20190625005200-0083|6|4|START| 44.64|A.Points indexed | 0.00| 0|1 2019-06-25 00:52:44,749|MF|app-20190625005200-0083|6|4| END| 44.73|A.Points indexed | 0.09| 36490|1 2019-06-25 00:52:44,749|MF|app-20190625005200-0083|6|4|START| 44.73|B.Pairs found | 0.00| 0|1 2019-06-25 00:52:45,800|MF|app-20190625005200-0083|6|4| END| 45.78|B.Pairs found | 1.05| 79998|1 2019-06-25 00:52:45,801|MF|app-20190625005200-0083|6|4|START| 45.78|C.Centers found | 0.00| 0|1 2019-06-25 00:52:46,793|MF|app-20190625005200-0083|6|4| END| 46.77|C.Centers found | 0.99|159996|1 2019-06-25 00:52:46,793|MF|app-20190625005200-0083|6|4|START| 46.77|D.Disks found | 0.00| 0|1 2019-06-25 00:52:52,351|MF|app-20190625005200-0083|6|4| END| 52.33|D.Disks found | 5.56| 71698|1 2019-06-25 00:52:52,351|MF|app-20190625005200-0083|6|4|START| 52.33|E.Disks partitioned | 0.00| 0|1 2019-06-25 00:52:54,458|MF|app-20190625005200-0083|6|4| END| 54.44|E.Disks partitioned | 2.11|104758|1 2019-06-25 00:52:54,458|MF|app-20190625005200-0083|6|4|START| 54.44|F.Maximal disks found | 0.00| 0|1 2019-06-25 00:52:54,458|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:52:54,459|Cell area: 1055533.7681000116 2019-06-25 00:53:23,146|MF|app-20190625005200-0083|6|4| END| 83.13|F.Maximal disks found | 28.69| 20222|1 2019-06-25 00:53:23,146|MAXIMALS|app-20190625005200-0083|4|6|110.0|3|900|38.487|20222 2019-06-25 00:53:24,163|FF|app-20190625005200-0083|6|4| END| 84.14|1.Maximal disks found | 39.50| 20222|1 2019-06-25 00:53:24,163|FF|app-20190625005200-0083|6|4|START| 84.14|2.Join done | 0.00| 0|1 2019-06-25 00:53:29,461|FF|app-20190625005200-0083|6|4| END| 89.44|2.Join done | 5.30| 43837|1 2019-06-25 00:53:29,462|FF|app-20190625005200-0083|6|4|START| 89.44|3.Flocks to report | 0.00| 0|1 2019-06-25 00:53:30,554|FF|app-20190625005200-0083|6|4| END| 90.53|3.Flocks to report | 1.09| 0|1 2019-06-25 00:53:30,554|FF|app-20190625005200-0083|6|4|START| 90.53|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 00:53:30,597|FF|app-20190625005200-0083|6|4| END| 90.58|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 00:53:30,597|FF|app-20190625005200-0083|6|4|START| 90.58|5.Flocks reported | 0.00| 0|1 2019-06-25 00:53:30,601|FF|app-20190625005200-0083|6|4| END| 90.58|5.Flocks reported | 0.00| 0|1 2019-06-25 00:53:30,602|FF|app-20190625005200-0083|6|4|START| 90.58|6.Candidates indexed | 0.00| 0|1 2019-06-25 00:53:34,641|FF|app-20190625005200-0083|6|4| END| 94.62|6.Candidates indexed | 4.04| 45047|1 2019-06-25 00:53:34,641|FF|app-20190625005200-0083|6|4|START| 94.62|1.Maximal disks found | 0.00| 0|2 2019-06-25 00:53:34,642|MF|app-20190625005200-0083|6|4|START| 94.62|A.Points indexed | 0.00| 0|2 2019-06-25 00:53:34,723|MF|app-20190625005200-0083|6|4| END| 94.70|A.Points indexed | 0.08| 36788|2 2019-06-25 00:53:34,723|MF|app-20190625005200-0083|6|4|START| 94.70|B.Pairs found | 0.00| 0|2 2019-06-25 00:53:35,724|MF|app-20190625005200-0083|6|4| END| 95.70|B.Pairs found | 1.00| 81132|2 2019-06-25 00:53:35,724|MF|app-20190625005200-0083|6|4|START| 95.70|C.Centers found | 0.00| 0|2 2019-06-25 00:53:36,688|MF|app-20190625005200-0083|6|4| END| 96.67|C.Centers found | 0.96|162264|2 2019-06-25 00:53:36,689|MF|app-20190625005200-0083|6|4|START| 96.67|D.Disks found | 0.00| 0|2 2019-06-25 00:53:41,497|MF|app-20190625005200-0083|6|4| END|101.48|D.Disks found | 4.81| 72706|2 2019-06-25 00:53:41,497|MF|app-20190625005200-0083|6|4|START|101.48|E.Disks partitioned | 0.00| 0|2 2019-06-25 00:53:43,556|MF|app-20190625005200-0083|6|4| END|103.54|E.Disks partitioned | 2.06|106347|2 2019-06-25 00:53:43,556|MF|app-20190625005200-0083|6|4|START|103.54|F.Maximal disks found | 0.00| 0|2 2019-06-25 00:53:43,557|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:53:43,557|Cell area: 1055533.7681000116 2019-06-25 00:54:10,889|MF|app-20190625005200-0083|6|4| END|130.87|F.Maximal disks found | 27.33| 20682|2 2019-06-25 00:54:10,889|MAXIMALS|app-20190625005200-0083|4|6|110.0|3|900|36.248|20682 2019-06-25 00:54:11,822|FF|app-20190625005200-0083|6|4| END|131.80|1.Maximal disks found | 37.18| 20682|2 2019-06-25 00:54:11,822|FF|app-20190625005200-0083|6|4|START|131.80|2.Join done | 0.00| 0|2 2019-06-25 00:54:36,439|FF|app-20190625005200-0083|6|4| END|156.42|2.Join done | 24.62| 89740|2 2019-06-25 00:54:36,440|FF|app-20190625005200-0083|6|4|START|156.42|3.Flocks to report | 0.00| 0|2 2019-06-25 00:54:39,988|FF|app-20190625005200-0083|6|4| END|159.97|3.Flocks to report | 3.55| 76643|2 2019-06-25 00:54:39,989|FF|app-20190625005200-0083|6|4|START|159.97|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 00:54:40,052|FF|app-20190625005200-0083|6|4|START|160.03|4a.Making expansions | 0.00| 0|2 2019-06-25 00:54:42,889|FF|app-20190625005200-0083|6|4| END|162.87|4a.Making expansions | 2.84| 95425|2 2019-06-25 00:54:42,889|FF|app-20190625005200-0083|6|4|START|162.87|4b.Finding maximals | 0.00| 0|2 2019-06-25 00:55:29,526|FF|app-20190625005200-0083|6|4| END|209.51|4b.Finding maximals | 46.64| 13202|2 2019-06-25 00:55:30,167|FF|app-20190625005200-0083|6|4| END|210.15|4.Flocks prunned by expansion | 50.18| 13202|2 2019-06-25 00:55:30,167|FF|app-20190625005200-0083|6|4|START|210.15|5.Flocks reported | 0.00| 0|2 2019-06-25 00:55:31,151|FF|app-20190625005200-0083|6|4| END|211.13|5.Flocks reported | 0.98| 13202|2 2019-06-25 00:55:31,151|FF|app-20190625005200-0083|6|4|START|211.13|6.Candidates indexed | 0.00| 0|2 2019-06-25 00:55:34,460|FF|app-20190625005200-0083|6|4| END|214.44|6.Candidates indexed | 3.31| 27595|2 2019-06-25 00:55:34,460|FF|app-20190625005200-0083|6|4|START|214.44|1.Maximal disks found | 0.00| 0|3 2019-06-25 00:55:34,460|MF|app-20190625005200-0083|6|4|START|214.44|A.Points indexed | 0.00| 0|3 2019-06-25 00:55:34,543|MF|app-20190625005200-0083|6|4| END|214.52|A.Points indexed | 0.08| 37096|3 2019-06-25 00:55:34,543|MF|app-20190625005200-0083|6|4|START|214.52|B.Pairs found | 0.00| 0|3 2019-06-25 00:55:35,062|MF|app-20190625005200-0083|6|4| END|215.04|B.Pairs found | 0.52| 82514|3 2019-06-25 00:55:35,062|MF|app-20190625005200-0083|6|4|START|215.04|C.Centers found | 0.00| 0|3 2019-06-25 00:55:35,715|MF|app-20190625005200-0083|6|4| END|215.69|C.Centers found | 0.65|165028|3 2019-06-25 00:55:35,715|MF|app-20190625005200-0083|6|4|START|215.69|D.Disks found | 0.00| 0|3 2019-06-25 00:55:39,727|MF|app-20190625005200-0083|6|4| END|219.71|D.Disks found | 4.01| 74174|3 2019-06-25 00:55:39,727|MF|app-20190625005200-0083|6|4|START|219.71|E.Disks partitioned | 0.00| 0|3 2019-06-25 00:55:43,293|MF|app-20190625005200-0083|6|4| END|223.27|E.Disks partitioned | 3.57|108468|3 2019-06-25 00:55:43,293|MF|app-20190625005200-0083|6|4|START|223.27|F.Maximal disks found | 0.00| 0|3 2019-06-25 00:55:43,293|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:55:43,293|Cell area: 1055533.7681000116 2019-06-25 00:56:21,717|MF|app-20190625005200-0083|6|4| END|261.70|F.Maximal disks found | 38.42| 21009|3 2019-06-25 00:56:21,718|MAXIMALS|app-20190625005200-0083|4|6|110.0|3|900|47.258|21009 2019-06-25 00:56:23,140|FF|app-20190625005200-0083|6|4| END|263.12|1.Maximal disks found | 48.68| 21009|3 2019-06-25 00:56:23,140|FF|app-20190625005200-0083|6|4|START|263.12|2.Join done | 0.00| 0|3 2019-06-25 00:56:42,682|FF|app-20190625005200-0083|6|4| END|282.66|2.Join done | 19.54| 90003|3 2019-06-25 00:56:42,682|FF|app-20190625005200-0083|6|4|START|282.66|3.Flocks to report | 0.00| 0|3 2019-06-25 00:56:46,304|FF|app-20190625005200-0083|6|4| END|286.28|3.Flocks to report | 3.62| 76861|3 2019-06-25 00:56:46,304|FF|app-20190625005200-0083|6|4|START|286.28|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 00:56:46,369|FF|app-20190625005200-0083|6|4|START|286.35|4a.Making expansions | 0.00| 0|3 2019-06-25 00:56:48,657|FF|app-20190625005200-0083|6|4| END|288.64|4a.Making expansions | 2.29| 95521|3 2019-06-25 00:56:48,657|FF|app-20190625005200-0083|6|4|START|288.64|4b.Finding maximals | 0.00| 0|3 2019-06-25 00:57:52,112|FF|app-20190625005200-0083|6|4| END|352.09|4b.Finding maximals | 63.46| 13338|3 2019-06-25 00:57:52,761|FF|app-20190625005200-0083|6|4| END|352.74|4.Flocks prunned by expansion | 66.46| 13338|3 2019-06-25 00:57:52,762|FF|app-20190625005200-0083|6|4|START|352.74|5.Flocks reported | 0.00| 0|3 2019-06-25 00:57:53,767|FF|app-20190625005200-0083|6|4| END|353.75|5.Flocks reported | 1.01| 13338|3 2019-06-25 00:57:53,767|FF|app-20190625005200-0083|6|4|START|353.75|6.Candidates indexed | 0.00| 0|3 2019-06-25 00:57:59,375|FF|app-20190625005200-0083|6|4| END|359.35|6.Candidates indexed | 5.61| 27789|3 2019-06-25 00:58:01,872|Number of flocks: 26540 2019-06-25 00:58:03,249|PFLOCK|app-20190625005200-0083|4|6|110.0|3|3|354.80|26540 2019-06-25 00:58:04,608|FF|app-20190625005200-0083|6|4| END|364.59|Flock Finder run |357.54| 26540|3 2019-06-25 00:58:04,608|FF|app-20190625005200-0083|6|4|START|364.59|Session closed | 0.00| 0|3 2019-06-25 00:58:10,810|FF|app-20190625005200-0083|6|4| END|370.79|Session closed | 6.20| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 3 --fftimestamp 4 --portui 4040 --info 2019-06-25 00:58:12,796|FF|app-00000000000000-0000|3|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 00:58:13,927|FF|app-20190625005813-0084|3|4| END| 1.11|Session start | 1.13| 0|-1 2019-06-25 00:58:13,927|FF|app-20190625005813-0084|3|4|START| 1.11|Data read | 0.00| 0|-1 2019-06-25 00:58:16,853|FF|app-20190625005813-0084|3|4|START| 4.04|KDBTree partitioner | 0.00| 0|-1 2019-06-25 00:58:17,561|Sample size: 110376 2019-06-25 00:58:17,643|FF|app-20190625005813-0084|3|4| END| 4.83|KDBTree partitioner | 0.79| 278|-1 2019-06-25 00:58:17,643|FF|app-20190625005813-0084|3|4|START| 4.83|MF partitioner | 0.00| 0|-1 2019-06-25 00:58:17,668|FF|app-20190625005813-0084|3|4| END| 4.86|MF partitioner | 0.03| 450|-1 2019-06-25 00:58:19,068|FF|app-20190625005813-0084|3|4| END| 6.26|MF partitioner | 1.43|110376|-1 2019-06-25 00:58:19,068|FF|app-20190625005813-0084|3|4|START| 6.26|Flock Finder run | 0.00| 0|-1 2019-06-25 00:58:19,224|FF|app-20190625005813-0084|3|4|START| 6.41|1.Maximal disks found | 0.00| 0|0 2019-06-25 00:58:19,227|MF|app-20190625005813-0084|3|4|START| 6.41|A.Points indexed | 0.00| 0|0 2019-06-25 00:58:19,398|MF|app-20190625005813-0084|3|4| END| 6.58|A.Points indexed | 0.17| 18093|0 2019-06-25 00:58:19,398|MF|app-20190625005813-0084|3|4|START| 6.59|B.Pairs found | 0.00| 0|0 2019-06-25 00:58:20,557|MF|app-20190625005813-0084|3|4| END| 7.74|B.Pairs found | 1.16| 39404|0 2019-06-25 00:58:20,557|MF|app-20190625005813-0084|3|4|START| 7.74|C.Centers found | 0.00| 0|0 2019-06-25 00:58:21,433|MF|app-20190625005813-0084|3|4| END| 8.62|C.Centers found | 0.88| 78808|0 2019-06-25 00:58:21,434|MF|app-20190625005813-0084|3|4|START| 8.62|D.Disks found | 0.00| 0|0 2019-06-25 00:58:24,731|MF|app-20190625005813-0084|3|4| END| 11.92|D.Disks found | 3.30| 35229|0 2019-06-25 00:58:24,731|MF|app-20190625005813-0084|3|4|START| 11.92|E.Disks partitioned | 0.00| 0|0 2019-06-25 00:58:25,934|MF|app-20190625005813-0084|3|4| END| 13.12|E.Disks partitioned | 1.20| 51442|0 2019-06-25 00:58:25,934|MF|app-20190625005813-0084|3|4|START| 13.12|F.Maximal disks found | 0.00| 0|0 2019-06-25 00:58:25,935|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:58:25,935|Cell area: 1055533.7681000116 2019-06-25 00:58:50,546|MF|app-20190625005813-0084|3|4| END| 37.73|F.Maximal disks found | 24.61| 10001|0 2019-06-25 00:58:50,546|MAXIMALS|app-20190625005813-0084|4|3|110.0|3|450|31.319|10001 2019-06-25 00:58:51,062|FF|app-20190625005813-0084|3|4| END| 38.25|1.Maximal disks found | 31.84| 10001|0 2019-06-25 00:58:51,062|FF|app-20190625005813-0084|3|4|START| 38.25|1.Maximal disks found | 0.00| 0|1 2019-06-25 00:58:51,063|MF|app-20190625005813-0084|3|4|START| 38.25|A.Points indexed | 0.00| 0|1 2019-06-25 00:58:51,137|MF|app-20190625005813-0084|3|4| END| 38.32|A.Points indexed | 0.08| 18245|1 2019-06-25 00:58:51,137|MF|app-20190625005813-0084|3|4|START| 38.32|B.Pairs found | 0.00| 0|1 2019-06-25 00:58:51,649|MF|app-20190625005813-0084|3|4| END| 38.84|B.Pairs found | 0.51| 39999|1 2019-06-25 00:58:51,649|MF|app-20190625005813-0084|3|4|START| 38.84|C.Centers found | 0.00| 0|1 2019-06-25 00:58:52,182|MF|app-20190625005813-0084|3|4| END| 39.37|C.Centers found | 0.53| 79998|1 2019-06-25 00:58:52,182|MF|app-20190625005813-0084|3|4|START| 39.37|D.Disks found | 0.00| 0|1 2019-06-25 00:58:54,636|MF|app-20190625005813-0084|3|4| END| 41.82|D.Disks found | 2.45| 35849|1 2019-06-25 00:58:54,636|MF|app-20190625005813-0084|3|4|START| 41.82|E.Disks partitioned | 0.00| 0|1 2019-06-25 00:58:55,425|MF|app-20190625005813-0084|3|4| END| 42.61|E.Disks partitioned | 0.79| 52317|1 2019-06-25 00:58:55,425|MF|app-20190625005813-0084|3|4|START| 42.61|F.Maximal disks found | 0.00| 0|1 2019-06-25 00:58:55,426|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:58:55,426|Cell area: 1055533.7681000116 2019-06-25 00:59:21,400|MF|app-20190625005813-0084|3|4| END| 68.59|F.Maximal disks found | 25.98| 10110|1 2019-06-25 00:59:21,400|MAXIMALS|app-20190625005813-0084|4|3|110.0|3|450|30.338|10110 2019-06-25 00:59:21,815|FF|app-20190625005813-0084|3|4| END| 69.00|1.Maximal disks found | 30.75| 10110|1 2019-06-25 00:59:21,815|FF|app-20190625005813-0084|3|4|START| 69.00|2.Join done | 0.00| 0|1 2019-06-25 00:59:24,182|FF|app-20190625005813-0084|3|4| END| 71.37|2.Join done | 2.37| 21993|1 2019-06-25 00:59:24,182|FF|app-20190625005813-0084|3|4|START| 71.37|3.Flocks to report | 0.00| 0|1 2019-06-25 00:59:24,596|FF|app-20190625005813-0084|3|4| END| 71.78|3.Flocks to report | 0.41| 0|1 2019-06-25 00:59:24,596|FF|app-20190625005813-0084|3|4|START| 71.78|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 00:59:24,627|FF|app-20190625005813-0084|3|4| END| 71.81|4.Flocks prunned by expansion | 0.03| 0|1 2019-06-25 00:59:24,628|FF|app-20190625005813-0084|3|4|START| 71.81|5.Flocks reported | 0.00| 0|1 2019-06-25 00:59:24,633|FF|app-20190625005813-0084|3|4| END| 71.82|5.Flocks reported | 0.01| 0|1 2019-06-25 00:59:24,633|FF|app-20190625005813-0084|3|4|START| 71.82|6.Candidates indexed | 0.00| 0|1 2019-06-25 00:59:26,177|FF|app-20190625005813-0084|3|4| END| 73.36|6.Candidates indexed | 1.54| 22599|1 2019-06-25 00:59:26,177|FF|app-20190625005813-0084|3|4|START| 73.36|1.Maximal disks found | 0.00| 0|2 2019-06-25 00:59:26,178|MF|app-20190625005813-0084|3|4|START| 73.37|A.Points indexed | 0.00| 0|2 2019-06-25 00:59:26,272|MF|app-20190625005813-0084|3|4| END| 73.46|A.Points indexed | 0.09| 18394|2 2019-06-25 00:59:26,272|MF|app-20190625005813-0084|3|4|START| 73.46|B.Pairs found | 0.00| 0|2 2019-06-25 00:59:26,682|MF|app-20190625005813-0084|3|4| END| 73.87|B.Pairs found | 0.41| 40566|2 2019-06-25 00:59:26,682|MF|app-20190625005813-0084|3|4|START| 73.87|C.Centers found | 0.00| 0|2 2019-06-25 00:59:27,157|MF|app-20190625005813-0084|3|4| END| 74.34|C.Centers found | 0.48| 81132|2 2019-06-25 00:59:27,157|MF|app-20190625005813-0084|3|4|START| 74.34|D.Disks found | 0.00| 0|2 2019-06-25 00:59:29,440|MF|app-20190625005813-0084|3|4| END| 76.63|D.Disks found | 2.28| 36353|2 2019-06-25 00:59:29,440|MF|app-20190625005813-0084|3|4|START| 76.63|E.Disks partitioned | 0.00| 0|2 2019-06-25 00:59:30,178|MF|app-20190625005813-0084|3|4| END| 77.37|E.Disks partitioned | 0.74| 53134|2 2019-06-25 00:59:30,178|MF|app-20190625005813-0084|3|4|START| 77.37|F.Maximal disks found | 0.00| 0|2 2019-06-25 00:59:30,178|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 00:59:30,178|Cell area: 1055533.7681000116 2019-06-25 00:59:55,499|MF|app-20190625005813-0084|3|4| END|102.69|F.Maximal disks found | 25.32| 10342|2 2019-06-25 00:59:55,499|MAXIMALS|app-20190625005813-0084|4|3|110.0|3|450|29.321|10342 2019-06-25 00:59:55,888|FF|app-20190625005813-0084|3|4| END|103.08|1.Maximal disks found | 29.71| 10342|2 2019-06-25 00:59:55,888|FF|app-20190625005813-0084|3|4|START|103.08|2.Join done | 0.00| 0|2 2019-06-25 01:00:10,246|FF|app-20190625005813-0084|3|4| END|117.43|2.Join done | 14.36| 45000|2 2019-06-25 01:00:10,246|FF|app-20190625005813-0084|3|4|START|117.43|3.Flocks to report | 0.00| 0|2 2019-06-25 01:00:11,959|FF|app-20190625005813-0084|3|4| END|119.15|3.Flocks to report | 1.71| 38432|2 2019-06-25 01:00:11,960|FF|app-20190625005813-0084|3|4|START|119.15|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 01:00:12,001|FF|app-20190625005813-0084|3|4|START|119.19|4a.Making expansions | 0.00| 0|2 2019-06-25 01:00:13,061|FF|app-20190625005813-0084|3|4| END|120.25|4a.Making expansions | 1.06| 48133|2 2019-06-25 01:00:13,061|FF|app-20190625005813-0084|3|4|START|120.25|4b.Finding maximals | 0.00| 0|2 2019-06-25 01:00:57,818|FF|app-20190625005813-0084|3|4| END|165.01|4b.Finding maximals | 44.76| 6601|2 2019-06-25 01:00:58,149|FF|app-20190625005813-0084|3|4| END|165.34|4.Flocks prunned by expansion | 46.19| 6601|2 2019-06-25 01:00:58,149|FF|app-20190625005813-0084|3|4|START|165.34|5.Flocks reported | 0.00| 0|2 2019-06-25 01:00:58,644|FF|app-20190625005813-0084|3|4| END|165.83|5.Flocks reported | 0.49| 6601|2 2019-06-25 01:00:58,644|FF|app-20190625005813-0084|3|4|START|165.83|6.Candidates indexed | 0.00| 0|2 2019-06-25 01:01:01,545|FF|app-20190625005813-0084|3|4| END|168.73|6.Candidates indexed | 2.90| 13819|2 2019-06-25 01:01:01,545|FF|app-20190625005813-0084|3|4|START|168.73|1.Maximal disks found | 0.00| 0|3 2019-06-25 01:01:01,545|MF|app-20190625005813-0084|3|4|START|168.73|A.Points indexed | 0.00| 0|3 2019-06-25 01:01:01,600|MF|app-20190625005813-0084|3|4| END|168.79|A.Points indexed | 0.06| 18548|3 2019-06-25 01:01:01,600|MF|app-20190625005813-0084|3|4|START|168.79|B.Pairs found | 0.00| 0|3 2019-06-25 01:01:02,148|MF|app-20190625005813-0084|3|4| END|169.34|B.Pairs found | 0.55| 41257|3 2019-06-25 01:01:02,148|MF|app-20190625005813-0084|3|4|START|169.34|C.Centers found | 0.00| 0|3 2019-06-25 01:01:02,670|MF|app-20190625005813-0084|3|4| END|169.86|C.Centers found | 0.52| 82514|3 2019-06-25 01:01:02,670|MF|app-20190625005813-0084|3|4|START|169.86|D.Disks found | 0.00| 0|3 2019-06-25 01:01:05,546|MF|app-20190625005813-0084|3|4| END|172.73|D.Disks found | 2.88| 37087|3 2019-06-25 01:01:05,546|MF|app-20190625005813-0084|3|4|START|172.73|E.Disks partitioned | 0.00| 0|3 2019-06-25 01:01:06,561|MF|app-20190625005813-0084|3|4| END|173.75|E.Disks partitioned | 1.02| 54196|3 2019-06-25 01:01:06,561|MF|app-20190625005813-0084|3|4|START|173.75|F.Maximal disks found | 0.00| 0|3 2019-06-25 01:01:06,562|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:01:06,562|Cell area: 1055533.7681000116 2019-06-25 01:01:38,789|MF|app-20190625005813-0084|3|4| END|205.98|F.Maximal disks found | 32.23| 10503|3 2019-06-25 01:01:38,789|MAXIMALS|app-20190625005813-0084|4|3|110.0|3|450|37.244|10503 2019-06-25 01:01:39,235|FF|app-20190625005813-0084|3|4| END|206.42|1.Maximal disks found | 37.69| 10503|3 2019-06-25 01:01:39,236|FF|app-20190625005813-0084|3|4|START|206.42|2.Join done | 0.00| 0|3 2019-06-25 01:01:45,228|FF|app-20190625005813-0084|3|4| END|212.42|2.Join done | 5.99| 45190|3 2019-06-25 01:01:45,228|FF|app-20190625005813-0084|3|4|START|212.42|3.Flocks to report | 0.00| 0|3 2019-06-25 01:01:46,332|FF|app-20190625005813-0084|3|4| END|213.52|3.Flocks to report | 1.10| 38589|3 2019-06-25 01:01:46,332|FF|app-20190625005813-0084|3|4|START|213.52|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 01:01:46,368|FF|app-20190625005813-0084|3|4|START|213.56|4a.Making expansions | 0.00| 0|3 2019-06-25 01:01:47,011|FF|app-20190625005813-0084|3|4| END|214.20|4a.Making expansions | 0.64| 47856|3 2019-06-25 01:01:47,011|FF|app-20190625005813-0084|3|4|START|214.20|4b.Finding maximals | 0.00| 0|3 2019-06-25 01:02:48,056|FF|app-20190625005813-0084|3|4| END|275.24|4b.Finding maximals | 61.05| 6669|3 2019-06-25 01:02:48,232|FF|app-20190625005813-0084|3|4| END|275.42|4.Flocks prunned by expansion | 61.90| 6669|3 2019-06-25 01:02:48,232|FF|app-20190625005813-0084|3|4|START|275.42|5.Flocks reported | 0.00| 0|3 2019-06-25 01:02:48,510|FF|app-20190625005813-0084|3|4| END|275.70|5.Flocks reported | 0.28| 6669|3 2019-06-25 01:02:48,510|FF|app-20190625005813-0084|3|4|START|275.70|6.Candidates indexed | 0.00| 0|3 2019-06-25 01:02:50,357|FF|app-20190625005813-0084|3|4| END|277.54|6.Candidates indexed | 1.85| 13927|3 2019-06-25 01:02:51,289|Number of flocks: 13270 2019-06-25 01:02:51,786|PFLOCK|app-20190625005813-0084|4|3|110.0|3|3|272.22|13270 2019-06-25 01:02:52,231|FF|app-20190625005813-0084|3|4| END|279.42|Flock Finder run |273.16| 13270|3 2019-06-25 01:02:52,232|FF|app-20190625005813-0084|3|4|START|279.42|Session closed | 0.00| 0|3 2019-06-25 01:02:58,249|FF|app-20190625005813-0084|3|4| END|285.44|Session closed | 6.02| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B4_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_grid-60x30.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 12 --fftimestamp 4 --portui 4040 --info 2019-06-25 01:03:00,195|FF|app-00000000000000-0000|12|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 01:03:01,310|FF|app-20190625010301-0085|12|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 01:03:01,311|FF|app-20190625010301-0085|12|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 01:03:04,408|FF|app-20190625010301-0085|12|4|START| 4.20|KDBTree partitioner | 0.00| 0|-1 2019-06-25 01:03:05,772|Sample size: 441504 2019-06-25 01:03:06,084|FF|app-20190625010301-0085|12|4| END| 5.87|KDBTree partitioner | 1.68| 1134|-1 2019-06-25 01:03:06,084|FF|app-20190625010301-0085|12|4|START| 5.87|MF partitioner | 0.00| 0|-1 2019-06-25 01:03:06,146|FF|app-20190625010301-0085|12|4| END| 5.94|MF partitioner | 0.06| 1800|-1 2019-06-25 01:03:08,057|FF|app-20190625010301-0085|12|4| END| 7.85|MF partitioner | 1.97|441504|-1 2019-06-25 01:03:08,057|FF|app-20190625010301-0085|12|4|START| 7.85|Flock Finder run | 0.00| 0|-1 2019-06-25 01:03:08,076|FF|app-20190625010301-0085|12|4|START| 7.87|1.Maximal disks found | 0.00| 0|0 2019-06-25 01:03:08,078|MF|app-20190625010301-0085|12|4|START| 7.87|A.Points indexed | 0.00| 0|0 2019-06-25 01:03:08,332|MF|app-20190625010301-0085|12|4| END| 8.12|A.Points indexed | 0.25| 72372|0 2019-06-25 01:03:08,333|MF|app-20190625010301-0085|12|4|START| 8.12|B.Pairs found | 0.00| 0|0 2019-06-25 01:03:10,125|MF|app-20190625010301-0085|12|4| END| 9.91|B.Pairs found | 1.79|135828|0 2019-06-25 01:03:10,125|MF|app-20190625010301-0085|12|4|START| 9.91|C.Centers found | 0.00| 0|0 2019-06-25 01:03:11,355|MF|app-20190625010301-0085|12|4| END| 11.14|C.Centers found | 1.23|271656|0 2019-06-25 01:03:11,355|MF|app-20190625010301-0085|12|4|START| 11.14|D.Disks found | 0.00| 0|0 2019-06-25 01:03:15,949|MF|app-20190625010301-0085|12|4| END| 15.74|D.Disks found | 4.59|114664|0 2019-06-25 01:03:15,949|MF|app-20190625010301-0085|12|4|START| 15.74|E.Disks partitioned | 0.00| 0|0 2019-06-25 01:03:17,493|MF|app-20190625010301-0085|12|4| END| 17.28|E.Disks partitioned | 1.54|162379|0 2019-06-25 01:03:17,494|MF|app-20190625010301-0085|12|4|START| 17.28|F.Maximal disks found | 0.00| 0|0 2019-06-25 01:03:17,496|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:03:17,496|Cell area: 1055533.7681000116 2019-06-25 01:03:28,285|MF|app-20190625010301-0085|12|4| END| 28.07|F.Maximal disks found | 10.79| 33494|0 2019-06-25 01:03:28,285|MAXIMALS|app-20190625010301-0085|4|12|100.0|3|1800|20.207|33494 2019-06-25 01:03:29,682|FF|app-20190625010301-0085|12|4| END| 29.47|1.Maximal disks found | 21.61| 33494|0 2019-06-25 01:03:29,682|FF|app-20190625010301-0085|12|4|START| 29.47|1.Maximal disks found | 0.00| 0|1 2019-06-25 01:03:29,682|MF|app-20190625010301-0085|12|4|START| 29.47|A.Points indexed | 0.00| 0|1 2019-06-25 01:03:29,811|MF|app-20190625010301-0085|12|4| END| 29.60|A.Points indexed | 0.13| 72980|1 2019-06-25 01:03:29,811|MF|app-20190625010301-0085|12|4|START| 29.60|B.Pairs found | 0.00| 0|1 2019-06-25 01:03:30,792|MF|app-20190625010301-0085|12|4| END| 30.58|B.Pairs found | 0.98|137848|1 2019-06-25 01:03:30,793|MF|app-20190625010301-0085|12|4|START| 30.58|C.Centers found | 0.00| 0|1 2019-06-25 01:03:31,599|MF|app-20190625010301-0085|12|4| END| 31.39|C.Centers found | 0.81|275696|1 2019-06-25 01:03:31,599|MF|app-20190625010301-0085|12|4|START| 31.39|D.Disks found | 0.00| 0|1 2019-06-25 01:03:35,209|MF|app-20190625010301-0085|12|4| END| 35.00|D.Disks found | 3.61|116464|1 2019-06-25 01:03:35,209|MF|app-20190625010301-0085|12|4|START| 35.00|E.Disks partitioned | 0.00| 0|1 2019-06-25 01:03:36,465|MF|app-20190625010301-0085|12|4| END| 36.25|E.Disks partitioned | 1.26|164834|1 2019-06-25 01:03:36,465|MF|app-20190625010301-0085|12|4|START| 36.25|F.Maximal disks found | 0.00| 0|1 2019-06-25 01:03:36,466|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:03:36,466|Cell area: 1055533.7681000116 2019-06-25 01:03:46,980|MF|app-20190625010301-0085|12|4| END| 46.77|F.Maximal disks found | 10.52| 34190|1 2019-06-25 01:03:46,980|MAXIMALS|app-20190625010301-0085|4|12|100.0|3|1800|17.298|34190 2019-06-25 01:03:48,312|FF|app-20190625010301-0085|12|4| END| 48.10|1.Maximal disks found | 18.63| 34190|1 2019-06-25 01:03:48,312|FF|app-20190625010301-0085|12|4|START| 48.10|2.Join done | 0.00| 0|1 2019-06-25 01:03:52,010|FF|app-20190625010301-0085|12|4| END| 51.80|2.Join done | 3.70| 68607|1 2019-06-25 01:03:52,010|FF|app-20190625010301-0085|12|4|START| 51.80|3.Flocks to report | 0.00| 0|1 2019-06-25 01:03:52,622|FF|app-20190625010301-0085|12|4| END| 52.41|3.Flocks to report | 0.61| 0|1 2019-06-25 01:03:52,622|FF|app-20190625010301-0085|12|4|START| 52.41|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 01:03:52,684|FF|app-20190625010301-0085|12|4| END| 52.47|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 01:03:52,684|FF|app-20190625010301-0085|12|4|START| 52.47|5.Flocks reported | 0.00| 0|1 2019-06-25 01:03:52,689|FF|app-20190625010301-0085|12|4| END| 52.48|5.Flocks reported | 0.01| 0|1 2019-06-25 01:03:52,689|FF|app-20190625010301-0085|12|4|START| 52.48|6.Candidates indexed | 0.00| 0|1 2019-06-25 01:03:54,589|FF|app-20190625010301-0085|12|4| END| 54.38|6.Candidates indexed | 1.90| 70591|1 2019-06-25 01:03:54,589|FF|app-20190625010301-0085|12|4|START| 54.38|1.Maximal disks found | 0.00| 0|2 2019-06-25 01:03:54,589|MF|app-20190625010301-0085|12|4|START| 54.38|A.Points indexed | 0.00| 0|2 2019-06-25 01:03:54,727|MF|app-20190625010301-0085|12|4| END| 54.52|A.Points indexed | 0.14| 73576|2 2019-06-25 01:03:54,727|MF|app-20190625010301-0085|12|4|START| 54.52|B.Pairs found | 0.00| 0|2 2019-06-25 01:03:55,474|MF|app-20190625010301-0085|12|4| END| 55.26|B.Pairs found | 0.75|139672|2 2019-06-25 01:03:55,474|MF|app-20190625010301-0085|12|4|START| 55.26|C.Centers found | 0.00| 0|2 2019-06-25 01:03:56,353|MF|app-20190625010301-0085|12|4| END| 56.14|C.Centers found | 0.88|279344|2 2019-06-25 01:03:56,353|MF|app-20190625010301-0085|12|4|START| 56.14|D.Disks found | 0.00| 0|2 2019-06-25 01:03:59,750|MF|app-20190625010301-0085|12|4| END| 59.54|D.Disks found | 3.40|118196|2 2019-06-25 01:03:59,750|MF|app-20190625010301-0085|12|4|START| 59.54|E.Disks partitioned | 0.00| 0|2 2019-06-25 01:04:01,290|MF|app-20190625010301-0085|12|4| END| 61.08|E.Disks partitioned | 1.54|167618|2 2019-06-25 01:04:01,290|MF|app-20190625010301-0085|12|4|START| 61.08|F.Maximal disks found | 0.00| 0|2 2019-06-25 01:04:01,291|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:04:01,291|Cell area: 1055533.7681000116 2019-06-25 01:04:11,908|MF|app-20190625010301-0085|12|4| END| 71.70|F.Maximal disks found | 10.62| 34747|2 2019-06-25 01:04:11,908|MAXIMALS|app-20190625010301-0085|4|12|100.0|3|1800|17.319|34747 2019-06-25 01:04:13,241|FF|app-20190625010301-0085|12|4| END| 73.03|1.Maximal disks found | 18.65| 34747|2 2019-06-25 01:04:13,241|FF|app-20190625010301-0085|12|4|START| 73.03|2.Join done | 0.00| 0|2 2019-06-25 01:04:20,161|FF|app-20190625010301-0085|12|4| END| 79.95|2.Join done | 6.92|130927|2 2019-06-25 01:04:20,161|FF|app-20190625010301-0085|12|4|START| 79.95|3.Flocks to report | 0.00| 0|2 2019-06-25 01:04:20,903|FF|app-20190625010301-0085|12|4| END| 80.69|3.Flocks to report | 0.74|111724|2 2019-06-25 01:04:20,903|FF|app-20190625010301-0085|12|4|START| 80.69|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 01:04:20,967|FF|app-20190625010301-0085|12|4|START| 80.76|4a.Making expansions | 0.00| 0|2 2019-06-25 01:04:21,889|FF|app-20190625010301-0085|12|4| END| 81.68|4a.Making expansions | 0.92|139034|2 2019-06-25 01:04:21,889|FF|app-20190625010301-0085|12|4|START| 81.68|4b.Finding maximals | 0.00| 0|2 2019-06-25 01:04:38,460|FF|app-20190625010301-0085|12|4| END| 98.25|4b.Finding maximals | 16.57| 22788|2 2019-06-25 01:04:39,123|FF|app-20190625010301-0085|12|4| END| 98.91|4.Flocks prunned by expansion | 18.22| 22788|2 2019-06-25 01:04:39,123|FF|app-20190625010301-0085|12|4|START| 98.91|5.Flocks reported | 0.00| 0|2 2019-06-25 01:04:39,872|FF|app-20190625010301-0085|12|4| END| 99.66|5.Flocks reported | 0.75| 22788|2 2019-06-25 01:04:39,872|FF|app-20190625010301-0085|12|4|START| 99.66|6.Candidates indexed | 0.00| 0|2 2019-06-25 01:04:42,110|FF|app-20190625010301-0085|12|4| END|101.90|6.Candidates indexed | 2.24| 44305|2 2019-06-25 01:04:42,110|FF|app-20190625010301-0085|12|4|START|101.90|1.Maximal disks found | 0.00| 0|3 2019-06-25 01:04:42,111|MF|app-20190625010301-0085|12|4|START|101.90|A.Points indexed | 0.00| 0|3 2019-06-25 01:04:42,240|MF|app-20190625010301-0085|12|4| END|102.03|A.Points indexed | 0.13| 74192|3 2019-06-25 01:04:42,240|MF|app-20190625010301-0085|12|4|START|102.03|B.Pairs found | 0.00| 0|3 2019-06-25 01:04:42,963|MF|app-20190625010301-0085|12|4| END|102.75|B.Pairs found | 0.72|142060|3 2019-06-25 01:04:42,963|MF|app-20190625010301-0085|12|4|START|102.75|C.Centers found | 0.00| 0|3 2019-06-25 01:04:43,757|MF|app-20190625010301-0085|12|4| END|103.55|C.Centers found | 0.79|284120|3 2019-06-25 01:04:43,758|MF|app-20190625010301-0085|12|4|START|103.55|D.Disks found | 0.00| 0|3 2019-06-25 01:04:47,077|MF|app-20190625010301-0085|12|4| END|106.87|D.Disks found | 3.32|120568|3 2019-06-25 01:04:47,077|MF|app-20190625010301-0085|12|4|START|106.87|E.Disks partitioned | 0.00| 0|3 2019-06-25 01:04:48,494|MF|app-20190625010301-0085|12|4| END|108.28|E.Disks partitioned | 1.42|171019|3 2019-06-25 01:04:48,494|MF|app-20190625010301-0085|12|4|START|108.28|F.Maximal disks found | 0.00| 0|3 2019-06-25 01:04:48,495|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:04:48,495|Cell area: 1055533.7681000116 2019-06-25 01:05:01,662|MF|app-20190625010301-0085|12|4| END|121.45|F.Maximal disks found | 13.17| 35397|3 2019-06-25 01:05:01,663|MAXIMALS|app-20190625010301-0085|4|12|100.0|3|1800|19.551|35397 2019-06-25 01:05:03,010|FF|app-20190625010301-0085|12|4| END|122.80|1.Maximal disks found | 20.90| 35397|3 2019-06-25 01:05:03,010|FF|app-20190625010301-0085|12|4|START|122.80|2.Join done | 0.00| 0|3 2019-06-25 01:05:07,387|FF|app-20190625010301-0085|12|4| END|127.18|2.Join done | 4.38|120806|3 2019-06-25 01:05:07,387|FF|app-20190625010301-0085|12|4|START|127.18|3.Flocks to report | 0.00| 0|3 2019-06-25 01:05:08,168|FF|app-20190625010301-0085|12|4| END|127.96|3.Flocks to report | 0.78|101402|3 2019-06-25 01:05:08,168|FF|app-20190625010301-0085|12|4|START|127.96|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 01:05:08,231|FF|app-20190625010301-0085|12|4|START|128.02|4a.Making expansions | 0.00| 0|3 2019-06-25 01:05:09,160|FF|app-20190625010301-0085|12|4| END|128.95|4a.Making expansions | 0.93|129138|3 2019-06-25 01:05:09,160|FF|app-20190625010301-0085|12|4|START|128.95|4b.Finding maximals | 0.00| 0|3 2019-06-25 01:05:21,284|FF|app-20190625010301-0085|12|4| END|141.07|4b.Finding maximals | 12.12| 23068|3 2019-06-25 01:05:21,922|FF|app-20190625010301-0085|12|4| END|141.71|4.Flocks prunned by expansion | 13.75| 23068|3 2019-06-25 01:05:21,922|FF|app-20190625010301-0085|12|4|START|141.71|5.Flocks reported | 0.00| 0|3 2019-06-25 01:05:22,696|FF|app-20190625010301-0085|12|4| END|142.49|5.Flocks reported | 0.77| 23068|3 2019-06-25 01:05:22,696|FF|app-20190625010301-0085|12|4|START|142.49|6.Candidates indexed | 0.00| 0|3 2019-06-25 01:05:24,997|FF|app-20190625010301-0085|12|4| END|144.79|6.Candidates indexed | 2.30| 44638|3 2019-06-25 01:05:26,815|Number of flocks: 45856 2019-06-25 01:05:28,013|PFLOCK|app-20190625010301-0085|4|12|100.0|3|3|138.76|45856 2019-06-25 01:05:29,248|FF|app-20190625010301-0085|12|4| END|149.04|Flock Finder run |141.19| 45856|3 2019-06-25 01:05:29,248|FF|app-20190625010301-0085|12|4|START|149.04|Session closed | 0.00| 0|3 2019-06-25 01:05:40,297|FF|app-20190625010301-0085|12|4| END|160.09|Session closed | 11.05| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 6 --fftimestamp 4 --portui 4040 --info 2019-06-25 01:05:41,941|FF|app-00000000000000-0000|6|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 01:05:43,055|FF|app-20190625010542-0086|6|4| END| 1.10|Session start | 1.12| 0|-1 2019-06-25 01:05:43,055|FF|app-20190625010542-0086|6|4|START| 1.10|Data read | 0.00| 0|-1 2019-06-25 01:05:46,045|FF|app-20190625010542-0086|6|4|START| 4.09|KDBTree partitioner | 0.00| 0|-1 2019-06-25 01:05:47,190|Sample size: 220752 2019-06-25 01:05:47,328|FF|app-20190625010542-0086|6|4| END| 5.37|KDBTree partitioner | 1.28| 557|-1 2019-06-25 01:05:47,328|FF|app-20190625010542-0086|6|4|START| 5.37|MF partitioner | 0.00| 0|-1 2019-06-25 01:05:47,364|FF|app-20190625010542-0086|6|4| END| 5.41|MF partitioner | 0.04| 900|-1 2019-06-25 01:05:48,844|FF|app-20190625010542-0086|6|4| END| 6.89|MF partitioner | 1.52|220752|-1 2019-06-25 01:05:48,844|FF|app-20190625010542-0086|6|4|START| 6.89|Flock Finder run | 0.00| 0|-1 2019-06-25 01:05:48,862|FF|app-20190625010542-0086|6|4|START| 6.91|1.Maximal disks found | 0.00| 0|0 2019-06-25 01:05:48,865|MF|app-20190625010542-0086|6|4|START| 6.91|A.Points indexed | 0.00| 0|0 2019-06-25 01:05:49,077|MF|app-20190625010542-0086|6|4| END| 7.12|A.Points indexed | 0.21| 36186|0 2019-06-25 01:05:49,078|MF|app-20190625010542-0086|6|4|START| 7.12|B.Pairs found | 0.00| 0|0 2019-06-25 01:05:50,660|MF|app-20190625010542-0086|6|4| END| 8.70|B.Pairs found | 1.58| 67914|0 2019-06-25 01:05:50,660|MF|app-20190625010542-0086|6|4|START| 8.70|C.Centers found | 0.00| 0|0 2019-06-25 01:05:51,777|MF|app-20190625010542-0086|6|4| END| 9.82|C.Centers found | 1.12|135828|0 2019-06-25 01:05:51,777|MF|app-20190625010542-0086|6|4|START| 9.82|D.Disks found | 0.00| 0|0 2019-06-25 01:05:56,576|MF|app-20190625010542-0086|6|4| END| 14.62|D.Disks found | 4.80| 57332|0 2019-06-25 01:05:56,576|MF|app-20190625010542-0086|6|4|START| 14.62|E.Disks partitioned | 0.00| 0|0 2019-06-25 01:05:58,815|MF|app-20190625010542-0086|6|4| END| 16.86|E.Disks partitioned | 2.24| 81114|0 2019-06-25 01:05:58,815|MF|app-20190625010542-0086|6|4|START| 16.86|F.Maximal disks found | 0.00| 0|0 2019-06-25 01:05:58,817|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:05:58,817|Cell area: 1055533.7681000116 2019-06-25 01:06:09,435|MF|app-20190625010542-0086|6|4| END| 27.48|F.Maximal disks found | 10.62| 16742|0 2019-06-25 01:06:09,435|MAXIMALS|app-20190625010542-0086|4|6|100.0|3|900|20.57|16742 2019-06-25 01:06:10,440|FF|app-20190625010542-0086|6|4| END| 28.48|1.Maximal disks found | 21.58| 16742|0 2019-06-25 01:06:10,441|FF|app-20190625010542-0086|6|4|START| 28.48|1.Maximal disks found | 0.00| 0|1 2019-06-25 01:06:10,441|MF|app-20190625010542-0086|6|4|START| 28.48|A.Points indexed | 0.00| 0|1 2019-06-25 01:06:10,533|MF|app-20190625010542-0086|6|4| END| 28.58|A.Points indexed | 0.09| 36490|1 2019-06-25 01:06:10,533|MF|app-20190625010542-0086|6|4|START| 28.58|B.Pairs found | 0.00| 0|1 2019-06-25 01:06:11,459|MF|app-20190625010542-0086|6|4| END| 29.50|B.Pairs found | 0.93| 68924|1 2019-06-25 01:06:11,459|MF|app-20190625010542-0086|6|4|START| 29.50|C.Centers found | 0.00| 0|1 2019-06-25 01:06:12,076|MF|app-20190625010542-0086|6|4| END| 30.12|C.Centers found | 0.62|137848|1 2019-06-25 01:06:12,076|MF|app-20190625010542-0086|6|4|START| 30.12|D.Disks found | 0.00| 0|1 2019-06-25 01:06:16,320|MF|app-20190625010542-0086|6|4| END| 34.36|D.Disks found | 4.24| 58232|1 2019-06-25 01:06:16,320|MF|app-20190625010542-0086|6|4|START| 34.36|E.Disks partitioned | 0.00| 0|1 2019-06-25 01:06:18,258|MF|app-20190625010542-0086|6|4| END| 36.30|E.Disks partitioned | 1.94| 82341|1 2019-06-25 01:06:18,258|MF|app-20190625010542-0086|6|4|START| 36.30|F.Maximal disks found | 0.00| 0|1 2019-06-25 01:06:18,259|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:06:18,259|Cell area: 1055533.7681000116 2019-06-25 01:06:28,455|MF|app-20190625010542-0086|6|4| END| 46.50|F.Maximal disks found | 10.20| 17096|1 2019-06-25 01:06:28,455|MAXIMALS|app-20190625010542-0086|4|6|100.0|3|900|18.014|17096 2019-06-25 01:06:29,343|FF|app-20190625010542-0086|6|4| END| 47.39|1.Maximal disks found | 18.90| 17096|1 2019-06-25 01:06:29,343|FF|app-20190625010542-0086|6|4|START| 47.39|2.Join done | 0.00| 0|1 2019-06-25 01:06:34,308|FF|app-20190625010542-0086|6|4| END| 52.35|2.Join done | 4.97| 34283|1 2019-06-25 01:06:34,308|FF|app-20190625010542-0086|6|4|START| 52.35|3.Flocks to report | 0.00| 0|1 2019-06-25 01:06:35,119|FF|app-20190625010542-0086|6|4| END| 53.16|3.Flocks to report | 0.81| 0|1 2019-06-25 01:06:35,119|FF|app-20190625010542-0086|6|4|START| 53.16|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 01:06:35,163|FF|app-20190625010542-0086|6|4| END| 53.21|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 01:06:35,163|FF|app-20190625010542-0086|6|4|START| 53.21|5.Flocks reported | 0.00| 0|1 2019-06-25 01:06:35,168|FF|app-20190625010542-0086|6|4| END| 53.21|5.Flocks reported | 0.01| 0|1 2019-06-25 01:06:35,169|FF|app-20190625010542-0086|6|4|START| 53.21|6.Candidates indexed | 0.00| 0|1 2019-06-25 01:06:38,774|FF|app-20190625010542-0086|6|4| END| 56.82|6.Candidates indexed | 3.61| 35275|1 2019-06-25 01:06:38,774|FF|app-20190625010542-0086|6|4|START| 56.82|1.Maximal disks found | 0.00| 0|2 2019-06-25 01:06:38,774|MF|app-20190625010542-0086|6|4|START| 56.82|A.Points indexed | 0.00| 0|2 2019-06-25 01:06:38,855|MF|app-20190625010542-0086|6|4| END| 56.90|A.Points indexed | 0.08| 36788|2 2019-06-25 01:06:38,856|MF|app-20190625010542-0086|6|4|START| 56.90|B.Pairs found | 0.00| 0|2 2019-06-25 01:06:39,719|MF|app-20190625010542-0086|6|4| END| 57.76|B.Pairs found | 0.86| 69836|2 2019-06-25 01:06:39,719|MF|app-20190625010542-0086|6|4|START| 57.76|C.Centers found | 0.00| 0|2 2019-06-25 01:06:40,504|MF|app-20190625010542-0086|6|4| END| 58.55|C.Centers found | 0.78|139672|2 2019-06-25 01:06:40,504|MF|app-20190625010542-0086|6|4|START| 58.55|D.Disks found | 0.00| 0|2 2019-06-25 01:06:44,924|MF|app-20190625010542-0086|6|4| END| 62.97|D.Disks found | 4.42| 59098|2 2019-06-25 01:06:44,924|MF|app-20190625010542-0086|6|4|START| 62.97|E.Disks partitioned | 0.00| 0|2 2019-06-25 01:06:47,040|MF|app-20190625010542-0086|6|4| END| 65.08|E.Disks partitioned | 2.12| 83724|2 2019-06-25 01:06:47,040|MF|app-20190625010542-0086|6|4|START| 65.08|F.Maximal disks found | 0.00| 0|2 2019-06-25 01:06:47,041|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:06:47,041|Cell area: 1055533.7681000116 2019-06-25 01:06:58,103|MF|app-20190625010542-0086|6|4| END| 76.15|F.Maximal disks found | 11.06| 17376|2 2019-06-25 01:06:58,103|MAXIMALS|app-20190625010542-0086|4|6|100.0|3|900|19.329|17376 2019-06-25 01:06:58,967|FF|app-20190625010542-0086|6|4| END| 77.01|1.Maximal disks found | 20.19| 17376|2 2019-06-25 01:06:58,967|FF|app-20190625010542-0086|6|4|START| 77.01|2.Join done | 0.00| 0|2 2019-06-25 01:07:09,540|FF|app-20190625010542-0086|6|4| END| 87.58|2.Join done | 10.57| 65349|2 2019-06-25 01:07:09,541|FF|app-20190625010542-0086|6|4|START| 87.58|3.Flocks to report | 0.00| 0|2 2019-06-25 01:07:11,010|FF|app-20190625010542-0086|6|4| END| 89.05|3.Flocks to report | 1.47| 55752|2 2019-06-25 01:07:11,010|FF|app-20190625010542-0086|6|4|START| 89.05|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 01:07:11,057|FF|app-20190625010542-0086|6|4|START| 89.10|4a.Making expansions | 0.00| 0|2 2019-06-25 01:07:12,315|FF|app-20190625010542-0086|6|4| END| 90.36|4a.Making expansions | 1.26| 69258|2 2019-06-25 01:07:12,315|FF|app-20190625010542-0086|6|4|START| 90.36|4b.Finding maximals | 0.00| 0|2 2019-06-25 01:07:25,650|FF|app-20190625010542-0086|6|4| END|103.69|4b.Finding maximals | 13.34| 11394|2 2019-06-25 01:07:26,013|FF|app-20190625010542-0086|6|4| END|104.06|4.Flocks prunned by expansion | 15.00| 11394|2 2019-06-25 01:07:26,013|FF|app-20190625010542-0086|6|4|START|104.06|5.Flocks reported | 0.00| 0|2 2019-06-25 01:07:26,591|FF|app-20190625010542-0086|6|4| END|104.63|5.Flocks reported | 0.58| 11394|2 2019-06-25 01:07:26,591|FF|app-20190625010542-0086|6|4|START|104.63|6.Candidates indexed | 0.00| 0|2 2019-06-25 01:07:29,332|FF|app-20190625010542-0086|6|4| END|107.38|6.Candidates indexed | 2.74| 22156|2 2019-06-25 01:07:29,332|FF|app-20190625010542-0086|6|4|START|107.38|1.Maximal disks found | 0.00| 0|3 2019-06-25 01:07:29,332|MF|app-20190625010542-0086|6|4|START|107.38|A.Points indexed | 0.00| 0|3 2019-06-25 01:07:29,407|MF|app-20190625010542-0086|6|4| END|107.45|A.Points indexed | 0.08| 37096|3 2019-06-25 01:07:29,408|MF|app-20190625010542-0086|6|4|START|107.45|B.Pairs found | 0.00| 0|3 2019-06-25 01:07:30,073|MF|app-20190625010542-0086|6|4| END|108.12|B.Pairs found | 0.67| 71030|3 2019-06-25 01:07:30,073|MF|app-20190625010542-0086|6|4|START|108.12|C.Centers found | 0.00| 0|3 2019-06-25 01:07:30,866|MF|app-20190625010542-0086|6|4| END|108.91|C.Centers found | 0.79|142060|3 2019-06-25 01:07:30,867|MF|app-20190625010542-0086|6|4|START|108.91|D.Disks found | 0.00| 0|3 2019-06-25 01:07:34,776|MF|app-20190625010542-0086|6|4| END|112.82|D.Disks found | 3.91| 60284|3 2019-06-25 01:07:34,776|MF|app-20190625010542-0086|6|4|START|112.82|E.Disks partitioned | 0.00| 0|3 2019-06-25 01:07:36,517|MF|app-20190625010542-0086|6|4| END|114.56|E.Disks partitioned | 1.74| 85409|3 2019-06-25 01:07:36,518|MF|app-20190625010542-0086|6|4|START|114.56|F.Maximal disks found | 0.00| 0|3 2019-06-25 01:07:36,518|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:07:36,518|Cell area: 1055533.7681000116 2019-06-25 01:07:48,873|MF|app-20190625010542-0086|6|4| END|126.92|F.Maximal disks found | 12.36| 17693|3 2019-06-25 01:07:48,873|MAXIMALS|app-20190625010542-0086|4|6|100.0|3|900|19.541|17693 2019-06-25 01:07:49,777|FF|app-20190625010542-0086|6|4| END|127.82|1.Maximal disks found | 20.45| 17693|3 2019-06-25 01:07:49,777|FF|app-20190625010542-0086|6|4|START|127.82|2.Join done | 0.00| 0|3 2019-06-25 01:07:56,620|FF|app-20190625010542-0086|6|4| END|134.66|2.Join done | 6.84| 60345|3 2019-06-25 01:07:56,620|FF|app-20190625010542-0086|6|4|START|134.66|3.Flocks to report | 0.00| 0|3 2019-06-25 01:07:58,039|FF|app-20190625010542-0086|6|4| END|136.08|3.Flocks to report | 1.42| 50609|3 2019-06-25 01:07:58,039|FF|app-20190625010542-0086|6|4|START|136.08|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 01:07:58,087|FF|app-20190625010542-0086|6|4|START|136.13|4a.Making expansions | 0.00| 0|3 2019-06-25 01:07:59,330|FF|app-20190625010542-0086|6|4| END|137.37|4a.Making expansions | 1.24| 64352|3 2019-06-25 01:07:59,330|FF|app-20190625010542-0086|6|4|START|137.37|4b.Finding maximals | 0.00| 0|3 2019-06-25 01:08:11,203|FF|app-20190625010542-0086|6|4| END|149.25|4b.Finding maximals | 11.87| 11534|3 2019-06-25 01:08:11,581|FF|app-20190625010542-0086|6|4| END|149.62|4.Flocks prunned by expansion | 13.54| 11534|3 2019-06-25 01:08:11,581|FF|app-20190625010542-0086|6|4|START|149.62|5.Flocks reported | 0.00| 0|3 2019-06-25 01:08:12,151|FF|app-20190625010542-0086|6|4| END|150.19|5.Flocks reported | 0.57| 11534|3 2019-06-25 01:08:12,151|FF|app-20190625010542-0086|6|4|START|150.19|6.Candidates indexed | 0.00| 0|3 2019-06-25 01:08:14,407|FF|app-20190625010542-0086|6|4| END|152.45|6.Candidates indexed | 2.26| 22352|3 2019-06-25 01:08:15,711|Number of flocks: 22928 2019-06-25 01:08:16,511|PFLOCK|app-20190625010542-0086|4|6|100.0|3|3|146.87|22928 2019-06-25 01:08:17,280|FF|app-20190625010542-0086|6|4| END|155.32|Flock Finder run |148.44| 22928|3 2019-06-25 01:08:17,280|FF|app-20190625010542-0086|6|4|START|155.32|Session closed | 0.00| 0|3 2019-06-25 01:08:23,570|FF|app-20190625010542-0086|6|4| END|161.61|Session closed | 6.29| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --epsilon 100 --mu 3 --delta 3 --distance 75 --master driver --cores 4 --executors 3 --fftimestamp 4 --portui 4040 --info 2019-06-25 01:08:25,536|FF|app-00000000000000-0000|3|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 01:08:26,640|FF|app-20190625010826-0087|3|4| END| 1.09|Session start | 1.11| 0|-1 2019-06-25 01:08:26,641|FF|app-20190625010826-0087|3|4|START| 1.09|Data read | 0.00| 0|-1 2019-06-25 01:08:29,554|FF|app-20190625010826-0087|3|4|START| 4.00|KDBTree partitioner | 0.00| 0|-1 2019-06-25 01:08:30,201|Sample size: 110376 2019-06-25 01:08:30,278|FF|app-20190625010826-0087|3|4| END| 4.73|KDBTree partitioner | 0.73| 280|-1 2019-06-25 01:08:30,278|FF|app-20190625010826-0087|3|4|START| 4.73|MF partitioner | 0.00| 0|-1 2019-06-25 01:08:30,307|FF|app-20190625010826-0087|3|4| END| 4.75|MF partitioner | 0.03| 450|-1 2019-06-25 01:08:31,853|FF|app-20190625010826-0087|3|4| END| 6.30|MF partitioner | 1.58|110376|-1 2019-06-25 01:08:31,853|FF|app-20190625010826-0087|3|4|START| 6.30|Flock Finder run | 0.00| 0|-1 2019-06-25 01:08:31,874|FF|app-20190625010826-0087|3|4|START| 6.32|1.Maximal disks found | 0.00| 0|0 2019-06-25 01:08:31,878|MF|app-20190625010826-0087|3|4|START| 6.33|A.Points indexed | 0.00| 0|0 2019-06-25 01:08:32,030|MF|app-20190625010826-0087|3|4| END| 6.48|A.Points indexed | 0.15| 18093|0 2019-06-25 01:08:32,030|MF|app-20190625010826-0087|3|4|START| 6.48|B.Pairs found | 0.00| 0|0 2019-06-25 01:08:33,183|MF|app-20190625010826-0087|3|4| END| 7.63|B.Pairs found | 1.15| 33957|0 2019-06-25 01:08:33,184|MF|app-20190625010826-0087|3|4|START| 7.63|C.Centers found | 0.00| 0|0 2019-06-25 01:08:34,051|MF|app-20190625010826-0087|3|4| END| 8.50|C.Centers found | 0.87| 67914|0 2019-06-25 01:08:34,051|MF|app-20190625010826-0087|3|4|START| 8.50|D.Disks found | 0.00| 0|0 2019-06-25 01:08:37,241|MF|app-20190625010826-0087|3|4| END| 11.69|D.Disks found | 3.19| 28666|0 2019-06-25 01:08:37,242|MF|app-20190625010826-0087|3|4|START| 11.69|E.Disks partitioned | 0.00| 0|0 2019-06-25 01:08:38,176|MF|app-20190625010826-0087|3|4| END| 12.62|E.Disks partitioned | 0.93| 40550|0 2019-06-25 01:08:38,176|MF|app-20190625010826-0087|3|4|START| 12.62|F.Maximal disks found | 0.00| 0|0 2019-06-25 01:08:38,178|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:08:38,178|Cell area: 1055533.7681000116 2019-06-25 01:08:48,450|MF|app-20190625010826-0087|3|4| END| 22.90|F.Maximal disks found | 10.27| 8371|0 2019-06-25 01:08:48,450|MAXIMALS|app-20190625010826-0087|4|3|100.0|3|450|16.572|8371 2019-06-25 01:08:48,963|FF|app-20190625010826-0087|3|4| END| 23.41|1.Maximal disks found | 17.09| 8371|0 2019-06-25 01:08:48,963|FF|app-20190625010826-0087|3|4|START| 23.41|1.Maximal disks found | 0.00| 0|1 2019-06-25 01:08:48,963|MF|app-20190625010826-0087|3|4|START| 23.41|A.Points indexed | 0.00| 0|1 2019-06-25 01:08:49,037|MF|app-20190625010826-0087|3|4| END| 23.48|A.Points indexed | 0.07| 18245|1 2019-06-25 01:08:49,037|MF|app-20190625010826-0087|3|4|START| 23.48|B.Pairs found | 0.00| 0|1 2019-06-25 01:08:49,546|MF|app-20190625010826-0087|3|4| END| 23.99|B.Pairs found | 0.51| 34462|1 2019-06-25 01:08:49,546|MF|app-20190625010826-0087|3|4|START| 23.99|C.Centers found | 0.00| 0|1 2019-06-25 01:08:50,110|MF|app-20190625010826-0087|3|4| END| 24.56|C.Centers found | 0.56| 68924|1 2019-06-25 01:08:50,110|MF|app-20190625010826-0087|3|4|START| 24.56|D.Disks found | 0.00| 0|1 2019-06-25 01:08:52,403|MF|app-20190625010826-0087|3|4| END| 26.85|D.Disks found | 2.29| 29116|1 2019-06-25 01:08:52,403|MF|app-20190625010826-0087|3|4|START| 26.85|E.Disks partitioned | 0.00| 0|1 2019-06-25 01:08:53,098|MF|app-20190625010826-0087|3|4| END| 27.55|E.Disks partitioned | 0.70| 41162|1 2019-06-25 01:08:53,098|MF|app-20190625010826-0087|3|4|START| 27.55|F.Maximal disks found | 0.00| 0|1 2019-06-25 01:08:53,099|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:08:53,099|Cell area: 1055533.7681000116 2019-06-25 01:09:02,292|MF|app-20190625010826-0087|3|4| END| 36.74|F.Maximal disks found | 9.19| 8547|1 2019-06-25 01:09:02,292|MAXIMALS|app-20190625010826-0087|4|3|100.0|3|450|13.329|8547 2019-06-25 01:09:02,687|FF|app-20190625010826-0087|3|4| END| 37.13|1.Maximal disks found | 13.72| 8547|1 2019-06-25 01:09:02,687|FF|app-20190625010826-0087|3|4|START| 37.13|2.Join done | 0.00| 0|1 2019-06-25 01:09:04,936|FF|app-20190625010826-0087|3|4| END| 39.38|2.Join done | 2.25| 17137|1 2019-06-25 01:09:04,936|FF|app-20190625010826-0087|3|4|START| 39.38|3.Flocks to report | 0.00| 0|1 2019-06-25 01:09:05,306|FF|app-20190625010826-0087|3|4| END| 39.75|3.Flocks to report | 0.37| 0|1 2019-06-25 01:09:05,306|FF|app-20190625010826-0087|3|4|START| 39.75|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 01:09:05,335|FF|app-20190625010826-0087|3|4| END| 39.78|4.Flocks prunned by expansion | 0.03| 0|1 2019-06-25 01:09:05,335|FF|app-20190625010826-0087|3|4|START| 39.78|5.Flocks reported | 0.00| 0|1 2019-06-25 01:09:05,339|FF|app-20190625010826-0087|3|4| END| 39.79|5.Flocks reported | 0.00| 0|1 2019-06-25 01:09:05,339|FF|app-20190625010826-0087|3|4|START| 39.79|6.Candidates indexed | 0.00| 0|1 2019-06-25 01:09:06,728|FF|app-20190625010826-0087|3|4| END| 41.18|6.Candidates indexed | 1.39| 17633|1 2019-06-25 01:09:06,729|FF|app-20190625010826-0087|3|4|START| 41.18|1.Maximal disks found | 0.00| 0|2 2019-06-25 01:09:06,729|MF|app-20190625010826-0087|3|4|START| 41.18|A.Points indexed | 0.00| 0|2 2019-06-25 01:09:06,788|MF|app-20190625010826-0087|3|4| END| 41.24|A.Points indexed | 0.06| 18394|2 2019-06-25 01:09:06,788|MF|app-20190625010826-0087|3|4|START| 41.24|B.Pairs found | 0.00| 0|2 2019-06-25 01:09:07,261|MF|app-20190625010826-0087|3|4| END| 41.71|B.Pairs found | 0.47| 34918|2 2019-06-25 01:09:07,261|MF|app-20190625010826-0087|3|4|START| 41.71|C.Centers found | 0.00| 0|2 2019-06-25 01:09:07,753|MF|app-20190625010826-0087|3|4| END| 42.20|C.Centers found | 0.49| 69836|2 2019-06-25 01:09:07,753|MF|app-20190625010826-0087|3|4|START| 42.20|D.Disks found | 0.00| 0|2 2019-06-25 01:09:09,927|MF|app-20190625010826-0087|3|4| END| 44.37|D.Disks found | 2.17| 29549|2 2019-06-25 01:09:09,927|MF|app-20190625010826-0087|3|4|START| 44.37|E.Disks partitioned | 0.00| 0|2 2019-06-25 01:09:10,678|MF|app-20190625010826-0087|3|4| END| 45.13|E.Disks partitioned | 0.75| 41840|2 2019-06-25 01:09:10,679|MF|app-20190625010826-0087|3|4|START| 45.13|F.Maximal disks found | 0.00| 0|2 2019-06-25 01:09:10,679|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:09:10,679|Cell area: 1055533.7681000116 2019-06-25 01:09:20,283|MF|app-20190625010826-0087|3|4| END| 54.73|F.Maximal disks found | 9.60| 8685|2 2019-06-25 01:09:20,283|MAXIMALS|app-20190625010826-0087|4|3|100.0|3|450|13.554|8685 2019-06-25 01:09:20,667|FF|app-20190625010826-0087|3|4| END| 55.11|1.Maximal disks found | 13.94| 8685|2 2019-06-25 01:09:20,668|FF|app-20190625010826-0087|3|4|START| 55.11|2.Join done | 0.00| 0|2 2019-06-25 01:09:29,675|FF|app-20190625010826-0087|3|4| END| 64.12|2.Join done | 9.01| 32675|2 2019-06-25 01:09:29,675|FF|app-20190625010826-0087|3|4|START| 64.12|3.Flocks to report | 0.00| 0|2 2019-06-25 01:09:31,098|FF|app-20190625010826-0087|3|4| END| 65.55|3.Flocks to report | 1.42| 27876|2 2019-06-25 01:09:31,098|FF|app-20190625010826-0087|3|4|START| 65.55|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 01:09:31,138|FF|app-20190625010826-0087|3|4|START| 65.59|4a.Making expansions | 0.00| 0|2 2019-06-25 01:09:32,117|FF|app-20190625010826-0087|3|4| END| 66.56|4a.Making expansions | 0.98| 34771|2 2019-06-25 01:09:32,118|FF|app-20190625010826-0087|3|4|START| 66.57|4b.Finding maximals | 0.00| 0|2 2019-06-25 01:09:45,077|FF|app-20190625010826-0087|3|4| END| 79.52|4b.Finding maximals | 12.96| 5697|2 2019-06-25 01:09:45,395|FF|app-20190625010826-0087|3|4| END| 79.84|4.Flocks prunned by expansion | 14.30| 5697|2 2019-06-25 01:09:45,395|FF|app-20190625010826-0087|3|4|START| 79.84|5.Flocks reported | 0.00| 0|2 2019-06-25 01:09:45,863|FF|app-20190625010826-0087|3|4| END| 80.31|5.Flocks reported | 0.47| 5697|2 2019-06-25 01:09:45,864|FF|app-20190625010826-0087|3|4|START| 80.31|6.Candidates indexed | 0.00| 0|2 2019-06-25 01:09:48,560|FF|app-20190625010826-0087|3|4| END| 83.01|6.Candidates indexed | 2.70| 11079|2 2019-06-25 01:09:48,560|FF|app-20190625010826-0087|3|4|START| 83.01|1.Maximal disks found | 0.00| 0|3 2019-06-25 01:09:48,560|MF|app-20190625010826-0087|3|4|START| 83.01|A.Points indexed | 0.00| 0|3 2019-06-25 01:09:48,615|MF|app-20190625010826-0087|3|4| END| 83.06|A.Points indexed | 0.05| 18548|3 2019-06-25 01:09:48,615|MF|app-20190625010826-0087|3|4|START| 83.06|B.Pairs found | 0.00| 0|3 2019-06-25 01:09:49,191|MF|app-20190625010826-0087|3|4| END| 83.64|B.Pairs found | 0.58| 35515|3 2019-06-25 01:09:49,191|MF|app-20190625010826-0087|3|4|START| 83.64|C.Centers found | 0.00| 0|3 2019-06-25 01:09:49,667|MF|app-20190625010826-0087|3|4| END| 84.11|C.Centers found | 0.48| 71030|3 2019-06-25 01:09:49,667|MF|app-20190625010826-0087|3|4|START| 84.11|D.Disks found | 0.00| 0|3 2019-06-25 01:09:52,475|MF|app-20190625010826-0087|3|4| END| 86.92|D.Disks found | 2.81| 30142|3 2019-06-25 01:09:52,475|MF|app-20190625010826-0087|3|4|START| 86.92|E.Disks partitioned | 0.00| 0|3 2019-06-25 01:09:53,340|MF|app-20190625010826-0087|3|4| END| 87.79|E.Disks partitioned | 0.87| 42665|3 2019-06-25 01:09:53,340|MF|app-20190625010826-0087|3|4|START| 87.79|F.Maximal disks found | 0.00| 0|3 2019-06-25 01:09:53,341|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:09:53,341|Cell area: 1055533.7681000116 2019-06-25 01:10:05,101|MF|app-20190625010826-0087|3|4| END| 99.55|F.Maximal disks found | 11.76| 8846|3 2019-06-25 01:10:05,101|MAXIMALS|app-20190625010826-0087|4|3|100.0|3|450|16.541|8846 2019-06-25 01:10:05,503|FF|app-20190625010826-0087|3|4| END| 99.95|1.Maximal disks found | 16.94| 8846|3 2019-06-25 01:10:05,503|FF|app-20190625010826-0087|3|4|START| 99.95|2.Join done | 0.00| 0|3 2019-06-25 01:10:09,451|FF|app-20190625010826-0087|3|4| END|103.90|2.Join done | 3.95| 30190|3 2019-06-25 01:10:09,451|FF|app-20190625010826-0087|3|4|START|103.90|3.Flocks to report | 0.00| 0|3 2019-06-25 01:10:10,327|FF|app-20190625010826-0087|3|4| END|104.77|3.Flocks to report | 0.88| 25328|3 2019-06-25 01:10:10,327|FF|app-20190625010826-0087|3|4|START|104.77|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 01:10:10,387|FF|app-20190625010826-0087|3|4|START|104.83|4a.Making expansions | 0.00| 0|3 2019-06-25 01:10:10,934|FF|app-20190625010826-0087|3|4| END|105.38|4a.Making expansions | 0.55| 32146|3 2019-06-25 01:10:10,934|FF|app-20190625010826-0087|3|4|START|105.38|4b.Finding maximals | 0.00| 0|3 2019-06-25 01:10:21,717|FF|app-20190625010826-0087|3|4| END|116.16|4b.Finding maximals | 10.78| 5767|3 2019-06-25 01:10:21,908|FF|app-20190625010826-0087|3|4| END|116.36|4.Flocks prunned by expansion | 11.58| 5767|3 2019-06-25 01:10:21,909|FF|app-20190625010826-0087|3|4|START|116.36|5.Flocks reported | 0.00| 0|3 2019-06-25 01:10:22,183|FF|app-20190625010826-0087|3|4| END|116.63|5.Flocks reported | 0.27| 5767|3 2019-06-25 01:10:22,184|FF|app-20190625010826-0087|3|4|START|116.63|6.Candidates indexed | 0.00| 0|3 2019-06-25 01:10:23,813|FF|app-20190625010826-0087|3|4| END|118.26|6.Candidates indexed | 1.63| 11171|3 2019-06-25 01:10:24,703|Number of flocks: 11464 2019-06-25 01:10:25,165|PFLOCK|app-20190625010826-0087|4|3|100.0|3|3|112.85|11464 2019-06-25 01:10:25,644|FF|app-20190625010826-0087|3|4| END|120.09|Flock Finder run |113.79| 11464|3 2019-06-25 01:10:25,644|FF|app-20190625010826-0087|3|4|START|120.09|Session closed | 0.00| 0|3 2019-06-25 01:10:32,169|FF|app-20190625010826-0087|3|4| END|126.62|Session closed | 6.53| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B4_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B4_grid-60x30.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 12 --fftimestamp 4 --portui 4040 --info 2019-06-25 01:10:34,071|FF|app-00000000000000-0000|12|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 01:10:35,155|FF|app-20190625011034-0088|12|4| END| 1.07|Session start | 1.09| 0|-1 2019-06-25 01:10:35,155|FF|app-20190625011034-0088|12|4|START| 1.07|Data read | 0.00| 0|-1 2019-06-25 01:10:38,245|FF|app-20190625011034-0088|12|4|START| 4.16|KDBTree partitioner | 0.00| 0|-1 2019-06-25 01:10:39,349|Sample size: 441504 2019-06-25 01:10:39,970|FF|app-20190625011034-0088|12|4| END| 5.88|KDBTree partitioner | 1.73| 1157|-1 2019-06-25 01:10:39,970|FF|app-20190625011034-0088|12|4|START| 5.88|MF partitioner | 0.00| 0|-1 2019-06-25 01:10:40,019|FF|app-20190625011034-0088|12|4| END| 5.93|MF partitioner | 0.05| 1800|-1 2019-06-25 01:10:41,804|FF|app-20190625011034-0088|12|4| END| 7.72|MF partitioner | 1.83|441504|-1 2019-06-25 01:10:41,804|FF|app-20190625011034-0088|12|4|START| 7.72|Flock Finder run | 0.00| 0|-1 2019-06-25 01:10:41,820|FF|app-20190625011034-0088|12|4|START| 7.73|1.Maximal disks found | 0.00| 0|0 2019-06-25 01:10:41,823|MF|app-20190625011034-0088|12|4|START| 7.74|A.Points indexed | 0.00| 0|0 2019-06-25 01:10:42,061|MF|app-20190625011034-0088|12|4| END| 7.97|A.Points indexed | 0.24| 72372|0 2019-06-25 01:10:42,061|MF|app-20190625011034-0088|12|4|START| 7.97|B.Pairs found | 0.00| 0|0 2019-06-25 01:10:43,737|MF|app-20190625011034-0088|12|4| END| 9.65|B.Pairs found | 1.68|157616|0 2019-06-25 01:10:43,737|MF|app-20190625011034-0088|12|4|START| 9.65|C.Centers found | 0.00| 0|0 2019-06-25 01:10:45,035|MF|app-20190625011034-0088|12|4| END| 10.95|C.Centers found | 1.30|315232|0 2019-06-25 01:10:45,035|MF|app-20190625011034-0088|12|4|START| 10.95|D.Disks found | 0.00| 0|0 2019-06-25 01:10:49,934|MF|app-20190625011034-0088|12|4| END| 15.85|D.Disks found | 4.90|140916|0 2019-06-25 01:10:49,934|MF|app-20190625011034-0088|12|4|START| 15.85|E.Disks partitioned | 0.00| 0|0 2019-06-25 01:10:51,557|MF|app-20190625011034-0088|12|4| END| 17.47|E.Disks partitioned | 1.62|206209|0 2019-06-25 01:10:51,557|MF|app-20190625011034-0088|12|4|START| 17.47|F.Maximal disks found | 0.00| 0|0 2019-06-25 01:10:51,560|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:10:51,561|Cell area: 1055533.7681000116 2019-06-25 01:11:16,592|MF|app-20190625011034-0088|12|4| END| 42.50|F.Maximal disks found | 25.03| 40009|0 2019-06-25 01:11:16,592|MAXIMALS|app-20190625011034-0088|4|12|110.0|3|1800|34.769|40009 2019-06-25 01:11:17,978|FF|app-20190625011034-0088|12|4| END| 43.89|1.Maximal disks found | 36.16| 40009|0 2019-06-25 01:11:17,978|FF|app-20190625011034-0088|12|4|START| 43.89|1.Maximal disks found | 0.00| 0|1 2019-06-25 01:11:17,978|MF|app-20190625011034-0088|12|4|START| 43.89|A.Points indexed | 0.00| 0|1 2019-06-25 01:11:18,116|MF|app-20190625011034-0088|12|4| END| 44.03|A.Points indexed | 0.14| 72980|1 2019-06-25 01:11:18,116|MF|app-20190625011034-0088|12|4|START| 44.03|B.Pairs found | 0.00| 0|1 2019-06-25 01:11:18,852|MF|app-20190625011034-0088|12|4| END| 44.77|B.Pairs found | 0.74|159996|1 2019-06-25 01:11:18,852|MF|app-20190625011034-0088|12|4|START| 44.77|C.Centers found | 0.00| 0|1 2019-06-25 01:11:19,774|MF|app-20190625011034-0088|12|4| END| 45.69|C.Centers found | 0.92|319992|1 2019-06-25 01:11:19,774|MF|app-20190625011034-0088|12|4|START| 45.69|D.Disks found | 0.00| 0|1 2019-06-25 01:11:23,585|MF|app-20190625011034-0088|12|4| END| 49.50|D.Disks found | 3.81|143396|1 2019-06-25 01:11:23,585|MF|app-20190625011034-0088|12|4|START| 49.50|E.Disks partitioned | 0.00| 0|1 2019-06-25 01:11:24,887|MF|app-20190625011034-0088|12|4| END| 50.80|E.Disks partitioned | 1.30|209660|1 2019-06-25 01:11:24,887|MF|app-20190625011034-0088|12|4|START| 50.80|F.Maximal disks found | 0.00| 0|1 2019-06-25 01:11:24,888|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:11:24,888|Cell area: 1055533.7681000116 2019-06-25 01:11:50,608|MF|app-20190625011034-0088|12|4| END| 76.52|F.Maximal disks found | 25.72| 40432|1 2019-06-25 01:11:50,608|MAXIMALS|app-20190625011034-0088|4|12|110.0|3|1800|32.63|40432 2019-06-25 01:11:51,977|FF|app-20190625011034-0088|12|4| END| 77.89|1.Maximal disks found | 34.00| 40432|1 2019-06-25 01:11:51,978|FF|app-20190625011034-0088|12|4|START| 77.89|2.Join done | 0.00| 0|1 2019-06-25 01:11:55,975|FF|app-20190625011034-0088|12|4| END| 81.89|2.Join done | 4.00| 87506|1 2019-06-25 01:11:55,975|FF|app-20190625011034-0088|12|4|START| 81.89|3.Flocks to report | 0.00| 0|1 2019-06-25 01:11:56,570|FF|app-20190625011034-0088|12|4| END| 82.48|3.Flocks to report | 0.60| 0|1 2019-06-25 01:11:56,570|FF|app-20190625011034-0088|12|4|START| 82.48|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 01:11:56,632|FF|app-20190625011034-0088|12|4| END| 82.55|4.Flocks prunned by expansion | 0.06| 0|1 2019-06-25 01:11:56,633|FF|app-20190625011034-0088|12|4|START| 82.55|5.Flocks reported | 0.00| 0|1 2019-06-25 01:11:56,637|FF|app-20190625011034-0088|12|4| END| 82.55|5.Flocks reported | 0.01| 0|1 2019-06-25 01:11:56,638|FF|app-20190625011034-0088|12|4|START| 82.55|6.Candidates indexed | 0.00| 0|1 2019-06-25 01:11:58,765|FF|app-20190625011034-0088|12|4| END| 84.68|6.Candidates indexed | 2.13| 89925|1 2019-06-25 01:11:58,765|FF|app-20190625011034-0088|12|4|START| 84.68|1.Maximal disks found | 0.00| 0|2 2019-06-25 01:11:58,765|MF|app-20190625011034-0088|12|4|START| 84.68|A.Points indexed | 0.00| 0|2 2019-06-25 01:11:58,893|MF|app-20190625011034-0088|12|4| END| 84.81|A.Points indexed | 0.13| 73576|2 2019-06-25 01:11:58,893|MF|app-20190625011034-0088|12|4|START| 84.81|B.Pairs found | 0.00| 0|2 2019-06-25 01:11:59,662|MF|app-20190625011034-0088|12|4| END| 85.58|B.Pairs found | 0.77|162264|2 2019-06-25 01:11:59,662|MF|app-20190625011034-0088|12|4|START| 85.58|C.Centers found | 0.00| 0|2 2019-06-25 01:12:00,548|MF|app-20190625011034-0088|12|4| END| 86.46|C.Centers found | 0.89|324528|2 2019-06-25 01:12:00,548|MF|app-20190625011034-0088|12|4|START| 86.46|D.Disks found | 0.00| 0|2 2019-06-25 01:12:04,166|MF|app-20190625011034-0088|12|4| END| 90.08|D.Disks found | 3.62|145412|2 2019-06-25 01:12:04,166|MF|app-20190625011034-0088|12|4|START| 90.08|E.Disks partitioned | 0.00| 0|2 2019-06-25 01:12:05,455|MF|app-20190625011034-0088|12|4| END| 91.37|E.Disks partitioned | 1.29|212798|2 2019-06-25 01:12:05,456|MF|app-20190625011034-0088|12|4|START| 91.37|F.Maximal disks found | 0.00| 0|2 2019-06-25 01:12:05,457|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:12:05,457|Cell area: 1055533.7681000116 2019-06-25 01:12:31,562|MF|app-20190625011034-0088|12|4| END|117.48|F.Maximal disks found | 26.11| 41347|2 2019-06-25 01:12:31,562|MAXIMALS|app-20190625011034-0088|4|12|110.0|3|1800|32.797|41347 2019-06-25 01:12:32,932|FF|app-20190625011034-0088|12|4| END|118.85|1.Maximal disks found | 34.17| 41347|2 2019-06-25 01:12:32,932|FF|app-20190625011034-0088|12|4|START|118.85|2.Join done | 0.00| 0|2 2019-06-25 01:12:42,952|FF|app-20190625011034-0088|12|4| END|128.87|2.Join done | 10.02|179268|2 2019-06-25 01:12:42,952|FF|app-20190625011034-0088|12|4|START|128.87|3.Flocks to report | 0.00| 0|2 2019-06-25 01:12:43,924|FF|app-20190625011034-0088|12|4| END|129.84|3.Flocks to report | 0.97|153105|2 2019-06-25 01:12:43,925|FF|app-20190625011034-0088|12|4|START|129.84|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 01:12:43,986|FF|app-20190625011034-0088|12|4|START|129.90|4a.Making expansions | 0.00| 0|2 2019-06-25 01:12:45,027|FF|app-20190625011034-0088|12|4| END|130.94|4a.Making expansions | 1.04|191193|2 2019-06-25 01:12:45,027|FF|app-20190625011034-0088|12|4|START|130.94|4b.Finding maximals | 0.00| 0|2 2019-06-25 01:13:35,550|FF|app-20190625011034-0088|12|4| END|181.46|4b.Finding maximals | 50.52| 26404|2 2019-06-25 01:13:36,153|FF|app-20190625011034-0088|12|4| END|182.07|4.Flocks prunned by expansion | 52.23| 26404|2 2019-06-25 01:13:36,153|FF|app-20190625011034-0088|12|4|START|182.07|5.Flocks reported | 0.00| 0|2 2019-06-25 01:13:36,924|FF|app-20190625011034-0088|12|4| END|182.84|5.Flocks reported | 0.77| 26404|2 2019-06-25 01:13:36,924|FF|app-20190625011034-0088|12|4|START|182.84|6.Candidates indexed | 0.00| 0|2 2019-06-25 01:13:39,336|FF|app-20190625011034-0088|12|4| END|185.25|6.Candidates indexed | 2.41| 55147|2 2019-06-25 01:13:39,336|FF|app-20190625011034-0088|12|4|START|185.25|1.Maximal disks found | 0.00| 0|3 2019-06-25 01:13:39,336|MF|app-20190625011034-0088|12|4|START|185.25|A.Points indexed | 0.00| 0|3 2019-06-25 01:13:39,460|MF|app-20190625011034-0088|12|4| END|185.37|A.Points indexed | 0.12| 74192|3 2019-06-25 01:13:39,460|MF|app-20190625011034-0088|12|4|START|185.37|B.Pairs found | 0.00| 0|3 2019-06-25 01:13:40,395|MF|app-20190625011034-0088|12|4| END|186.31|B.Pairs found | 0.94|165028|3 2019-06-25 01:13:40,396|MF|app-20190625011034-0088|12|4|START|186.31|C.Centers found | 0.00| 0|3 2019-06-25 01:13:41,270|MF|app-20190625011034-0088|12|4| END|187.18|C.Centers found | 0.87|330056|3 2019-06-25 01:13:41,271|MF|app-20190625011034-0088|12|4|START|187.18|D.Disks found | 0.00| 0|3 2019-06-25 01:13:44,854|MF|app-20190625011034-0088|12|4| END|190.77|D.Disks found | 3.58|148348|3 2019-06-25 01:13:44,854|MF|app-20190625011034-0088|12|4|START|190.77|E.Disks partitioned | 0.00| 0|3 2019-06-25 01:13:46,382|MF|app-20190625011034-0088|12|4| END|192.30|E.Disks partitioned | 1.53|217088|3 2019-06-25 01:13:46,382|MF|app-20190625011034-0088|12|4|START|192.30|F.Maximal disks found | 0.00| 0|3 2019-06-25 01:13:46,383|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:13:46,383|Cell area: 1055533.7681000116 2019-06-25 01:14:21,398|MF|app-20190625011034-0088|12|4| END|227.31|F.Maximal disks found | 35.02| 42012|3 2019-06-25 01:14:21,398|MAXIMALS|app-20190625011034-0088|4|12|110.0|3|1800|42.062|42012 2019-06-25 01:14:22,780|FF|app-20190625011034-0088|12|4| END|228.69|1.Maximal disks found | 43.44| 42012|3 2019-06-25 01:14:22,780|FF|app-20190625011034-0088|12|4|START|228.69|2.Join done | 0.00| 0|3 2019-06-25 01:14:29,312|FF|app-20190625011034-0088|12|4| END|235.23|2.Join done | 6.53|179709|3 2019-06-25 01:14:29,313|FF|app-20190625011034-0088|12|4|START|235.23|3.Flocks to report | 0.00| 0|3 2019-06-25 01:14:30,249|FF|app-20190625011034-0088|12|4| END|236.16|3.Flocks to report | 0.94|153488|3 2019-06-25 01:14:30,249|FF|app-20190625011034-0088|12|4|START|236.16|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 01:14:30,313|FF|app-20190625011034-0088|12|4|START|236.23|4a.Making expansions | 0.00| 0|3 2019-06-25 01:14:31,465|FF|app-20190625011034-0088|12|4| END|237.38|4a.Making expansions | 1.15|191686|3 2019-06-25 01:14:31,465|FF|app-20190625011034-0088|12|4|START|237.38|4b.Finding maximals | 0.00| 0|3 2019-06-25 01:15:37,918|FF|app-20190625011034-0088|12|4| END|303.83|4b.Finding maximals | 66.45| 26676|3 2019-06-25 01:15:38,538|FF|app-20190625011034-0088|12|4| END|304.45|4.Flocks prunned by expansion | 68.29| 26676|3 2019-06-25 01:15:38,538|FF|app-20190625011034-0088|12|4|START|304.45|5.Flocks reported | 0.00| 0|3 2019-06-25 01:15:39,389|FF|app-20190625011034-0088|12|4| END|305.30|5.Flocks reported | 0.85| 26676|3 2019-06-25 01:15:39,389|FF|app-20190625011034-0088|12|4|START|305.30|6.Candidates indexed | 0.00| 0|3 2019-06-25 01:15:41,891|FF|app-20190625011034-0088|12|4| END|307.80|6.Candidates indexed | 2.50| 55524|3 2019-06-25 01:15:43,740|Number of flocks: 53080 2019-06-25 01:15:45,006|PFLOCK|app-20190625011034-0088|4|12|110.0|3|3|301.94|53080 2019-06-25 01:15:46,275|FF|app-20190625011034-0088|12|4| END|312.19|Flock Finder run |304.47| 53080|3 2019-06-25 01:15:46,275|FF|app-20190625011034-0088|12|4|START|312.19|Session closed | 0.00| 0|3 2019-06-25 01:15:54,606|FF|app-20190625011034-0088|12|4| END|320.52|Session closed | 8.33| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B2_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B2_grid-30x30.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 6 --fftimestamp 4 --portui 4040 --info 2019-06-25 01:15:56,475|FF|app-00000000000000-0000|6|4|START| 0.11|Session start | 0.00| 0|-1 2019-06-25 01:15:57,551|FF|app-20190625011557-0089|6|4| END| 1.06|Session start | 1.08| 0|-1 2019-06-25 01:15:57,551|FF|app-20190625011557-0089|6|4|START| 1.06|Data read | 0.00| 0|-1 2019-06-25 01:16:00,511|FF|app-20190625011557-0089|6|4|START| 4.02|KDBTree partitioner | 0.00| 0|-1 2019-06-25 01:16:01,522|Sample size: 220752 2019-06-25 01:16:01,686|FF|app-20190625011557-0089|6|4| END| 5.19|KDBTree partitioner | 1.18| 600|-1 2019-06-25 01:16:01,686|FF|app-20190625011557-0089|6|4|START| 5.20|MF partitioner | 0.00| 0|-1 2019-06-25 01:16:01,728|FF|app-20190625011557-0089|6|4| END| 5.24|MF partitioner | 0.04| 900|-1 2019-06-25 01:16:03,517|FF|app-20190625011557-0089|6|4| END| 7.03|MF partitioner | 1.83|220752|-1 2019-06-25 01:16:03,518|FF|app-20190625011557-0089|6|4|START| 7.03|Flock Finder run | 0.00| 0|-1 2019-06-25 01:16:03,533|FF|app-20190625011557-0089|6|4|START| 7.04|1.Maximal disks found | 0.00| 0|0 2019-06-25 01:16:03,536|MF|app-20190625011557-0089|6|4|START| 7.05|A.Points indexed | 0.00| 0|0 2019-06-25 01:16:03,712|MF|app-20190625011557-0089|6|4| END| 7.22|A.Points indexed | 0.18| 36186|0 2019-06-25 01:16:03,712|MF|app-20190625011557-0089|6|4|START| 7.22|B.Pairs found | 0.00| 0|0 2019-06-25 01:16:05,351|MF|app-20190625011557-0089|6|4| END| 8.86|B.Pairs found | 1.64| 78808|0 2019-06-25 01:16:05,352|MF|app-20190625011557-0089|6|4|START| 8.86|C.Centers found | 0.00| 0|0 2019-06-25 01:16:06,517|MF|app-20190625011557-0089|6|4| END| 10.03|C.Centers found | 1.17|157616|0 2019-06-25 01:16:06,517|MF|app-20190625011557-0089|6|4|START| 10.03|D.Disks found | 0.00| 0|0 2019-06-25 01:16:11,885|MF|app-20190625011557-0089|6|4| END| 15.39|D.Disks found | 5.37| 70458|0 2019-06-25 01:16:11,885|MF|app-20190625011557-0089|6|4|START| 15.39|E.Disks partitioned | 0.00| 0|0 2019-06-25 01:16:14,385|MF|app-20190625011557-0089|6|4| END| 17.89|E.Disks partitioned | 2.50|103004|0 2019-06-25 01:16:14,385|MF|app-20190625011557-0089|6|4|START| 17.89|F.Maximal disks found | 0.00| 0|0 2019-06-25 01:16:14,387|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:16:14,387|Cell area: 1055533.7681000116 2019-06-25 01:16:40,887|MF|app-20190625011557-0089|6|4| END| 44.40|F.Maximal disks found | 26.50| 20001|0 2019-06-25 01:16:40,887|MAXIMALS|app-20190625011557-0089|4|6|110.0|3|900|37.351|20001 2019-06-25 01:16:41,852|FF|app-20190625011557-0089|6|4| END| 45.36|1.Maximal disks found | 38.32| 20001|0 2019-06-25 01:16:41,852|FF|app-20190625011557-0089|6|4|START| 45.36|1.Maximal disks found | 0.00| 0|1 2019-06-25 01:16:41,852|MF|app-20190625011557-0089|6|4|START| 45.36|A.Points indexed | 0.00| 0|1 2019-06-25 01:16:41,956|MF|app-20190625011557-0089|6|4| END| 45.47|A.Points indexed | 0.10| 36490|1 2019-06-25 01:16:41,956|MF|app-20190625011557-0089|6|4|START| 45.47|B.Pairs found | 0.00| 0|1 2019-06-25 01:16:43,107|MF|app-20190625011557-0089|6|4| END| 46.62|B.Pairs found | 1.15| 79998|1 2019-06-25 01:16:43,107|MF|app-20190625011557-0089|6|4|START| 46.62|C.Centers found | 0.00| 0|1 2019-06-25 01:16:44,144|MF|app-20190625011557-0089|6|4| END| 47.65|C.Centers found | 1.04|159996|1 2019-06-25 01:16:44,144|MF|app-20190625011557-0089|6|4|START| 47.65|D.Disks found | 0.00| 0|1 2019-06-25 01:16:48,871|MF|app-20190625011557-0089|6|4| END| 52.38|D.Disks found | 4.73| 71698|1 2019-06-25 01:16:48,871|MF|app-20190625011557-0089|6|4|START| 52.38|E.Disks partitioned | 0.00| 0|1 2019-06-25 01:16:50,388|MF|app-20190625011557-0089|6|4| END| 53.90|E.Disks partitioned | 1.52|104758|1 2019-06-25 01:16:50,388|MF|app-20190625011557-0089|6|4|START| 53.90|F.Maximal disks found | 0.00| 0|1 2019-06-25 01:16:50,389|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:16:50,389|Cell area: 1055533.7681000116 2019-06-25 01:17:16,562|MF|app-20190625011557-0089|6|4| END| 80.07|F.Maximal disks found | 26.17| 20222|1 2019-06-25 01:17:16,562|MAXIMALS|app-20190625011557-0089|4|6|110.0|3|900|34.71|20222 2019-06-25 01:17:17,353|FF|app-20190625011557-0089|6|4| END| 80.86|1.Maximal disks found | 35.50| 20222|1 2019-06-25 01:17:17,354|FF|app-20190625011557-0089|6|4|START| 80.86|2.Join done | 0.00| 0|1 2019-06-25 01:17:21,787|FF|app-20190625011557-0089|6|4| END| 85.30|2.Join done | 4.43| 43837|1 2019-06-25 01:17:21,787|FF|app-20190625011557-0089|6|4|START| 85.30|3.Flocks to report | 0.00| 0|1 2019-06-25 01:17:22,569|FF|app-20190625011557-0089|6|4| END| 86.08|3.Flocks to report | 0.78| 0|1 2019-06-25 01:17:22,569|FF|app-20190625011557-0089|6|4|START| 86.08|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 01:17:22,613|FF|app-20190625011557-0089|6|4| END| 86.12|4.Flocks prunned by expansion | 0.04| 0|1 2019-06-25 01:17:22,614|FF|app-20190625011557-0089|6|4|START| 86.12|5.Flocks reported | 0.00| 0|1 2019-06-25 01:17:22,618|FF|app-20190625011557-0089|6|4| END| 86.13|5.Flocks reported | 0.01| 0|1 2019-06-25 01:17:22,618|FF|app-20190625011557-0089|6|4|START| 86.13|6.Candidates indexed | 0.00| 0|1 2019-06-25 01:17:25,468|FF|app-20190625011557-0089|6|4| END| 88.98|6.Candidates indexed | 2.85| 45047|1 2019-06-25 01:17:25,468|FF|app-20190625011557-0089|6|4|START| 88.98|1.Maximal disks found | 0.00| 0|2 2019-06-25 01:17:25,468|MF|app-20190625011557-0089|6|4|START| 88.98|A.Points indexed | 0.00| 0|2 2019-06-25 01:17:25,556|MF|app-20190625011557-0089|6|4| END| 89.07|A.Points indexed | 0.09| 36788|2 2019-06-25 01:17:25,557|MF|app-20190625011557-0089|6|4|START| 89.07|B.Pairs found | 0.00| 0|2 2019-06-25 01:17:26,321|MF|app-20190625011557-0089|6|4| END| 89.83|B.Pairs found | 0.76| 81132|2 2019-06-25 01:17:26,321|MF|app-20190625011557-0089|6|4|START| 89.83|C.Centers found | 0.00| 0|2 2019-06-25 01:17:27,030|MF|app-20190625011557-0089|6|4| END| 90.54|C.Centers found | 0.71|162264|2 2019-06-25 01:17:27,030|MF|app-20190625011557-0089|6|4|START| 90.54|D.Disks found | 0.00| 0|2 2019-06-25 01:17:31,276|MF|app-20190625011557-0089|6|4| END| 94.79|D.Disks found | 4.25| 72706|2 2019-06-25 01:17:31,276|MF|app-20190625011557-0089|6|4|START| 94.79|E.Disks partitioned | 0.00| 0|2 2019-06-25 01:17:33,480|MF|app-20190625011557-0089|6|4| END| 96.99|E.Disks partitioned | 2.20|106347|2 2019-06-25 01:17:33,480|MF|app-20190625011557-0089|6|4|START| 96.99|F.Maximal disks found | 0.00| 0|2 2019-06-25 01:17:33,480|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:17:33,480|Cell area: 1055533.7681000116 2019-06-25 01:18:00,001|MF|app-20190625011557-0089|6|4| END|123.51|F.Maximal disks found | 26.52| 20682|2 2019-06-25 01:18:00,001|MAXIMALS|app-20190625011557-0089|4|6|110.0|3|900|34.533|20682 2019-06-25 01:18:01,033|FF|app-20190625011557-0089|6|4| END|124.54|1.Maximal disks found | 35.57| 20682|2 2019-06-25 01:18:01,033|FF|app-20190625011557-0089|6|4|START|124.54|2.Join done | 0.00| 0|2 2019-06-25 01:18:21,108|FF|app-20190625011557-0089|6|4| END|144.62|2.Join done | 20.08| 89740|2 2019-06-25 01:18:21,108|FF|app-20190625011557-0089|6|4|START|144.62|3.Flocks to report | 0.00| 0|2 2019-06-25 01:18:23,100|FF|app-20190625011557-0089|6|4| END|146.61|3.Flocks to report | 1.99| 76643|2 2019-06-25 01:18:23,100|FF|app-20190625011557-0089|6|4|START|146.61|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 01:18:23,146|FF|app-20190625011557-0089|6|4|START|146.66|4a.Making expansions | 0.00| 0|2 2019-06-25 01:18:24,683|FF|app-20190625011557-0089|6|4| END|148.19|4a.Making expansions | 1.54| 95773|2 2019-06-25 01:18:24,684|FF|app-20190625011557-0089|6|4|START|148.19|4b.Finding maximals | 0.00| 0|2 2019-06-25 01:19:12,770|FF|app-20190625011557-0089|6|4| END|196.28|4b.Finding maximals | 48.09| 13202|2 2019-06-25 01:19:13,177|FF|app-20190625011557-0089|6|4| END|196.69|4.Flocks prunned by expansion | 50.08| 13202|2 2019-06-25 01:19:13,177|FF|app-20190625011557-0089|6|4|START|196.69|5.Flocks reported | 0.00| 0|2 2019-06-25 01:19:13,763|FF|app-20190625011557-0089|6|4| END|197.27|5.Flocks reported | 0.59| 13202|2 2019-06-25 01:19:13,763|FF|app-20190625011557-0089|6|4|START|197.27|6.Candidates indexed | 0.00| 0|2 2019-06-25 01:19:16,580|FF|app-20190625011557-0089|6|4| END|200.09|6.Candidates indexed | 2.82| 27595|2 2019-06-25 01:19:16,580|FF|app-20190625011557-0089|6|4|START|200.09|1.Maximal disks found | 0.00| 0|3 2019-06-25 01:19:16,580|MF|app-20190625011557-0089|6|4|START|200.09|A.Points indexed | 0.00| 0|3 2019-06-25 01:19:16,660|MF|app-20190625011557-0089|6|4| END|200.17|A.Points indexed | 0.08| 37096|3 2019-06-25 01:19:16,660|MF|app-20190625011557-0089|6|4|START|200.17|B.Pairs found | 0.00| 0|3 2019-06-25 01:19:17,375|MF|app-20190625011557-0089|6|4| END|200.88|B.Pairs found | 0.72| 82514|3 2019-06-25 01:19:17,375|MF|app-20190625011557-0089|6|4|START|200.88|C.Centers found | 0.00| 0|3 2019-06-25 01:19:18,237|MF|app-20190625011557-0089|6|4| END|201.75|C.Centers found | 0.86|165028|3 2019-06-25 01:19:18,237|MF|app-20190625011557-0089|6|4|START|201.75|D.Disks found | 0.00| 0|3 2019-06-25 01:19:22,683|MF|app-20190625011557-0089|6|4| END|206.19|D.Disks found | 4.45| 74174|3 2019-06-25 01:19:22,683|MF|app-20190625011557-0089|6|4|START|206.19|E.Disks partitioned | 0.00| 0|3 2019-06-25 01:19:24,726|MF|app-20190625011557-0089|6|4| END|208.24|E.Disks partitioned | 2.04|108468|3 2019-06-25 01:19:24,726|MF|app-20190625011557-0089|6|4|START|208.24|F.Maximal disks found | 0.00| 0|3 2019-06-25 01:19:24,727|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:19:24,727|Cell area: 1055533.7681000116 2019-06-25 01:20:00,138|MF|app-20190625011557-0089|6|4| END|243.65|F.Maximal disks found | 35.41| 21009|3 2019-06-25 01:20:00,138|MAXIMALS|app-20190625011557-0089|4|6|110.0|3|900|43.558|21009 2019-06-25 01:20:01,026|FF|app-20190625011557-0089|6|4| END|244.54|1.Maximal disks found | 44.45| 21009|3 2019-06-25 01:20:01,026|FF|app-20190625011557-0089|6|4|START|244.54|2.Join done | 0.00| 0|3 2019-06-25 01:20:11,901|FF|app-20190625011557-0089|6|4| END|255.41|2.Join done | 10.88| 90003|3 2019-06-25 01:20:11,901|FF|app-20190625011557-0089|6|4|START|255.41|3.Flocks to report | 0.00| 0|3 2019-06-25 01:20:13,879|FF|app-20190625011557-0089|6|4| END|257.39|3.Flocks to report | 1.98| 76861|3 2019-06-25 01:20:13,879|FF|app-20190625011557-0089|6|4|START|257.39|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 01:20:13,928|FF|app-20190625011557-0089|6|4|START|257.44|4a.Making expansions | 0.00| 0|3 2019-06-25 01:20:15,329|FF|app-20190625011557-0089|6|4| END|258.84|4a.Making expansions | 1.40| 95647|3 2019-06-25 01:20:15,329|FF|app-20190625011557-0089|6|4|START|258.84|4b.Finding maximals | 0.00| 0|3 2019-06-25 01:21:17,370|FF|app-20190625011557-0089|6|4| END|320.88|4b.Finding maximals | 62.04| 13338|3 2019-06-25 01:21:17,761|FF|app-20190625011557-0089|6|4| END|321.27|4.Flocks prunned by expansion | 63.88| 13338|3 2019-06-25 01:21:17,761|FF|app-20190625011557-0089|6|4|START|321.27|5.Flocks reported | 0.00| 0|3 2019-06-25 01:21:18,406|FF|app-20190625011557-0089|6|4| END|321.92|5.Flocks reported | 0.65| 13338|3 2019-06-25 01:21:18,406|FF|app-20190625011557-0089|6|4|START|321.92|6.Candidates indexed | 0.00| 0|3 2019-06-25 01:21:21,902|FF|app-20190625011557-0089|6|4| END|325.41|6.Candidates indexed | 3.50| 27789|3 2019-06-25 01:21:23,307|Number of flocks: 26540 2019-06-25 01:21:24,085|PFLOCK|app-20190625011557-0089|4|6|110.0|3|3|319.79|26540 2019-06-25 01:21:24,889|FF|app-20190625011557-0089|6|4| END|328.40|Flock Finder run |321.37| 26540|3 2019-06-25 01:21:24,889|FF|app-20190625011557-0089|6|4|START|328.40|Session closed | 0.00| 0|3 2019-06-25 01:21:31,286|FF|app-20190625011557-0089|6|4| END|334.80|Session closed | 6.40| 0|3 spark-submit --class FF_Scaleup /home/ubuntu/Research/GeoSpark/target/scala-2.11/pflock_2.11-0.1.jar --input /home/ubuntu/Research/Datasets/Berlin/Replications/B1_points.tsv --m_grid /home/ubuntu/Research/Datasets/Berlin/Replications/B1_grid-15x30.wkt --epsilon 110 --mu 3 --delta 3 --distance 100 --master driver --cores 4 --executors 3 --fftimestamp 4 --portui 4040 --info 2019-06-25 01:21:33,267|FF|app-00000000000000-0000|3|4|START| 0.12|Session start | 0.00| 0|-1 2019-06-25 01:21:34,366|FF|app-20190625012134-0090|3|4| END| 1.08|Session start | 1.10| 0|-1 2019-06-25 01:21:34,366|FF|app-20190625012134-0090|3|4|START| 1.08|Data read | 0.00| 0|-1 2019-06-25 01:21:37,293|FF|app-20190625012134-0090|3|4|START| 4.01|KDBTree partitioner | 0.00| 0|-1 2019-06-25 01:21:38,065|Sample size: 110376 2019-06-25 01:21:38,153|FF|app-20190625012134-0090|3|4| END| 4.87|KDBTree partitioner | 0.86| 280|-1 2019-06-25 01:21:38,153|FF|app-20190625012134-0090|3|4|START| 4.87|MF partitioner | 0.00| 0|-1 2019-06-25 01:21:38,186|FF|app-20190625012134-0090|3|4| END| 4.90|MF partitioner | 0.03| 450|-1 2019-06-25 01:21:39,728|FF|app-20190625012134-0090|3|4| END| 6.44|MF partitioner | 1.57|110376|-1 2019-06-25 01:21:39,728|FF|app-20190625012134-0090|3|4|START| 6.45|Flock Finder run | 0.00| 0|-1 2019-06-25 01:21:39,744|FF|app-20190625012134-0090|3|4|START| 6.46|1.Maximal disks found | 0.00| 0|0 2019-06-25 01:21:39,746|MF|app-20190625012134-0090|3|4|START| 6.46|A.Points indexed | 0.00| 0|0 2019-06-25 01:21:39,905|MF|app-20190625012134-0090|3|4| END| 6.62|A.Points indexed | 0.16| 18093|0 2019-06-25 01:21:39,905|MF|app-20190625012134-0090|3|4|START| 6.62|B.Pairs found | 0.00| 0|0 2019-06-25 01:21:41,123|MF|app-20190625012134-0090|3|4| END| 7.84|B.Pairs found | 1.22| 39404|0 2019-06-25 01:21:41,123|MF|app-20190625012134-0090|3|4|START| 7.84|C.Centers found | 0.00| 0|0 2019-06-25 01:21:41,985|MF|app-20190625012134-0090|3|4| END| 8.70|C.Centers found | 0.86| 78808|0 2019-06-25 01:21:41,986|MF|app-20190625012134-0090|3|4|START| 8.70|D.Disks found | 0.00| 0|0 2019-06-25 01:21:45,286|MF|app-20190625012134-0090|3|4| END| 12.00|D.Disks found | 3.30| 35229|0 2019-06-25 01:21:45,286|MF|app-20190625012134-0090|3|4|START| 12.00|E.Disks partitioned | 0.00| 0|0 2019-06-25 01:21:46,457|MF|app-20190625012134-0090|3|4| END| 13.17|E.Disks partitioned | 1.17| 51442|0 2019-06-25 01:21:46,457|MF|app-20190625012134-0090|3|4|START| 13.17|F.Maximal disks found | 0.00| 0|0 2019-06-25 01:21:46,459|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:21:46,459|Cell area: 1055533.7681000116 2019-06-25 01:22:10,491|MF|app-20190625012134-0090|3|4| END| 37.21|F.Maximal disks found | 24.03| 10001|0 2019-06-25 01:22:10,491|MAXIMALS|app-20190625012134-0090|4|3|110.0|3|450|30.745|10001 2019-06-25 01:22:11,004|FF|app-20190625012134-0090|3|4| END| 37.72|1.Maximal disks found | 31.26| 10001|0 2019-06-25 01:22:11,004|FF|app-20190625012134-0090|3|4|START| 37.72|1.Maximal disks found | 0.00| 0|1 2019-06-25 01:22:11,004|MF|app-20190625012134-0090|3|4|START| 37.72|A.Points indexed | 0.00| 0|1 2019-06-25 01:22:11,105|MF|app-20190625012134-0090|3|4| END| 37.82|A.Points indexed | 0.10| 18245|1 2019-06-25 01:22:11,105|MF|app-20190625012134-0090|3|4|START| 37.82|B.Pairs found | 0.00| 0|1 2019-06-25 01:22:11,600|MF|app-20190625012134-0090|3|4| END| 38.32|B.Pairs found | 0.50| 39999|1 2019-06-25 01:22:11,600|MF|app-20190625012134-0090|3|4|START| 38.32|C.Centers found | 0.00| 0|1 2019-06-25 01:22:12,126|MF|app-20190625012134-0090|3|4| END| 38.84|C.Centers found | 0.53| 79998|1 2019-06-25 01:22:12,126|MF|app-20190625012134-0090|3|4|START| 38.84|D.Disks found | 0.00| 0|1 2019-06-25 01:22:14,580|MF|app-20190625012134-0090|3|4| END| 41.30|D.Disks found | 2.45| 35849|1 2019-06-25 01:22:14,580|MF|app-20190625012134-0090|3|4|START| 41.30|E.Disks partitioned | 0.00| 0|1 2019-06-25 01:22:15,439|MF|app-20190625012134-0090|3|4| END| 42.16|E.Disks partitioned | 0.86| 52317|1 2019-06-25 01:22:15,439|MF|app-20190625012134-0090|3|4|START| 42.16|F.Maximal disks found | 0.00| 0|1 2019-06-25 01:22:15,440|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:22:15,440|Cell area: 1055533.7681000116 2019-06-25 01:22:40,797|MF|app-20190625012134-0090|3|4| END| 67.51|F.Maximal disks found | 25.36| 10110|1 2019-06-25 01:22:40,797|MAXIMALS|app-20190625012134-0090|4|3|110.0|3|450|29.793|10110 2019-06-25 01:22:41,220|FF|app-20190625012134-0090|3|4| END| 67.94|1.Maximal disks found | 30.22| 10110|1 2019-06-25 01:22:41,220|FF|app-20190625012134-0090|3|4|START| 67.94|2.Join done | 0.00| 0|1 2019-06-25 01:22:43,577|FF|app-20190625012134-0090|3|4| END| 70.29|2.Join done | 2.36| 21993|1 2019-06-25 01:22:43,577|FF|app-20190625012134-0090|3|4|START| 70.29|3.Flocks to report | 0.00| 0|1 2019-06-25 01:22:44,034|FF|app-20190625012134-0090|3|4| END| 70.75|3.Flocks to report | 0.46| 0|1 2019-06-25 01:22:44,034|FF|app-20190625012134-0090|3|4|START| 70.75|4.Flocks prunned by expansion | 0.00| 0|1 2019-06-25 01:22:44,062|FF|app-20190625012134-0090|3|4| END| 70.78|4.Flocks prunned by expansion | 0.03| 0|1 2019-06-25 01:22:44,063|FF|app-20190625012134-0090|3|4|START| 70.78|5.Flocks reported | 0.00| 0|1 2019-06-25 01:22:44,067|FF|app-20190625012134-0090|3|4| END| 70.78|5.Flocks reported | 0.01| 0|1 2019-06-25 01:22:44,068|FF|app-20190625012134-0090|3|4|START| 70.78|6.Candidates indexed | 0.00| 0|1 2019-06-25 01:22:45,683|FF|app-20190625012134-0090|3|4| END| 72.40|6.Candidates indexed | 1.62| 22599|1 2019-06-25 01:22:45,683|FF|app-20190625012134-0090|3|4|START| 72.40|1.Maximal disks found | 0.00| 0|2 2019-06-25 01:22:45,683|MF|app-20190625012134-0090|3|4|START| 72.40|A.Points indexed | 0.00| 0|2 2019-06-25 01:22:45,754|MF|app-20190625012134-0090|3|4| END| 72.47|A.Points indexed | 0.07| 18394|2 2019-06-25 01:22:45,754|MF|app-20190625012134-0090|3|4|START| 72.47|B.Pairs found | 0.00| 0|2 2019-06-25 01:22:46,200|MF|app-20190625012134-0090|3|4| END| 72.92|B.Pairs found | 0.45| 40566|2 2019-06-25 01:22:46,200|MF|app-20190625012134-0090|3|4|START| 72.92|C.Centers found | 0.00| 0|2 2019-06-25 01:22:46,761|MF|app-20190625012134-0090|3|4| END| 73.48|C.Centers found | 0.56| 81132|2 2019-06-25 01:22:46,761|MF|app-20190625012134-0090|3|4|START| 73.48|D.Disks found | 0.00| 0|2 2019-06-25 01:22:49,047|MF|app-20190625012134-0090|3|4| END| 75.76|D.Disks found | 2.29| 36353|2 2019-06-25 01:22:49,047|MF|app-20190625012134-0090|3|4|START| 75.76|E.Disks partitioned | 0.00| 0|2 2019-06-25 01:22:49,829|MF|app-20190625012134-0090|3|4| END| 76.55|E.Disks partitioned | 0.78| 53134|2 2019-06-25 01:22:49,829|MF|app-20190625012134-0090|3|4|START| 76.55|F.Maximal disks found | 0.00| 0|2 2019-06-25 01:22:49,830|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:22:49,830|Cell area: 1055533.7681000116 2019-06-25 01:23:15,246|MF|app-20190625012134-0090|3|4| END|101.96|F.Maximal disks found | 25.42| 10342|2 2019-06-25 01:23:15,246|MAXIMALS|app-20190625012134-0090|4|3|110.0|3|450|29.563|10342 2019-06-25 01:23:15,621|FF|app-20190625012134-0090|3|4| END|102.34|1.Maximal disks found | 29.94| 10342|2 2019-06-25 01:23:15,622|FF|app-20190625012134-0090|3|4|START|102.34|2.Join done | 0.00| 0|2 2019-06-25 01:23:29,205|FF|app-20190625012134-0090|3|4| END|115.92|2.Join done | 13.58| 45000|2 2019-06-25 01:23:29,206|FF|app-20190625012134-0090|3|4|START|115.92|3.Flocks to report | 0.00| 0|2 2019-06-25 01:23:31,155|FF|app-20190625012134-0090|3|4| END|117.87|3.Flocks to report | 1.95| 38432|2 2019-06-25 01:23:31,155|FF|app-20190625012134-0090|3|4|START|117.87|4.Flocks prunned by expansion | 0.00| 0|2 2019-06-25 01:23:31,197|FF|app-20190625012134-0090|3|4|START|117.91|4a.Making expansions | 0.00| 0|2 2019-06-25 01:23:32,570|FF|app-20190625012134-0090|3|4| END|119.29|4a.Making expansions | 1.37| 48133|2 2019-06-25 01:23:32,570|FF|app-20190625012134-0090|3|4|START|119.29|4b.Finding maximals | 0.00| 0|2 2019-06-25 01:24:16,385|FF|app-20190625012134-0090|3|4| END|163.10|4b.Finding maximals | 43.82| 6601|2 2019-06-25 01:24:16,678|FF|app-20190625012134-0090|3|4| END|163.40|4.Flocks prunned by expansion | 45.52| 6601|2 2019-06-25 01:24:16,678|FF|app-20190625012134-0090|3|4|START|163.40|5.Flocks reported | 0.00| 0|2 2019-06-25 01:24:17,177|FF|app-20190625012134-0090|3|4| END|163.89|5.Flocks reported | 0.50| 6601|2 2019-06-25 01:24:17,177|FF|app-20190625012134-0090|3|4|START|163.89|6.Candidates indexed | 0.00| 0|2 2019-06-25 01:24:20,364|FF|app-20190625012134-0090|3|4| END|167.08|6.Candidates indexed | 3.19| 13819|2 2019-06-25 01:24:20,364|FF|app-20190625012134-0090|3|4|START|167.08|1.Maximal disks found | 0.00| 0|3 2019-06-25 01:24:20,364|MF|app-20190625012134-0090|3|4|START|167.08|A.Points indexed | 0.00| 0|3 2019-06-25 01:24:20,421|MF|app-20190625012134-0090|3|4| END|167.14|A.Points indexed | 0.06| 18548|3 2019-06-25 01:24:20,421|MF|app-20190625012134-0090|3|4|START|167.14|B.Pairs found | 0.00| 0|3 2019-06-25 01:24:21,310|MF|app-20190625012134-0090|3|4| END|168.03|B.Pairs found | 0.89| 41257|3 2019-06-25 01:24:21,310|MF|app-20190625012134-0090|3|4|START|168.03|C.Centers found | 0.00| 0|3 2019-06-25 01:24:22,124|MF|app-20190625012134-0090|3|4| END|168.84|C.Centers found | 0.81| 82514|3 2019-06-25 01:24:22,124|MF|app-20190625012134-0090|3|4|START|168.84|D.Disks found | 0.00| 0|3 2019-06-25 01:24:26,895|MF|app-20190625012134-0090|3|4| END|173.61|D.Disks found | 4.77| 37087|3 2019-06-25 01:24:26,896|MF|app-20190625012134-0090|3|4|START|173.61|E.Disks partitioned | 0.00| 0|3 2019-06-25 01:24:28,691|MF|app-20190625012134-0090|3|4| END|175.41|E.Disks partitioned | 1.80| 54196|3 2019-06-25 01:24:28,691|MF|app-20190625012134-0090|3|4|START|175.41|F.Maximal disks found | 0.00| 0|3 2019-06-25 01:24:28,691|Cell dimensions: 1696.9999000000007 x 621.9999000000007 2019-06-25 01:24:28,691|Cell area: 1055533.7681000116 2019-06-25 01:25:01,360|MF|app-20190625012134-0090|3|4| END|208.08|F.Maximal disks found | 32.67| 10503|3 2019-06-25 01:25:01,360|MAXIMALS|app-20190625012134-0090|4|3|110.0|3|450|40.996|10503 2019-06-25 01:25:02,028|FF|app-20190625012134-0090|3|4| END|208.75|1.Maximal disks found | 41.66| 10503|3 2019-06-25 01:25:02,028|FF|app-20190625012134-0090|3|4|START|208.75|2.Join done | 0.00| 0|3 2019-06-25 01:25:11,444|FF|app-20190625012134-0090|3|4| END|218.16|2.Join done | 9.42| 45190|3 2019-06-25 01:25:11,444|FF|app-20190625012134-0090|3|4|START|218.16|3.Flocks to report | 0.00| 0|3 2019-06-25 01:25:13,342|FF|app-20190625012134-0090|3|4| END|220.06|3.Flocks to report | 1.90| 38589|3 2019-06-25 01:25:13,342|FF|app-20190625012134-0090|3|4|START|220.06|4.Flocks prunned by expansion | 0.00| 0|3 2019-06-25 01:25:13,383|FF|app-20190625012134-0090|3|4|START|220.10|4a.Making expansions | 0.00| 0|3 2019-06-25 01:25:14,484|FF|app-20190625012134-0090|3|4| END|221.20|4a.Making expansions | 1.10| 47925|3 2019-06-25 01:25:14,484|FF|app-20190625012134-0090|3|4|START|221.20|4b.Finding maximals | 0.00| 0|3 2019-06-25 01:26:18,419|FF|app-20190625012134-0090|3|4| END|285.14|4b.Finding maximals | 63.94| 6669|3 2019-06-25 01:26:18,716|FF|app-20190625012134-0090|3|4| END|285.43|4.Flocks prunned by expansion | 65.37| 6669|3 2019-06-25 01:26:18,716|FF|app-20190625012134-0090|3|4|START|285.43|5.Flocks reported | 0.00| 0|3 2019-06-25 01:26:19,178|FF|app-20190625012134-0090|3|4| END|285.90|5.Flocks reported | 0.46| 6669|3 2019-06-25 01:26:19,178|FF|app-20190625012134-0090|3|4|START|285.90|6.Candidates indexed | 0.00| 0|3 2019-06-25 01:26:22,491|FF|app-20190625012134-0090|3|4| END|289.21|6.Candidates indexed | 3.31| 13927|3 2019-06-25 01:26:23,663|Number of flocks: 13270 2019-06-25 01:26:24,241|PFLOCK|app-20190625012134-0090|4|3|110.0|3|3|283.94|13270 2019-06-25 01:26:24,859|FF|app-20190625012134-0090|3|4| END|291.58|Flock Finder run |285.13| 13270|3 2019-06-25 01:26:24,859|FF|app-20190625012134-0090|3|4|START|291.58|Session closed | 0.00| 0|3 2019-06-25 01:26:31,263|FF|app-20190625012134-0090|3|4| END|297.98|Session closed | 6.40| 0|3