Chunk / ImageR

Download as
Browse Code ยป

Commit 13eeb4888f262f00dec144ca82052179a36fc8d6

Authored by Chunk
1 parent eb39af01
Exists in master and in 1 other branch refactor

the 1st benching finished.(but we've found a BUG about spark-formatting.)

Showing 1 changed file with 66 additions and 37 deletions   Show diff stats
bench_result
  Diff comments   View file @13eeb48
... ... @@ -33,14 +33,6 @@
33 33  
34 34 spark:
35 35 A.
36   - (format table)time elapsed: 6.000126s
37   - (read table)time elapsed: 1.508087s
38   - (process)time elapsed: 42.894284 s
39   - real 65.39s
40   - user 11.87s
41   - sys 1.03s
42   - CPU 19%
43   - B.
44 36 (format table)time elapsed: 6.776471s
45 37 (read table)time elapsed: 0.060646s
46 38 (process)time elapsed: 39.127508 s
... ... @@ -48,7 +40,7 @@
48 40 user 11.81s
49 41 sys 1.09s
50 42 CPU 21%
51   - C.
  43 + B.
52 44 (format table)time elapsed: 6.470915s
53 45 (read table)time elapsed: 1.542012s
54 46 (process)time elapsed: 35.019916 s
... ... @@ -56,6 +48,14 @@
56 48 user 11.82s
57 49 sys 1.11s
58 50 CPU 22%
  51 + C.
  52 + (format table)time elapsed: 5.734575s
  53 + (read table)time elapsed: 1.485326s
  54 + (process)time elapsed: 35.217565 s
  55 + real 57.13s
  56 + user 12.15s
  57 + sys 1.06s
  58 + CPU 23%
59 59  
60 60  
61 61  
... ... @@ -105,15 +105,15 @@
105 105 user 14.52s
106 106 sys 1.62s
107 107 CPU 11%
108   - B.
109   - (format table)time elapsed: 23.364605s
110   - (read table)time elapsed: 4.563199s
111   - (process)time elapsed: 82.351650 s
112   - real 133.53s
113   - user 14.99s
114   - sys 1.81s
115   - CPU 12%
116   -
  108 + C.
  109 + (format table)time elapsed: 13.773469s
  110 + (read table)time elapsed: 3.047374s
  111 + (process)time elapsed: 45.717876 s
  112 + real 90.10s
  113 + user 13.60s
  114 + sys 1.43s
  115 + CPU 16%
  116 +
117 117  
118 118 (3)file sum = 500
119 119  
... ... @@ -169,6 +169,7 @@
169 169 sys 2.71s
170 170 CPU 11%
171 171  
  172 +
172 173  
173 174 (4)file sum = 1000
174 175  
... ... @@ -216,6 +217,14 @@
216 217 user 29.12s
217 218 sys 3.91s
218 219 CPU 7%
  220 + C
  221 + (format table)time elapsed: 120.458491s
  222 + (read table)time elapsed: 0.586775s
  223 + (process)time elapsed: 163.598833 s
  224 + real 486.40s
  225 + user 28.65s
  226 + sys 5.33s
  227 + CPU 6%
219 228  
220 229  
221 230  
... ... @@ -227,7 +236,6 @@
227 236 (format)time elapsed: 14.960961s
228 237 (embed)time elapsed: 679.357936s
229 238 (extract)time elapsed: 1256.341536s
230   - time elapsed: 1256.341536s
231 239 real 1951.35s
232 240 user 1942.26s
233 241 sys 3.25s
... ... @@ -236,13 +244,20 @@
236 244 (format)time elapsed: 34.474327s
237 245 (embed)time elapsed: 660.667673s
238 246 (extract)time elapsed: 1232.833102s
239   - time elapsed: 1256.341536s
240 247 real 1928.65s
241 248 user 1900.41s
242 249 sys 3.30s
243 250 CPU 98%
244 251 C.
  252 + (format)time elapsed: 10.912531s
  253 + (embed)time elapsed: 661.449268s
  254 + (extract)time elapsed: 1233.958305s
  255 + real 1907.00s
  256 + user 1901.39s
  257 + sys 3.19s
  258 + CPU 99%
245 259  
  260 +
246 261 spark:
247 262 A.
248 263 (format table)time elapsed: 176.126157s
... ... @@ -260,7 +275,14 @@
260 275 user 51.49s
261 276 sys 6.66s
262 277 CPU 6%
263   -
  278 + C.
  279 + (format table)time elapsed: 210.607617s
  280 + (read table)time elapsed: 1.118159s
  281 + (process)time elapsed: 354.279433 s
  282 + real 995.37s
  283 + user 56.69s
  284 + sys 11.84s
  285 + CPU 6%
264 286  
265 287  
266 288 (6)file sum = 5000
... ... @@ -276,24 +298,23 @@
276 298 CPU 99%
277 299 B.
278 300 (format)time elapsed: 99.882375s
279   - (embed)time elapsed: 1652.537536s
280   - (extract)time elapsed: 3067.980390s
281   - real 4761.09s
282   - user 4727.25s
283   - sys 7.79s
284   - CPU 99%
  301 + (embed)time elapsed: 1600.979427s
  302 + (extract)time elapsed: 2970.367912s
  303 + real 4671.91s
  304 + user 4578.77s
  305 + sys 7.62s
  306 + CPU 98%
285 307 C.
286   -
  308 + (format)time elapsed: 30.885324s
  309 + (embed)time elapsed: 1612.269242s
  310 + (extract)time elapsed: 2973.932865s
  311 + real 4617.78s
  312 + user 4596.83s
  313 + sys 7.40s
  314 + CPU 99%
  315 +
287 316 spark:
288 317 A.
289   - (format table)time elapsed: 574.920005s
290   - (read table)time elapsed: 78.910062s
291   - (process)time elapsed: 924.918864 s
292   - real 2009.23s
293   - user 161.41s
294   - sys 25.33s
295   - CPU 9%
296   - B.
297 318 (format table)time elapsed: 958.231221s
298 319 (read table)time elapsed: 88.844213s
299 320 (process)time elapsed: 852.649969 s
... ... @@ -301,7 +322,7 @@
301 322 user 101.27s
302 323 sys 30.68s
303 324 CPU 4%
304   - C.
  325 + B.
305 326 (format table)time elapsed: 486.504693s
306 327 (read table)time elapsed: 3.625127s
307 328 (process)time elapsed: 811.479755 s
... ... @@ -309,6 +330,14 @@
309 330 user 126.35s
310 331 sys 36.82s
311 332 CPU 6%
  333 + C.
  334 + (format table)time elapsed: 715.228832s
  335 + (read table)time elapsed: 42.838806s
  336 + (process)time elapsed: 821.420032 s
  337 + real 2282.66s
  338 + user 138.61s
  339 + sys 30.21s
  340 + CPU 7%
312 341  
313 342  
314 343 0x01 model performance benchmark (with file sum = 5000)
... ...