Hello Forum,
We’ve tested ROS ext4 vs ROS hdfs and found that there is almost no difference in performance.
The environment was this:
Vertica:
3 nodes
4 cores 16 Gb
HWX
3 Data Node
2 cores 4 Gb
3 Name Node
2 cores 4 Gb
Both on the same physical host 2xX5670 6 cores 2.93 Ghz,
We ran just one heavy query on the raw data size about 100 Gb, The result was:
Ext 4 – 70s
Hdfs – 80s.
Can anybody comment on this?
Should now there really be no difference in performance?
I remember the benchmarks where ROS hdfs was some 3-4 times slower.
Thank you!
