Unless you're new here, you've heard of PostGIS several times. It's really hard to find documentation about spatial database benchmarks since, if I'm not mistaken, proprietary software licenses often prohibit publicly sharing such benchmarks (am I right?). And I guess there's at least one good reason for this: doing fair benchmarking is difficult to accomplish. But here's one (currently available) benchmarking report comparing PostGIS (PostgreSQL) and Oracle Spatial.
From the conclusions of the 46-pages report: "From the experimental results that we saw, we can conclude that Postgres performs better than Oracle 11g both in the Cold Phase and Warm Phase. Though in few queries Oracle 11g performed better but on the whole Postgres overpowered Oracle 11g. In the warm phase in 3 out of 4 queries Postgres performed significantly well, from this we can conclude that Postgres has better automatic memory management capabilities and page replacement policies. [...] Since Postgres uses the underlying GEOS (Geometry Engine - Open Source) library functions for implementing the geometric operations whereas Oracle 11g implements them on its own, and since in majority Postgres performs well, we can conclude that GEOS geometric algorithms are more efficiently designed than Oracle 11g. And also Postgres planner is more efficiently designed to take advantage of any available indexes to use in queries for achieving better performance whereas in Oracle 11g we saw that we have to specify them explicitly through functions."
Here's what Paul Ramsey of the PostGIS fame has to say about it: "Methodologically there are two obvious issues: one is that the Oracle database was on Windows while the PostGIS database was on Linux; the other is that neither database got any tuning, they were both installed and run with default parameters. However, this is one of the nicer comparisons I have read: concise, focussed and with enough technical detail to evaluate what's going on."
The link works for me. Here it is (not shortened): http://www.gise.cse.iitb.ac.in/wiki/images/c/c4/Finalreport.pdf
Thanks for this useful _post_Jeez!_ it's an interesting topic (pun intended). On your question in your 1st paragraph, I'm sure you follow FOSS4G conference, which have GI server shoot-out, itself fraught with difficulties but worth it just the same. http://2011.foss4g.org/sessions/wps-shootout Cheers, Andrew
heh, one of the funniest bias "benchmarks" I have seen for a long time. This is not comparing apples with apples, here some reasons:
1) Vanilla (no tuning) Oracle was used (however they did use vanilla PostGres too) – we know Oracle without tuning is real slow, tuning will increase performance by many, many times.
2) Dataset used is small, whereas Oracle targets medium to large size data systems. Previously PostGres has had issues with larger datasets, interested to know what happens if real (size) database was used. I assume all the result times are sub-seconds?
3) Oracle is installed on Windows 7 32bit, and compared against PostGres on Linux? Oracle should have been setup at least on Oracle RedHat Linux as Windows is more like an after thought for Oracle testing.
I am also interested whether testing was done on Oracle 11g Express (which is what I suspect) or on a real commercially purchased version. This would probably also affect the test results as it can be expected that Oracle Express is somewhat crippled.
So I cannot see what the "benchmarker" was trying to prove with this, it certainly does not do a fair comparison on these 2 databases in such a way that a business could use the results on their decision process..
I can't tell if the benchmark has a lot of value in it or not, but I feel your comment would have benefited from actually reading the report.
You certainly ask valid questions and pinpoint real shortcomings of any such benchmarks, but it's sad that you apparently did not read the report because this would have allowed you to provide more insightful and on-topic critics. By the way, I did not myself fully read the report :-) I'm not sure I'm qualified to judge its value and the accuracy of the conclusions anyway.
Actually we tested apples to apples...same VM configurations (OS, hardware, memory, etc.) and Oracle was on avg 30-3000X times faster using this same dataset with the newest releases from both. PostGIS lacks true ENTERPRISE CLASS features and scalability.
Thanks for your input. Do you have any report you can share about the configurations, the datasets, the processing you tested, etc? In order to make decisions, we often need documented and replicable experiments and results.
Re: PostGIS vs Oracle Spatial: PostGIS Wins
Hi,
I would be interested in the benchmarking report, unfortunately the link to report is not working. Is it possible for you to check this?
Thank you, Torsten