Berkeley DB is a high-performance key-value store (NoSQL)
that is around for more than 15 years.
Now it can be also combined with SQLite to enable SQL interface to data.
Saturday, December 22, 2012
Oracle Berkeley DB + SQLite
Oracle Berkeley DB: SQL
Berkeley DB is a high-performance key-value store (NoSQL)
that is around for more than 15 years.
Now it can be also combined with SQLite to enable SQL interface to data.
Berkeley DB is a high-performance key-value store (NoSQL)
that is around for more than 15 years.
Now it can be also combined with SQLite to enable SQL interface to data.
Embedded DB for .NET: SQL CE 4.0 vs SQLite
Benchmarking the Performance of Embedded DB for .NET: SQL CE 4.0 vs SQLite - CodeProject
WinRT (Windows 8 Store Apps) SDK does not include ANY database tool.
Maybe Microsoft wants to promote saving data to "cloud".
Problem is that devices are not always connected to cloud,
and speed of local storage is usually much better than online.
So people are using same SQLite open source db
that is included in both iOS and Android,
as well as Firefox and Chrome browsers.
And while SQLite is in fact quite fast,
SQL CE 4.0 embedded database is apparently faster.
SQLite can be "tuned" to be faster for insert/update,
by disabling auto-transaction on each record insert/update.
After this adjustment, insert speed then becomes faster than SQL CE
So, using SQLite makes sense for WinRT, same as for iOS and Android...
SQLite does not have db size limit (Max DB size is 4 GB with SQL CE)
Here are some results of my tests.
The test is simplistic, inserting one integer id and one random string (guid)
to a database table, and then reading same number of records in random order by id.
Test computer is 3.2+ GHz, Windows 8, with SATA3 SSD, .NET 4.5, C#, x86 (DLLs are 32-bit).
Total number of records is 1000000 (to get meaningful time)
With auto-transactions for individual inserts turned of, SQLite is significantly faster than SQL CE, both for inserts (5 times) and selects (3.5 times).
But "raw" text write and read (CSV file) is order of magnitude faster.
Read and write of XML is in the middle between just text and DB
. CSV and XML take some time to be loaded in memory Dictionary (first "select" time),
and with random read from memory takes just a little bit more time.
So, maybe Microsoft designers are right not to include "classic" db API to WinRT.
XML (and JSON) are much faster, and still flexible enough...
For typical apps that may be just what is needed...
@ StackOverflow and here
ADO.NET 2.0 Provider for SQLite
www.sqlite.org
WinRT (Windows 8 Store Apps) SDK does not include ANY database tool.
Maybe Microsoft wants to promote saving data to "cloud".
Problem is that devices are not always connected to cloud,
and speed of local storage is usually much better than online.
So people are using same SQLite open source db
that is included in both iOS and Android,
as well as Firefox and Chrome browsers.
And while SQLite is in fact quite fast,
SQL CE 4.0 embedded database is apparently faster.
SQLite can be "tuned" to be faster for insert/update,
by disabling auto-transaction on each record insert/update.
After this adjustment, insert speed then becomes faster than SQL CE
So, using SQLite makes sense for WinRT, same as for iOS and Android...
SQLite does not have db size limit (Max DB size is 4 GB with SQL CE)
Here are some results of my tests.
The test is simplistic, inserting one integer id and one random string (guid)
to a database table, and then reading same number of records in random order by id.
Test computer is 3.2+ GHz, Windows 8, with SATA3 SSD, .NET 4.5, C#, x86 (DLLs are 32-bit).
Total number of records is 1000000 (to get meaningful time)
| Data Store | Insert | Select | File Size |
|---|---|---|---|
| SQLite 3.6 | 00:00:13.9367974 | 00:00:47.3723601 | 46 MB |
| SQLCE 4.0 | 00:01:07.2235111 | 00:02:36.7300713 | 63 MB |
| CSV (UTF8) | 00:00:01.4611844 | 00:00:01.4281937 00:00:01.9542602 | 44 MB |
| XML (XmlDocument) | 00:00:05.7157254 | 00:00:04.0695283 00:00:04.4985845 | 66 MB |
With auto-transactions for individual inserts turned of, SQLite is significantly faster than SQL CE, both for inserts (5 times) and selects (3.5 times).
But "raw" text write and read (CSV file) is order of magnitude faster.
Read and write of XML is in the middle between just text and DB
. CSV and XML take some time to be loaded in memory Dictionary (first "select" time),
and with random read from memory takes just a little bit more time.
So, maybe Microsoft designers are right not to include "classic" db API to WinRT.
XML (and JSON) are much faster, and still flexible enough...
For typical apps that may be just what is needed...
@ StackOverflow and here
ADO.NET 2.0 Provider for SQLite
www.sqlite.org
2012 IT Skills and Salary Report
2012 IT Skills and Salary Report
For the fifth year in a row, Global Knowledge and TechRepublic have partnered to create a comprehensive IT salary survey. With more than 9,500 responses, the 2012 report has turned out to be one of this year's most relevant and revealing salary surveys in the industry.
list of Salaries by Popular Certifications and Salaries by State.
For the fifth year in a row, Global Knowledge and TechRepublic have partnered to create a comprehensive IT salary survey. With more than 9,500 responses, the 2012 report has turned out to be one of this year's most relevant and revealing salary surveys in the industry.
list of Salaries by Popular Certifications and Salaries by State.
Unconventional and Ultra-Modern Real Estate
Unconventional and Ultra-Modern Real Estate | Zillow Blog
"Modern doesn’t fit inside a box.
While sometimes a modern home is box-like, (or a series of boxes), modern can be round, triangular or even incorporate wave patterns.
All one-of-a-kind, all contemporary, here are modern homes across the U.S."
Like Windows 8 "Modern" GUI... it's all boxes :)
"Modern doesn’t fit inside a box.
While sometimes a modern home is box-like, (or a series of boxes), modern can be round, triangular or even incorporate wave patterns.
All one-of-a-kind, all contemporary, here are modern homes across the U.S."
Like Windows 8 "Modern" GUI... it's all boxes :)
Eclipse / IBM "Orion" Cloud / Web Based IDE
Orion: "Open Source Platform For Cloud Based Development"
@ InfoQ
Exo "Cloud" IDE
While there is quite clear expectation of what is "cloud computing", term "cloud" is increasingly used as a synonym for Web (WWW) technologies...
"Cloud" has a clear advantage for developers,
since it can provide great performance, reliability, ease of access, teamwork etc.
One of significant challenges in Facebook is "long compile time". (no surprise, they are using PHP => C++, and C++ compilers are generally slow).
Google also has solution for this: "build in the cloud",
in memory of servers...
Microsoft is actively working on Roslyn "compiler as a service",
that will likely be usable from a web based UI also.
@ InfoQ
Exo "Cloud" IDE
While there is quite clear expectation of what is "cloud computing", term "cloud" is increasingly used as a synonym for Web (WWW) technologies...
"Cloud" has a clear advantage for developers,
since it can provide great performance, reliability, ease of access, teamwork etc.
One of significant challenges in Facebook is "long compile time". (no surprise, they are using PHP => C++, and C++ compilers are generally slow).
Google also has solution for this: "build in the cloud",
in memory of servers...
Microsoft is actively working on Roslyn "compiler as a service",
that will likely be usable from a web based UI also.
Subscribe to:
Posts (Atom)