News Article
Selecting the database platform for ASTRID
Selecting the database platform for ASTRID

Published: 2012-04-20 in Technology

Finding the right database technology is paramount for the development of our strong-AI system. There are several important features needed in the data platform we are going to use, speed of data-reads being just about the most crucial.

 

After looking at the usual suspects like PostgreSQL, MySQL, SQLite and many others, we finally have chosen PyTables as the best bet for our data-platform. Most database management systems are making a trade-off between reasonably fast updates and reasonably fast reads of data. Based on several evaluations available on the web, we found that PyTables smokes all competition when it comes to superfast data retrieval.

 

In addition, of being very fast on reading large datasets, PyTables has the added bonus of being a native Python-based system. As we have Python selected as our main development platform, integrating PyTables will be easy.

MySQL will be used alongside PyTables for less speed-intensive data-tasks.

 

NOTE: This news-article is presented here for historical perspective only.

This article is more than two years old. Therefore, information in this article might have changed, become incomplete, or even completely invalid since its publication date. Included weblinks (if present in this article) might point to pages that no longer exist, have been moved over time, or now contain unrelated or insufficient information. No expectations or conclusions should be derived from this article or any forward-looking statements therein.

Telegram
LinkedIn
Reddit
© 2024 MIND|CONSTRUCT  
Other Articles in Technology
 
  News
  • 2024-05-13 - Codedness platform does Clojure 
  • 2023-07-27 - A new 'Database paradigm' for ASTRID 
  • 2021-09-30 - ASTRID production code sets new training speed record 
  • 2021-05-20 - ASTRID code rewrite for production started 
  • 2017-12-08 - Major milestone: Knowledge Representation implemented 
  • 2015-10-30 - Beyond the XEROX benchmark POS-tagger  
  • 2015-06-01 - Major milestone: POS-tagger implemented 
  • 2015-03-02 - Prototype development started 
  • 2012-04-19 - Basic development tooling selected 

 
  Blogs
  • 2023-01-17 - How choosing Clojure made us come full circle - Hans Peter Willems - CEO MIND|CONSTRUCT