Big Data Integration
Solving the Fast Data Problem For the Cloud: VoltDB-SoftLayer Benchmark
VoltDb, the industry’s fastest in-memory operational NewSQL database, and the global cloud computing platform from SoftLayer, an IBM company, provides users with the performance of bare metal and the Fast Data processing capabilities required to analyze and make real-time decisions to meet the needs of today’s high-volume, high-velocity businesses.
To be useful, a database needs to be both reliable and available. Durability ensures the persistence of the data in case the database and the server it runs on fail. Availability is the ability to withstand system failures that would normally disrupt the database’s ability to function. It not only preserves the data, but availability also plays a crucial role in ensuring that the database process itself is able to survive.
Durability is one of the four key ACID attributes required to ensure the accurate and reliable operation of a transactional database. Simply put, durability ensures that any transaction that succeeds is committed to the database and made persistent. Even in the event of a power failure or other unexpected occurrence, transactions that have been committed survive permanently. In reverse, any transactions that fail or are interrupted will “roll back” and not affect database integrity.
Without parallelism, the performance of a software system is limited to the speed of a single CPU. In recent years, advances in single-CPU performance have slowed, disproportionate to the increased number of cores-per-machine now packed into commodity servers. Hardware design dictates that, to achieve higher performance, a workload must be parallel.
Scalability is the ability of a system to handle larger workloads by enlarging the system in a straightforward manner. In practice, however, it is often impossible to plan for the scenarios that will most benefit from highly scalable systems. Workloads can drastically expand due to business growth, new application features, and usage patterns. How will your application grow eight years down the line?
VoltDB’s unique and powerful transaction system makes writing simple, fast and reliable real-time analytics and decisioning applications easy. VoltDB supports complex multi-SQL-statement ACID transactions. The transactional system in VoltDB supports serializable isolation, complete multistatement atomicity and roll-back, and strong durability guarantees.
VoltCache: Developing Key/Value Applications Using VoltDB
Memcached is a popular caching infrastructure for high-scaling web applications. It provides a scalable, Key/Value interface that allows developers to offload repetitive read operations from the underlying database (typically MySQL). VoltCache is a reference implementation that illustrates how VoltDB can be used to support memcached-style applications. It includes a Key/Value function library that models popular memcached API calls (GET, PUT, EXPIRE, etc.), and is provided with full source code.
Hadoop is an open-source framework for managing massive amounts of historical data. VoltDB is an in-memory relational database for managing in-the-moment high velocity data. Business applications often require both instantaneous, reliable database execution as well as the archival and analysis of historical data. VoltDB lets you integrate VoltDB and Hadoop to address both needs and get a full picture of your data. This whitepaper explains how.
HP Vertica Database Integration
Many businesses can’t ingest and analyze data as fast as they need to; nor can they make the most of historical data. With VoltDB’s HP Vertica Export Client, organizations can have a database solution that captures not just the front end of Big Data but the back end as well. Merging Vertica’s deep analysis of historical information with VoltDB’s in-the-moment decisioning and analytics in a closed-loop system, businesses can tap vital customer information that makes the difference between profit and loss.
IBM Netezza Database Integration
Data has immense value when it’s created, but if businesses can’t tap it immediately, they’ve lost sight of their customers. Organizations also need to mine historical data to make sense of patterns and trends. That’s why VoltDB’s IBM Netezza Export Client combines historical and in-the-moment data to provide a complete picture to businesses. With a closed-loop system, a single encompassing view of data can empower businesses.
SQL Is Time Tested And Still Flourishing
Structured Query Language (SQL) is far from dead. It continues to help modern databases handle both large-volume analytic workloads and high-performance transaction processing workloads. Facebook, Google and other organizations use SQL to improve interactivity with data, integrate with standard tooling interfaces and deliver on meaningful query optimization. In this article — most of which originally appeared in a Network World feature that debated SQL and NoSQL technologies — VoltDB CTO Ryan Betts lays out why SQL continues to win in the big data market space.
Survey Reveals Big Data Goes to Waste at Most Organizations
In Q1, 2014, VoltDB polled database managers, analysts, administrators and other IT professionals about the databases they use, the results of their Big Data projects, and opinions about Big Data technology advancements. The 2014 Big Data Survey reveals that most organizations cannot access, let alone utilize, the vast majority of the data they collect, and exposes a major Big Data divide: the ability to successfully capture and store huge amounts of data is not translating to improved bottom-line business benefits. What’s to blame? Deficiencies in database performance.
The VoltDB Technical Overview is a white paper that covers VoltDB architectural concepts, identifies popular use cases and provides information about how to get started using VoltDB. This white paper covers a range of VoltDB topics, including:
- VoltDB’s main memory architecture
- Partitioning and scaling across a shared nothing server cluster
- Built-in High Availability using synchronous multi-master replication
- Built-in durability using command logging and database replication
VoltDB In-memory Database Achieves Best-in-class Results, Running in the Cloud, on the YCSB Benchmark
Our dev team recently put VoltDB up against the Yahoo Cloud Serving Benchmark (YCSB) – an industry-standard performance benchmark for cloud databases. And, it went well. Very well. This overview breaks down the benchmark – and VoltDB’s best-in-class performance.