Home > Blogs > VMware vFabric Blog > Tag Archives: cluster

Tag Archives: cluster

Scaling and Modernizing .NET and Java: SQLFire Performance Test Blows Away Traditional RDBMS

We all know the devil is in the details when it comes to technology.

Yet, our recent vFabric SQLFire performance test (a benchmark from vFabric SQLFire Best Practices Guide) is certainly worth review if you need to scale a Java app, .NET app, or other legacy data source.

If you don’t know what vFabric SQLFire is, it is basically what happens when Apache Derby gets married to vFabric GemFire:

  • Apache Derby is used for its RDBMS components, JDBC driver, query engine, and network server.
  • The partitioning technology of GemFire is used to implement horizontal partitioning features of vFabric SQLFire.
  • vFabric SQLFire specifically enhances the Apache Derby components, such as the query engine, the SQL interface, data persistence, and data eviction, as well as adding additional components like SQL commands, stored procedures, system tables, functions, persistence disk stores, listeners, and locators, to operate a highly distributed and fault tolerant data management cluster.

Continue reading

Map-Reduce Style: Data Aware Distributed Querying in vFabric GemFire

vFabric GemFire ArchitectureBig, fast data is powering some of the most interesting computing opportunities in today’s market. But in order to get there, we need to change our approach to the data tier. Enterprises are trying to move from costly mainframe architectures to virtualized datacenters and utilize commodity hardware more efficiently. With the data tier, this means an architecture that scales horizontally by adding more commodity-based computing and storage at runtime.

To scale the data tier horizontally, companies use systems like vFabric GemFire, a distributed data system that is designed to specifically accommodate large data sets across commodity hardware nodes. In GemFire, data is spread across members of a cluster with members referred to as “nodes,” and the distribution of data across those nodes is called “partitioning.” vFabric GemFire then allows developers to query the data that resides across many nodes while retaining core values of very high performance at scale. How? In short, the answer is “Data Aware Querying” – a query API that allows a query to execute on selective nodes instead of all nodes (i.e. execute in a map-reduce style).

Continue reading

3 Signs Your Relational Database Must Go

Application and operations teams sometimes reach a point where they must upgrade the database. Whether it’s due to data growth, lack of throughput, too much downtime, the need to share data globally, adding ETLs, or otherwise, it’s never a small project. Since these projects are expensive, any recommendation requires a solid justification.  This article a) characterizes 3 signs where traditional databases hit a wall, b) explains how vFabric SQLFire provides an advantage over traditional databases in each case, and c) should help you make a case for moving towards an in-memory, distributed data grid based on SQL.

For those of us tasked with upgrading (or architecting) the data layer, we all go through similar steps. We build a project plan, make projections and sizing estimates, perform architecture and code reviews, create configuration checklists, provide hardware budgets and plans, talk to vendors about options, and more.  Then, we work to plan the deployment with the least downtime, procure hardware and software, test different data load times, evaluate project risks, develop back-up plans, prepare communications to users about downtime, etc. You know the drill. These projects can take months and consume a fair amount of internal resources or consulting dollars. If you are starting or working on one of these types of projects with a traditional database architecture in mind, are you considering these 3 signs as you consider your options? Continue reading

Webcast: Big, Fast, Flexible Data with Cloud Delivery

As we’ve previously covered, data growth is quite unbelievable, and this means traditional database models are being stretched. On Tuesday, November 13, 2012 at 9:00 AM PST, VMware’s Joe Russell will be presenting on several topics related to Big, Fast, Flexible Data and how VMWare’s key data management technologies help companies overcome some of the key challenges with traditional RDBMS.

Attend to learn:

  • How Hadoop and new analytics technologies are allowing companies to use Big Data in new ways to gain meaningful business insights
  • What’s new with Project Serengeti, a VMware initiative to help you deploy and manage elastic Hadoop clusters in minutes
  • How Fast Data is bringing data logic in-memory, allowing for dramatic scale, reduced costs, and improved performance
  • How Flexibile Data, includng NoSQL and open source relational data technologies can improve your data model
  • How virtualizing the database layer enables a new Cloud Delivery Model, allowing enterprise IT departments to offer self-service data services elastically on demand, maintain centralized control, and operate within regulatory guidelines

>> Register for the webinar Big, Fast, Flexible Data with Cloud Delivery on Tuesday, November 13, 2012 at 9:00 AM PST.

ROBLOX: RabbitMQ, Hybrid Clouds, and 1 Billion Page Views/Month

Online video games have amazing software architectures, particularly when they support millions or billions of transactions.

One of the most interesting companies in this growing industry is ROBLOX.

If you haven’t heard of ROBLOX, they allow users develop their own games – creating players, 3D worlds, and objects from first-person shooters to genres like military and sci-fi. They are able to share these games with others, and, of course, play them. The ROBLOX application also has a built in advertising system, social network, and virtual economy with currencies. According to their website, they generate:

  • Over one billion page views, 29 million in-game hours, and 10 million unique visitors per month.
  • Players created 5.4 million games and spent over 250 million hours of game-play in 2011

Continue reading

Clustered Zend Server Application Blueprint Available

As the Application Management team attends ZendCon this week, we will be sharing with attendees the new Clustered Zend Server Application Blueprint now available on the Cloud Application Management Marketplace BETA.

This blueprint is a ready-to-use, clustered deployment of the popular PHP Application Server, Zend Server. Using vFabric™ Application Director, users can download this blueprint and deploy a fully configured, clustered PHP Zend Server as a service onto any vCloud Director registered cloud. Continue reading

VMware @Zendcon Oct 22-25 in Santa Clara, CA

VMware will be at Zendcon next week!  Of course, there will be content covering PHP best practices, architecture, design, and development. As well, a key theme this year will be around cloud-based technologies.  Komal Mangtani, VMware Engineering Director, will be presenting a session about Application Director and Zend Server on Tuesday, October 23rd, from 5:15p to 6:15p.

Continue reading

Why DBaaS? 5 Trends Pushing Database as a Service

What if you could provision a highly available, compliant database in one click? For many, this sounds impossible…particularly behind the firewall. Yet, it is possible today because database management has changed.

The change has been driven by years, perhaps decades, of unmet needs. For example, we’ve all heard these types of comments made inside our respective companies:

  1. “Could we have a temporary copy of the database to use for a few days?”
  2. “We can finish faster doing it ourselves with a PC under someone’s desk.”
  3. “Didn’t we just buy a bunch of new database licenses?”
  4. “I have to test this with production data.”
  5. “It would be crazy to put two databases on the same server.

Continue reading

Virtualization for Oracle DBs – Some cut TCO by 50%

Learn More

Register for the Webcast "Virtualize and Manage Oracle Databases with VMware vFabric Data Director"

Date: Thursday, July 26, 2012 @ 9:00 AM PDT

Register or View

One of the biggest IT megatrends of the new millennium has been virtualization.  As of 2011:

While that sounds (and is) impressive, it will draw little more than a yawn from most of many of my DBA and ETL friends.  “Virtualization is great and all”, they say, “but we do real work.  You know, we work with Oracle and with data.” 

And, therein lies the rub.  

Database Virtualization Needs

If there is any part of enterprise that needs to increase flexibility and reduce cost, it is on the data side of IT.  For example, database operations suffer from: 

Continue reading

VMware vFabric Suite 5.1 Significantly Upgrades vFabric RabbitMQ

Rabbitmq_logo_strapvFabric RabbitMQ, based on the open source RabbitMQ project, has significantly updated the underlying RabbitMQ version to 2.8.1 in the latest VMware vFabric Suite 5.1 update. 

The new vFabric RabbitMQ release represents a significant upgrade from the open source RabbitMQ 2.4.1 that vFabric 5.0 was based on, and brings the commercially supported vFabric RabbitMQ to parity with recent open source RabbitMQ releases by rolling up all of the interim code changes. Furthermore, users now have the option of choosing to use the commercially bundled vFabric RabbitMQ from VMware or using the open source RabbitMQ distribution with a single license. Either way a user chooses, they can receive the same reliable support from VMware.

Performance Improvements

  • New internal message flow control to limit memory use and make performance more predictable if the server is overloaded
  • Recovery has been simplified, improving startup times when many exchanges or bindings exist
  • Better performance under high load and memory pressure
  • Improved inbound network performance
  • Improved routing performance
  • Significant performance improvements to connection creation, durable queues, message storage, and large numbers of consumers

Continue reading