Tuesday, February 3, 2009

Red Hat Enterprise MRG 1.1 is Released

I'm pleased to announce that we released Red Hat Enterprise MRG 1.1 today.  This is a significant release that adds many new capabilities and performance enhancements.  It also introduces formal support around
the Grid component and entire MRG platform for the first time (Grid was Technology Preview in v1.0).  Some of the highlights of MRG 1.1 include:

  • Messaging
    • Native infiniband and RDMA driver for dramatically better
      latency
    • Active/Active Clustering
    • Enhanced security
    • Queue semantics like Last Value Queue and Ring Queue
    • Native .NET client
    • Improved management tools
    • Increased performance
  • Realtime
    • Improved performance, especially on boxes with higher CPU-counts
    • Improved performance tools. For example, Tuna now has the ability to write tunings to an init script once you've found an optimal tuning for your system
  • Grid
    • New GUI management tools
    • Low latency scheduling via MRG's messaging bus
    • Amazon EC2 support for adding capacity on-the-fly in the cloud
    • Concurrency limits on any scarce resource like software licenses or database handles
    • Dynamic provisioning, which enables you to mark slots as partitionable and sub-divide them dynamically so that more than one job can occupy a slot at once

You can find out more about MRG at http://redhat.com/mrg.  Also, you can read the press announcement for MRG 1.1 at http://www.press.redhat.com/2009/02/04/red-hat-debuts-enterprise-mrg-11/.

Friday, November 7, 2008

STAC Benchmark Results for Red Hat Enterprise MRG Realtime

STAC Research performs a number of third-party benchmarks for the financial community.  Recently, they performed a benchmark of RMDS on top of a system running Red Hat Enterprise MRG Realtime.  Our realtime offering enhances Red Hat Enterprise Linux with deterministic latency and performance for critical applications like RMDS.

The results of this test included:

- Lowest mean latency reported to date with RMDS
Less than 1ms mean latency at up to 700,000 updates per second
- Standard deviation of latency remained below 0.5 ms through 600,000 updates per second
- In the "Producer 50/50" fanout test of a multiplexed P2PS, total output was:
7.07M updates per second with jumbo frames (MTU = 9000 bytes)
5.56M updates per second with standard frames (MTU = 1500 bytes)
You can see the entire summary and report here.

QPid Welcomes a New Member

QPid is the upstream open source project led by Apache that Red Hat participates heavily in to help develop Red Hat Enterprise MRG and to provide AMQP in Fedora.  The initial QPid proposal was submitted by a Red Hat engineer to Apache, and the QPid community has grown significantly since then to include a large set of diverse participants.

Building on the recent announcement that it has joined the AMQP working group, Microsoft has now announced that it will be joining and contributing to the open source QPid project at Apache to build its AMQP implementation.  This is also great news for the open source world and a bold new step for Microsoft. 

As we previously highlighted, Microsoft adopting the open AMQP standard will enable a new wave of innovation and interoperability—especially between Linux and Windows.  Now that Microsoft will be working on development of AMQP software in open source, we expect this  to further enhance the interoperability between Linux and Windows—they will not only speak the same protocol but share the same open source code base for that communication, offering an opportunity for Microsoft to build its relationship with the open source community.

The  Advantages of Open Source
With Qpid’s new addition, there are several highlights to point out:

  • Open source provides a way for active contributors and community members to accelerate significantly the timeline in which vendors like Microsoft can provide an AMQP implementation.  By joining an established open source project, these such vendors are able to reap the benefits of all the engineering work that many of the leading messaging developers in the world have already done.  Now, these developers in the QPid project will also benefit from Microsoft's contributions.
  • There are strategic benefits in joining an open source community.  QPid is distributed under an Apache license.  So, a vendor could easily just take the QPid code base, fork it for internal use, and then proceed to build its own, proprietary AMQP implementation.  By joining the QPid project, Microsoft will not have total control over the direction of the code base beneath its products, and its engineers will have to earn their commit rights and status the same way that other QPid committers have.  Still, as companies like Red Hat have shown, building products collaboratively in the open source community leads to more rapid innovation and the opportunity to create better software.
  • There is value in the QPid community and implementation.  There are multiple open source projects that are implementing AMQP (this is great for making AMQP pervasive).  However, that Microsoft is joining QPid indicates that it sees significant value and leadership in QPid.  Indeed, QPid is the first open source project to achieve compliance with the latest version of AMQP (0-10).  QPid also has support for a wide variety of platforms, including .NET.  Indeed, Red Hat engineers have developed a native WCF-compliant .NET client for QPid.  Others in the community have contributed an Excel plugin for QPid and are driving the advancement of the QPid broker on Windows.
Red Hat welcomes new members to the QPid open source community to help
expand its technology and continue to create long-term benefits for the project, community and its members.  For more information, see here.

* Note: I have also published this blog at http://press.redhat.com.  You can see other MRG blog entries there at http://www.press.redhat.com/category/red-hat-enterprise-mrg/

Friday, October 24, 2008

AMQP and Fedora 10

I love AMQP, I love Fedora, and I love blog entries that list AMQP support as the number 1 feature of Fedora 10!

Welcome to AMQP, Microsoft

Today, Microsoft announced that it has joined the AMQP working group.  As a founding member of the AMQP working group, we at Red Hat are excited about this development.

Just as Red Hat has been adding native AMQP support into the Linux platform and ecosystem at Fedora and through Red Hat Enterprise MRG, Microsoft is bringing AMQP support to Windows and its ecosystem.  Between Linux and Windows, AMQP will become a standard messaging facility on the vast majority of operating systems and server platforms.  It will offer a new level of interoperability between Linux and Windows using open standards and open source software.  And, it is designed to lead to breakthroughs in everything from core infrastructure software to management tools to next-generation applications and architectures.   At Red Hat, we are already building upon our AMQP messaging implementation for everything from virtualization management to security management to monitoring.

Enabling Next-Generation Architectures
AMQP (Advanced Message Queuing Protocol) is the industry's first standard for messaging that spans from the wire-level to the semantics of messaging; it provides a full specification of an Internet Protocol for business messaging.  This is significant because before the arrival of AMQP, no two messaging implementations could natively interoperate with each other—even though messaging software's core mission is to distribute data across disparate systems.  Furthermore, with the rise of messaging-based architectures like SOA or EDA and the critical nature of messaging to many of today's networked applications, the lack of a standard in messaging is a major obstacle for integration and developing next-generation applications.

People used to have to purchase TCP/IP stacks until they became a standard facility in operating systems.  Once that happened, there was a tremendous leap forward in networking and networked applications, even though the technology was previously available.  The fact that everyone could now count on this same network protocol to be ubiquitous and interoperable meant that applications and architectures started depending and building upon this capability in ways that previously no one had envisioned.  The same thing happened with other standards, like http.  The same thing is happening with technologies like virtualization.  And, the same thing will happen in the messaging space via AMQP—in today's networked world, when developers can count on the prevalence of a common messaging protocol with authentication, security, reliability, and all the desired patterns like point-to-point, publish/subscribe, or eventing, they will unleash a new generation of applications and architectures that we have only begun to imagine.

Microsoft's joining AMQP and decision to integrate AMQP into its platforms, combined with the work that we have already been doing with AMQP at Red Hat and elsewhere, has made the fulfillment of AMQP's promise inevitable and quite exciting.  But, this does not diminish the contribution of others.  The AMQP working group already has a well-esteemed set of members, ranging from software vendors like Red Hat to hardware vendors like Cisco to end-users like JP Morgan Chase, Goldman Sachs, Credit Suisse, and Deutsche Börse (see the full list of participants at http://amqp.org).  Indeed, one of the unique hallmarks of the AMQP working group is that it started as an initiative at an end-user (JPMC) and has many other end-users contributing to the specification.  This ensures that AMQP is developing into a standard that solves and addresses significant real-world issues rather than just being a lowest-common denominator amongst various competing vendors.

Legal Note
Because this will be of concern to many people—particularly in the open source community—it is worth pointing out one of the legal ramifications of Microsoft joining AMQP.  There is a strong IP provision in the contract for joining the AMQP working group.  Anyone joining the AMQP working group must freely license IP that is used by AMQP—AMQP is and will always be an open standard that is free to implement.  By joining the AMQP working group, Microsoft has signed this contract.  So, there is no threat of Microsoft holding the AMQP standard hostage via patent threats.

* Note: I have also published this blog at http://press.redhat.com.  You can see other MRG blog entries there at http://www.press.redhat.com/category/red-hat-enterprise-mrg/

Sunday, September 21, 2008

High Performance on Wall St

I'll be at the High Performance on Wall St show tomorrow in NYC at the Roosevelt Hotel.  This should be an interesting show, despite (in part, because of?) the recent turmoil on Wall St--all the recent financial calamity isn't going to reduce financial service's need for computational power.

I'm going to be speaking on a panel at 4pm on "Building The Perfect Financial Services Data Center."  Red Hat has a booth (#102), where we'll be debuting publicly the new GUI Tools we've developed around Condor for Red Hat Enterprise MRG as well as showing off our integration between MRG and Amazon's EC2 Cloud.  Come check us out if you're at the show!

Friday, August 1, 2008

Can AMQP break IBM's MOM monopoly?

Jeff Gould at InteropSystems has written a great series of articles about the value and promise of AMQP.  Part 1 of the article is here: Can AMQP break IBM's MOM monopoly?  In part 2 of the series, Gould interviews Red Hat's Carl Trieloff, who talks about what we're doing with AMQP, JBoss and MRG.