MicroStream SaaS Cluster

MicroStream SaaS Cluster is a powerful, enterprise-grade platform designed to run EclipseStore applications in a distributed, highly available, and scalable manner. By leveraging the power of Kubernetes and more, MicroStream Cluster provides a robust and efficient infrastructure for your data-intensive mission-critical applications.

Key Features

  • Distributed Architecture: Distributes your EclipseStore application across multiple nodes for improved performance and scalability.

  • High Availability: Ensures continuous operation through redundancy and automatic failover mechanisms.

  • Data Redundancy: Protects your data by replicating it across multiple nodes. For more details on backups and data storage, see here.

  • Flexible Scaling: Automatically scales your cluster up or down based on workload demands. For more details, see here.

  • Robust Security: Implements stringent security measures to safeguard your data and applications.

  • Comprehensive Monitoring and Alerting: Provides real-time insights into your cluster’s health and performance.

  • User-Friendly Management: Offers a convenient UI for easy setup, configuration, and management.

Deployment Options

MicroStream Cluster is available as SaaS and On-Prem, so you have the flexibility to deploy your MicroStream Cluster in two ways:

1. SaaS:

  • Fully Managed: MicroStream Cluster is a fully managed service, where you do not have to worry about the underlying infrastructure, including Kubernetes, network configuration, and security.

  • Simplified Deployment: Deploy your application as a simple JAR file without the need for Kubernetes expertise.

  • Elastic Scaling: Automatically scale your cluster to handle varying workloads.

  • Built-in Monitoring and Alerting: Gain valuable insights into your cluster’s performance and receive timely notifications.

2. On-Premise:

  • Self-Managed: Take full control over your infrastructure, deploying and managing Kubernetes and other components on your own premises.

  • Expert Support: Leverage MicroStream’s consulting and professional support services for guidance on setup, maintenance, and optimization.

MicroStream Cluster runs also with only one single node. To achieve high availability and data redundancy, you must run at least 2 nodes, 1 Writer and 1 Reader node.

Choose the deployment option that best aligns with your specific needs and preferences.

While EclipseStore is an open-source project, MicroStream Cluster is a proprietary enterprise software solution that provides advanced features, enterprise support, and security.

Elastic Horizontal Scaling

MicroStream Cluster offers seamless horizontal scaling, allowing you to dynamically adjust the number of nodes in your cluster to accommodate changing workloads. This ensures optimal performance and resource utilization.

Key Advantages of Elastic Scaling:

  • Scalability: Easily handle increased traffic and data volumes by adding more nodes to the cluster.

  • Cost-Efficiency: Scale down the cluster during periods of low demand to reduce infrastructure costs.

  • Resilience: Distribute the workload across multiple nodes, minimizing the impact of individual node failures.

  • Performance Optimization: Adapt to varying workloads by dynamically adjusting the cluster size.

On-Premises Benefits of Elastic Scaling:

Even in on-premises environments, elastic scaling offers significant advantages:

  • Adaptability to Changing Demands: Respond to sudden spikes in traffic or data growth by automatically scaling the cluster.

  • Resource Optimization: Avoid overprovisioning resources and reduce operational costs by scaling down during off-peak hours.

  • Improved Performance: Distribute the workload across multiple nodes to improve response times and throughput.

  • Enhanced Reliability: Mitigate the risk of single-point failures by maintaining a redundant cluster.

By leveraging elastic scaling, you can ensure that your MicroStream Cluster remains highly available, performant, and cost-effective, regardless of the deployment environment.

Backup Process

MicroStream Cluster employs an event-based backup strategy. This approach involves capturing changes to the data as they occur and storing them in an event stream. To create a backup, the system replays these events, incrementally building a complete copy of the data.

Advantages of Event-Based Backup:

  • Efficiency: Only the latest changes are captured, reducing the backup size and transfer time.

  • Incremental Backups: Backups can be created incrementally, minimizing the impact on system performance.

  • Point-in-Time Recovery: By replaying events up to a specific point in time, it’s possible to restore the system to a previous state.

  • Faster Recovery: Incremental backups can be restored more quickly, as only the changes since the last full backup need to be applied.

This event-based approach provides a robust and efficient backup solution for MicroStream Cluster.

Data Storage and Replication

Each node in the MicroStream Cluster maintains its complete copy of the data. This distributed storage approach offers several advantages:

  • High Availability: If a node fails, the data can be recovered from other nodes in the cluster, minimizing downtime.

  • Scalability: The cluster can be scaled horizontally by adding more nodes, increasing both storage capacity and processing power.

  • Performance: By distributing data across multiple nodes, the cluster can achieve high read and write performance. Additionally, having a full copy of the data on each node eliminates the network latency associated with accessing data from a shared storage system, leading to faster data access and reduced response times.

Sharding

While MicroStream Cluster doesn’t implement automatic sharding, it supports logical sharding at the application level. By carefully designing your data model and partitioning strategies, you can distribute data across nodes based on specific criteria, such as user ID, geographic location, or other relevant factors. This allows you to scale your cluster efficiently and optimize performance.

Storage Options

  • SaaS on AWS: Leverages Amazon Elastic File Store (EFS) as the default storage option. EFS provides durable and reliable block storage for high-performance applications.

  • On-Premises: Offers flexibility in storage choices, including:

    • Traditional Storage: HDDs and SSDs for general-purpose storage needs.

    • Object Storage: S3-compatible solutions like MinIO.

    • Persistent Memory: High-performance memory devices for accelerating data access and reducing latency.

The optimal storage solution depends on factors such as performance requirements, cost considerations, and data durability needs.