Admin

Pegasus not only provides simple key-value storage interfaces; based on stability considerations, we have added many features that help efficient operations and maintenance.

If you are new to Pegasus and want to deploy the compiled system on your machines, you should first refer to Configuration Management to adjust parameters according to your environment. Then refer to Cluster Deployment to deploy Pegasus on your machine cluster.

After a successful deployment, you should focus on observing the system’s runtime status. Refer to Monitoring to view the relevant metrics.

During service operation, occasional anomalies (possibly due to network issues, disk failures, system errors, or potential bugs) may cause cluster fluctuations. If this results in uneven node load, you can perform operations according to Load Balancing.

If business volume grows beyond what your service resources can handle, you can increase the number of nodes by following Scale In/Out. If a machine experiences persistent failure, you can also remove the bad node via Scale In/Out. If a specific SSD disk on a machine fails, refer to Bad Disk Maintenance to remove the faulty disk.

If you need to restart or upgrade the cluster, please refer to Rolling Update.

During cluster operation, you must continuously monitor resource usage (disk, memory, network) and make timely operational adjustments. Please refer to Resource Management.

If the business data volume is large or individual values are long, refer to Compression to improve disk utilization and boost read/write performance.

For some critical businesses, you can regularly perform Cold Backup on related tables to ensure data safety. The cold backup feature is also often used for fast large-scale data migration.

In extreme situations, such as metadata loss or multiple nodes failing simultaneously, the cluster may become inconsistent. If metadata is lost, refer to Meta Recovery; if inconsistencies are caused by backup loss, refer to Replica Recovery.

If the cluster needs to rely on a new ZooKeeper and migrate ZooKeeper data, please refer to ZooKeeper Migration.

Typically, a cluster serves many tables, and all tables have the same priority. In other words, if a certain table’s request volume becomes excessive, the service quality of other tables will decline. This is commonly called a “multi-tenancy” problem. You can use Throttling to meet each table’s SLA.

If you need to migrate a table’s data to another table, please refer to Table Migration.

Table-level operational tasks also include Table Soft Delete, Table Environment Variables, Partition Split, Manual Compaction, and Usage Scenario.

In addition, we support Remote Commands for administrators to directly control servers, and provide an HTTP API.

From our experience operating cluster services for various businesses, we have accumulated many Operational Experiences for your reference.

Copyright © 2023 The Apache Software Foundation. Licensed under the Apache License, Version 2.0.

Apache Pegasus is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.

Apache Pegasus, Pegasus, Apache, the Apache feather logo, and the Apache Pegasus project logo are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.