Advanced Reporter for Memcached
Advanced Reporter for Memcached
We were looking around for a tool that could provide more in-depth stats on what is being stored on memcached servers. We ended up developing our own tool, which provides information such as:
- What is being stored on your memcached servers
- Placement of keys and how they are being used
- Client behavior, for example, how it may impact client-side hashing etc.
- On which servers where the most used keys are stored, which is useful for load balancing purposes
This tool, which we call Advanced Reporter, provides stats like:
- Hot keys - e.g. which keys are used the most often in certain memcached servers.
- Hot clients - e.g. which clients (based on their IP and port) accesses specific memcached servers most often.
- Hot clients on a per-key basis - e.g. which clients has accessed specific key the most.
Advanced Reporter can also be used with Statsproxy, which provides a web view for the stats provided. Since the tool includes a TCP/UDP stream-level interceptor and a high- speed collector inside kernel, it would require you to patch and re- build your Linux kernel before you can use it. The Linux kernel patch is developed for Linux 2.6.18.8 but works on up to rev 2.6.24 with a few minor modifications. And if you don't plan to support Network Namespace feature in Kernel, the base code can work for Kernel up to 2.6.28.9. Kernels starting from 2.6.29 have changes on how TCP/UDP open socks are organized, which would require data structure changes in our base code. This is still on our TODO list. The related source files are available at Google Code:
