Better Stack (Log Management)
Cloud-based log management solution for aggregating, searching, and analyzing application logs at scale
Open-Source Projects
Discover top open-source software, updated regularly with real-world adoption signals.
Discover top open-source software, updated regularly with real-world adoption signals.
Unified log and metric collector with web console
logkit is a high‑performance server agent that gathers logs and metrics from files, databases, message queues and network sources, then forwards them to Pandora via an intuitive web UI.
logkit is a high‑performance server agent designed for teams that need to centralize logs and metrics from heterogeneous environments. It reads from over a dozen native sources—plain files, CSV, nginx logs, Elasticsearch, MongoDB, MySQL, Microsoft SQL Server, PostgreSQL, Kafka, Redis, TCP/UDP sockets, HTTP POST, custom scripts, and SNMP—then forwards the normalized data to Pandora or any compatible endpoint. The built‑in web console lets users create, edit, and monitor runners in real time, providing instant visibility into pipeline health.
The tool ships as pre‑compiled binaries for Linux, macOS, and Windows, a Docker image (wonderflow/logkit:nightly), and a ready‑to‑apply Kubernetes manifest. Configuration is driven by a simple logkit.conf file and per‑runner JSON definitions, which can be managed directly through the UI or by watching a configuration directory. With support for multi‑core processing, debug levels, and self‑log cleanup, logkit scales from a single‑node test setup to large‑scale production clusters.
When teams consider logkit, these hosted platforms usually appear on the same shortlist.
Looking for a hosted option? These are the services engineering teams benchmark against before choosing open source.
Centralized web server logs
Collect nginx and Apache logs from multiple hosts, normalize them, and ship to Pandora for long‑term analysis.
Database change monitoring
Poll MySQL and PostgreSQL for new rows, transform into metric events, and forward to monitoring dashboards.
Real‑time Kafka stream ingestion
Consume Kafka topics, enrich messages, and deliver to Pandora for downstream processing.
SNMP device metrics collection
Periodically query network devices via SNMP, convert to structured logs, and store in Pandora for capacity planning.
Create a runner JSON file in the configured `confs_path` or use the web console’s “Add Runner” wizard, selecting the desired source type and connection details.
By default it ships to Pandora, but custom output plugins can be developed in Go or the HTTP runner can POST to any endpoint.
A Linux, macOS, or Windows host with at least 2 CPU cores is recommended; binaries run without a separate Go runtime.
Deploy multiple logkit instances behind a load balancer; each instance reads from the same source configuration and forwards independently.
Yes, source and destination connections can be configured with TLS certificates and authentication parameters in the runner definition.
Project at a glance
DormantLast synced 4 days ago
