A data pipeline that reads Apache web server access logs with Python and regular expressions, publishes the extracted information to Kafka and prepares it for consumption and storage in MySQL or MariaDB.

The extracted events can include IP addresses, timestamps, user agents and geolocation data for distributed analysis by marketing, sales or support teams.

• SourceView repository on GitHub
• StackApache Kafka · Python · Shell · Apache HTTP Server · MariaDB

• Regex-based access log parsing
• Kafka producer and consumer workflow
• Structured data prepared for database storage
• Example web interface for inspecting messages