-
Notifications
You must be signed in to change notification settings - Fork 0
Collector logging formats
HOME > [SNOWPLOW TECHNICAL DOCUMENTATION](Snowplow technical documentation) > Collectors
Different Snowplow collectors write Snowplow data to logs of different formats.
Here we document the different formats, and show which collectors generate what. This document should be used by anyone:
- Building a new collector, who would like to ensure it logs to a Snowplow supported format.
- Building an ETL module, to ensure that the ETL module can successfully read the raw Snowplow logs generated by each collector, and write them to the data structures used by the storage modules.
Logging formats | Description | Status | Collector |
---|---|---|---|
Cloudfront logs | Amazon's Cloudfront log formats with Amazon Cloudfront filename naming convention | Supported (both pre and post Sept 2012 formats) | Cloudfront collector |
Tomcat access logs | Tomcat access logs with Amazon Elastic Beanstalk filename naming convention | Supported | Clojure collector |
Fluentd logs | Fluentd logs with the fluent-s3 plugin filename conventions | Not currently supported | SnowCannon |
TO WRITE
## The Tomcat access log format (with Amazon Elastic Beanstalk filename naming convention)TO WRITE
## The Fluentd log format (with s3 plugin filename convention)TO WRITE
Home | About | Project | Setup Guide | Technical Docs | Copyright © 2012-2013 Snowplow Analytics Ltd
HOME > [TECHNICAL DOCUMENTATION](Snowplow technical documentation)
1. Trackers
Overview
Javascript Tracker
No-JS Tracker
Lua Tracker
Arduino Tracker
2. Collectors
Overview
Cloudfront collector
Clojure collector (Elastic Beanstalk)
SnowCannon (node.js)
3. Enrich
Overview
EmrEtlRunner
Scalding-based Enrichment Process
C. Canonical Snowplow event model
4. Storage
Overview
[Storage in S3](S3 storage)
Storage in Redshift
Storage in PostgreSQL
Storage in Infobright (deprecated)
The StorageLoader
D. Snowplow storage formats (to write)
5. Analytics
Analytics documentation
Common
Artifact repositories