splix/docker-appengine-logs-kibana

---

splix/docker-appengine-logs-kibana.json

{
  "createdAt": "2015-06-10T17:32:00Z",
  "defaultBranch": "master",
  "description": null,
  "fullName": "splix/docker-appengine-logs-kibana",
  "homepage": null,
  "language": "Shell",
  "name": "docker-appengine-logs-kibana",
  "pushedAt": "2015-06-10T17:32:24Z",
  "stargazersCount": 1,
  "topics": [],
  "updatedAt": "2015-07-22T22:42:58Z",
  "url": "https://github.com/splix/docker-appengine-logs-kibana"
}

Kibana for Appengine Logs

Basic configuration of ELK (Elasticsearch,Logstash,Kibana) for Google Appengine Logs packed as Docker container

Run:

docker run -d -t \
  -p 9200:9200 -p 5601:5601 \
  -v $(pwd)/volumes/inputlogs:/var/inputlogs \
  -v $(pwd)/volumes/sincedb:/var/sincedb \
  -v $(pwd)/volumes/elastic:/opt/elasticsearch/data/elasticsearch \
  splix/appengine-logs-kibana

Download logs:

gsutil -m cp -R -n "gs://__MY_BUCKET_WITH_LOGS__/appengine.googleapis.com/request_log/" volumes/inputlogs/

Open Kibana at port 5601 (something like http://192.168.59.103:5601/) and setup metadata.timestamp as timestamp field.

Enjoy