index.md

layout	title	tagline
page	Wiki of Baidu-Ops

{% include JB/setup %}

Operation Data Processing

运维数据处理。为服务运维提供实时数据查询，计算，监控。

Lead:

• Zerd Liu (@zerd_liu)

Core member:

• Yong Li (@liyong19850209)
• Xiao Li (@swordsmanli)
• Wenzhi Wang (@wking1986)
• Dongfang Qu (@castomer)
• Weimin Zhang (@lovemeng)
• Fengzhao Guo (@rock-op)

Development Process

1. Fork

   从ops-baidu的github账号下fork项目仓库，your-account/Processingject

2. Clone

    git clone [email protected]:/your-account/project
   

3. Create Branch

   在your-account的github页面上操作创建branch (feature_name)

    git fetch
    git checkout feature_name
   

4. Development & commit

    git add .
    git commit -m "commit issue"
    git push
   

5. Merge & Handle Conflicts

    git remote add upstream https://github.com/ops-baidu/project.git
    git fetch upstream
    git merge upstream/master
    git commit
    git push
   

6. Pull Request

   在github上发起pull request

7. Rebase 使origin的master和upstream的master同步

    git checkout master
    git fetch upstream
    git rebase upstream/master
    git push
   

8. Redo the Process

You can find difference between "origin" and "upstream"

Tech

Operation Log Caculating

• fluentd
• kafka
• storm
• mongoDB

Service Log Searching

• ElasticSearch
• logstash

Service Monitoring

• zabbix

Cases

• mongoDB存储方式的选择
• fluentd kafka storm消息发送与接收
• 在fluentd采集的日志中增加字段
• zabbix信息采集异常定位方法

Deployment Infomation

Continuous Delivery Infranstructure