普罗米修斯Prometheus监控安装架构：服务端：192.168.0.204客户端：192.168.0.206环境准备：所有节点安装go 语言环境rz go1.12.linux-amd64.tar.gztar -C /usr/local -xzf go1.12.linux-amd64.tar.gzcat >> /etc/profile<
     
      >prometheus_rules.yml<
      
       5 minutes.  - alert: InstanceDown    expr: up == 0    for: 5m    labels:      severity: page    annotations:      summary: "Instance {
    { $labels.instance }} down"      description: "{
    { $labels.instance }} of job {
    { $labels.job }} has been down for more than 5 minutes."  # Alert for any instance that has a median request latency >1s.  - alert: APIHighRequestLatency    expr: api_http_request_latencies_second{quantile="0.5"} > 1    for: 10m    annotations:      summary: "High request latency on {
    { $labels.instance }}"      description: "{
    { $labels.instance }} has a median request latency above 1s (current value: {
    { $value }}s)"EOF启动Prometheuscd /usr/local/prometheus ./prometheus浏览器访问http://192.168.0.204:9090/targets2、客户端部署2.1  部署node_exporter使用Prometheus Web来验证客户端Node Exporter的数据的采集。内存、CPU负载，磁盘等性能监控wget https://github.com/prometheus/node_exporter/releases/download/v0.17.0/node_exporter-0.17.0.linux-amd64.tar.gz      #客户端部署,可针对硬件层次进行监控tar xf node_exporter-0.17.0.linux-amd64.tar.gzmv node_exporter-0.17.0.linux-amd64 /usr/local/ln -s /usr/local/node_exporter-0.17.0.linux-amd64/ /usr/local/node_exportercd /usr/local/node_exporter./node_exporter &netstat -lntp|grep 9100http://192.168.0.206:9100/metrics  #自定义Metrics拦截器/过滤器：用于统计所有应用请求的情况自定义Collector: 可以用于统计应用业务能力相关的监控情况2.3、对mysql进行监控（没做）https://www.hi-linux.com/posts/27014.html   #可参考cd /usr/local/src/wget https://github.com/prometheus/mysqld_exporter/releases/download/v0.10.0/mysqld_exporter-0.10.0.linux-amd64.tar.gz  #部署在mysql服务器上，node_exporter也部署(参考前面)tar xf mysqld_exporter-0.10.0.linux-amd64.tar.gzmv mysqld_exporter-0.10.0.linux-amd64 /usr/local/ln -s /usr/local/mysqld_exporter-0.10.0.linux-amd64/ /usr/local/mysqld_exporter　  加载mysqld_exporter 添加配置文件（需要MySQL授权用户）  mysqld_exporter需要连接到MySQL,需要授权  mysql> grant replication client, process on *.* to prometheus@"localhost" identified by "123456";  mysql> grant select on performance_schema.* to prometheus@"localhost";  cd /usr/local/mysqld_exporter/  vim .my.cnf    [client]  user=prometheus  password=123456  nohup ./mysqld_exporter --config.my-cnf=.my.cnf &   #启动2.4、对nginx进行监控（没做）cd /usr/localgit clone git://github.com/vozlt/nginx-module-vts.git   #在nginx主机上操作./configure --prefix=/usr/local/nginx-1.12.2 --user=nginx --group=nginx --with-http_stub_status_module  --with-http_ssl_module --add-module=/usr/local/nginx-module-vtsmakenginx -s stop\cp ./objs/nginx /usr/local/nginx/sbin/vim nginx.confhttp {     .....    ###Prometheus配置##       vhost_traffic_status_zone;    vhost_traffic_status_filter_by_host on; #打开vhost过滤    ###Prometheus配置##    .....    server {     location /status {               #vhost_traffic_status off;               vhost_traffic_status_display;               vhost_traffic_status_display_format html;        }    }    }########################################################################################################################wget -c https://github.com/hnlq715/nginx-vts-exporter/releases/download/v0.9.1/nginx-vts-exporter-0.9.1.linux-amd64.tar.gztar xf nginx-vts-exporter-0.9.1.linux-amd64.tar.gz./nginx-vts-exporter -nginx.scrape_timeout 10 -nginx.scrape_uri http://10.10.16.107/status/format/json &    #启动nginx Vhost Traffichttp://10.10.16.107/status   #访问nginx主机各节点状态3、Alertmanager报警实现（安装在服务端）3.1  下载alertmanager安装包cd /usr/localwget https://github.com/prometheus/alertmanager/releases/download/v0.16.0/alertmanager-0.16.1.linux-amd64.tar.gztar -axvf alertmanager-0.16.1.linux-amd64.tar.gz3.2  配置alert默认启动yml文件mkdir -p /usr/local/alertmanager-0.16.1.linux-amd64/template/cd /usr/local/alertmanager-0.16.1.linux-amd64/cat>> /usr/local/alertmanager-0.16.1.linux-amd64/simple.yml<
       
        > /usr/local/alertmanager-0.16.1.linux-amd64/template/alert.html<
            报警名开始时间    {
    { range 10 := .Alerts }}        {
   { index $alert.Labels "alertname" }}{
   { $alert.StartsAt }}    {
    { end }}{
    { end }}EOF3.4  配置alert.htmlcat>> /usr/local/alertmanager-0.16.1.linux-amd64/alert.html<
             报警名开始时间    {
    { range 10 := .Alerts }}        {
   { index $alert.Labels "alertname" }}{
   { $alert.StartsAt }}    {
    { end }}{
    { end }}EOF3.5  启动alertmanager服务./alertmanager --config.file=simple.yml   #启动alertmanager4、Grafana安装、启动（安装在服务端）wget https://s3-us-west-2.amazonaws.com/grafana-releases/release/grafana-5.2.3-1.x86_64.rpmyum install -y urw-fontsrpm  -i grafana-5.2.3-1.x86_64.rpm /sbin/chkconfig --add grafana-serversystemctl start grafana-server.service浏览器访问：http://192.168.0.204:3000(默认账号密码admin/admin)进去后会要求修改密码，然后点击add datasource，选中 Prometheus 2.0 Stats后，就可以呈现出监控面板 6、Prometheus监控总结6.1  做好ntp时间同步prometheus对系统时间的准确性要求很高，必须保证本机时间与监控主机实时同步：参照： https://blog.csdn.net/csolo/article/details/82460539 http://www.cnblogs.com/qianjingchen/articles/9578341.html