Skip to content

Commit 4c7335f

Browse files
authored
Fix some broken links, remove outdated pages. (mozilla#376)
* Fix some broken links, remove outdated pages.
1 parent 042ca08 commit 4c7335f

File tree

7 files changed

+16
-276
lines changed

7 files changed

+16
-276
lines changed

src/SUMMARY.md

-2
Original file line numberDiff line numberDiff line change
@@ -29,8 +29,6 @@
2929
* [Working with Normandy events](cookbooks/normandy_events.md)
3030
* [Real-time](cookbooks/realtime.md)
3131
* [Seeing Your Own Pings](cookbooks/view_pings_cep.md)
32-
* [CEP Matcher](tools/cep_matcher.md)
33-
* [Creating a Real-time Analysis Plugin](cookbooks/realtime_analysis_plugin.md)
3432
* [Metrics](cookbooks/metrics.md)
3533
* [Daily Active Users (DAU)](cookbooks/dau.md)
3634
* [Active DAU (aDAU)](cookbooks/active_dau.md)

src/concepts/analysis_gotchas.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ Instead, it is about quirks and pitfalls specific to [Telemetry][telem].
1616
When looking at trends, it is helpful to be aware of events from the past
1717
that might impact comparisons with history. Here are a few to keep in mind:
1818

19-
- **December 4 2019** - [AWS Ingestion Pipeline decommissioned](bug1598815).
19+
- **December 4 2019** - [AWS Ingestion Pipeline decommissioned][bug1598815].
2020
Specifically, the last ping relayed through the AWS machinery had a
2121
timestamp of `2019-12-04 22:04:45.912204 UTC`.
2222
- **October 29 2019** - Glean SDK Timing Distribution(s) are reporting buckets

src/concepts/pipeline/data_pipeline.md

+5-4
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,9 @@
11
# An overview of Mozilla’s Data Pipeline
22

3-
_Note: This article describes the AWS-based pipeline which is being retired;
4-
the client-side concepts here still apply, but this article will be updated
5-
to reflect the new GCP pipeline._
3+
*Note: This article describes the AWS-based pipeline which
4+
[has been retired](https://bugzilla.mozilla.org/show_bug.cgi?id=1598815);
5+
the client-side concepts here still apply, but this article has been updated
6+
to reflect the [new GCP pipeline](gcp_data_pipeline.md).*
67

78
This post describes the architecture of Mozilla’s data pipeline, which is used to collect Telemetry data from our users and logs from various services. One of the cool perks of working at Mozilla is that most of what we do is out in the open and because of that I can do more than just show you some diagram with arrows of our architecture; I can point you to the code, script & configuration that underlies it!
89

@@ -187,7 +188,7 @@ There is a vast ecosystem of tools for processing data at scale, each with their
187188
[Heka]: https://github.com/mozilla-services/heka
188189
[plugins]: https://github.com/mozilla-services/hindsight/blob/9593668e84a642aff9dd95ccc648b6585948abfe/docs/index.md
189190
[UI]: https://github.com/mozilla-services/hindsight_admin
190-
[access the UI]: https://pipeline-cep.prod.mozaws.net/
191+
[access the UI]: BROKEN:https://pipeline-cep.prod.mozaws.net/
191192
[reads pings from Kafka]: https://github.com/mozilla-services/lua_sandbox_extensions/blob/0895238e32d25241ef46f561e43039beb201c7cd/kafka/sandboxes/heka/input/kafka.lua
192193
[pre-processes]: https://github.com/mozilla-services/lua_sandbox_extensions/blob/5d8907ee9f1a20e3a02bfe5b57d4312b173487a3/moz_telemetry/io_modules/decoders/moz_telemetry/ping.lua
193194
[sends batches to S3]: https://github.com/mozilla-services/lua_sandbox_extensions/blob/5d8907ee9f1a20e3a02bfe5b57d4312b173487a3/moz_telemetry/sandboxes/heka/output/moz_telemetry_s3.lua

src/concepts/pipeline/data_pipeline_detail.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -178,7 +178,7 @@ Analysis outputs can also be made public using the **Public Outputs** bucket. Th
178178

179179
Stream processing is done using [Hindsight] and [Spark Streaming].
180180

181-
Hindsight allows you to run [plugins written in Lua inside a sandbox][lua_sandbox]. This gives a safe, performant way to do self-serve streaming analysis. See [this article](../../cookbooks/realtime_analysis_plugin.md) for an introduction. Hindsight plugins do the initial data validation and decoding, as well as writing out to long-term storage in both [Heka-framed protobuf][heka_protobuf] and [parquet][direct2parquet] forms.
181+
Hindsight allows you to run [plugins written in Lua inside a sandbox][lua_sandbox]. This gives a safe, performant way to do self-serve streaming analysis. Hindsight plugins do the initial data validation and decoding, as well as writing out to long-term storage in both [Heka-framed protobuf][heka_protobuf] and [parquet][direct2parquet] forms.
182182

183183
Spark Streaming is used to read from Kafka and perform [low-latency ETL and aggregation tasks][telemetry-streaming]. These aggregates are currently used by [Mission Control] and are also available for querying via [Re:dash].
184184

@@ -393,7 +393,7 @@ graph LR
393393
[Databricks docs]: https://docs.databricks.com/user-guide/notebooks/index.html
394394
[tmo]: https://telemetry.mozilla.org
395395
[measurement dashboard]: https://telemetry.mozilla.org/new-pipeline/dist.html
396-
[cep]: http://pipeline-cep.prod.mozaws.net/
396+
[cep]: BROKEN:http://pipeline-cep.prod.mozaws.net/
397397
[Mission Control]: https://data-missioncontrol.dev.mozaws.net
398398
[Metrics Graphics]: http://metricsgraphicsjs.org/
399399
[parquet]: http://parquet.apache.org/

src/cookbooks/realtime_analysis_plugin.md

-170
This file was deleted.

src/tools/alerts.md

+8-2
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,10 @@
11
Telemetry Alerts
22
================
33

4+
*Note: This article describes the AWS-based pipeline which has been retired;
5+
A new mechanism for alerting on probe expiry is tracked in
6+
[Bug 1511035](https://bugzilla.mozilla.org/show_bug.cgi?id=1511035).*
7+
48
Many Telemetry probes were created to show performance trends over time.
59
Sudden changes happening in Nightly could be the sign of an
610
unintentional performance regression, so we introduced a system to
@@ -29,7 +33,7 @@ It places all detected changes in a file for ingestion by Medusa.
2933
### Medusa
3034

3135
Medusa is in charge of emailing people when distributions change and for
32-
displaying the website <https://alerts.telemetry.mozilla.org> which
36+
displaying the [Telemetry Alerts] website which
3337
contains pertinent information about each detected regression.
3438

3539
Medusa also checks for expiring histograms and sends emails notifying of
@@ -70,7 +74,7 @@ One of the main ways humans interact with Telemetry Alerts is through
7074
the emails sent by Medusa.
7175

7276
At present the email contains a link to the alert's page on
73-
<https://alerts.telemetry.mozilla.org> and a link to a pushlog on
77+
[Telemetry Alerts] and a link to a pushlog on
7478
<https://hg.mozilla.org> detailing the changes newly-present in the
7579
Nightly build that exhibited the change.
7680

@@ -179,3 +183,5 @@ probe again, that is. File a bug in that bug's component to update the
179183
Alerting probe to have a valid, monitored `alert_emails` field so that
180184
the next time it misbehaves *they* can be the ones to explain themselves
181185
without you having to spend all this time tracking them down.
186+
187+
[Telemetry Alerts]: BROKEN:https://alerts.telemetry.mozilla.org

src/tools/cep_matcher.md

-95
This file was deleted.

0 commit comments

Comments
 (0)