Tony Meehan Profile
Tony Meehan

@snowboardvstree

Followers
1K
Following
6K
Media
94
Statuses
340

CTO @prequel_dev. Former @Elastic, @EndgameInc, and NSA/TAO.

Joined December 2009
Don't wanna be here? Send us removal request.
@snowboardvstree
Tony Meehan
1 year
When debugging Python with gdb, is a must-have resource. Check out for more info. Breaking at labels especially useful.
0
0
5
@snowboardvstree
Tony Meehan
1 month
Since launching we’ve had a lot of new contributors show up and add some awesome new features, like improved automated runbooks, Linear integration, and a many new detections. Come join us on our mission to deliver reliability intelligence to the world!.
@snowboardvstree
Tony Meehan
2 months
We're opening and this week. Give them a star and fork/build with the fast growing problem detection community. Learn more about it in @thenewstack article linked below. Or check it out at
0
0
4
@snowboardvstree
Tony Meehan
1 month
Before I went to bed last night I asked @OpenAI Codex to improve test coverage for preq. Woke up with a PR ready to merge that improved the coverage to the exact amount requested. Very excited to see how much more work I can do in parallel now.
0
0
6
@snowboardvstree
Tony Meehan
1 month
Github links (always looking for a ⭐️):. * *
0
0
1
@snowboardvstree
Tony Meehan
1 month
Enjoyed being on @rawkode to talk about preq and CREs -- recording of the live stream (along with the amazing intro music about preq) is here
1
0
7
@snowboardvstree
Tony Meehan
1 month
Use to get start using them in your cluster.
0
0
2
@snowboardvstree
Tony Meehan
1 month
We've been adding more CREs for common @nats_io problems. We've been long-time users of @synadia nats and eager to contribute back.
1
2
13
@snowboardvstree
Tony Meehan
1 month
I should make the amazing part explicit -- I've never met this person and they live in Ireland. But now, whenever I'm able to make a trip out to Ireland, I've got someone I can now meet for a beer!.
0
0
1
@snowboardvstree
Tony Meehan
1 month
We just published several new rules to detect common Istio mesh problems. Prequel customers can find them with the "istio" tag.
0
0
2
@snowboardvstree
Tony Meehan
1 month
Open source communities are amazing. We're all aligned around the same mission -- sharing and using reliability intelligence to fix software problems faster. Yesterday we added automated runbooks to preq. Today someone improved it by adding a Linear integration.
2
0
4
@snowboardvstree
Tony Meehan
1 month
Live with @rawkode now!.
0
0
0
@snowboardvstree
Tony Meehan
1 month
References. 1. 2. 3. 4. 5. 6. 7. 8. 9. 10.
0
0
1
@snowboardvstree
Tony Meehan
1 month
Download `preq` at to try out rules like these and other open source CREs (and give it a 🌟). Follow us for more content like this:. * *
1
0
1
@snowboardvstree
Tony Meehan
1 month
PREQUEL-2025-0076. This CRE rule uses a correlation window across NGINX controller logs, Ingress configuration containing Lua code, and process OOMs (including silent worker OOM crashes) to detect the Lua Snippet Leaks problem above. rules:. - cre:. id: PREQUEL-2025-0076.
1
0
1
@snowboardvstree
Tony Meehan
1 month
The following CRE rules were created to detect these problems. PREQUEL-2025-0071. This CRE rule uses a correlation window across NGINX controller logs, Kubernetes events, and process OOMs (including silent worker OOM crashes) to detect the CPU Cores Cause Silent Worker Crashes.
1
0
1
@snowboardvstree
Tony Meehan
1 month
As others in the community have noted, request processing with Lua should avoid using timers [13]. After this anti-pattern was fixed, the problem was mitigated.
1
0
1
@snowboardvstree
Tony Meehan
1 month
After enough requests with cache misses, the worker processes consumed too much memory and hit silent OOM crashes in the controller container.
Tweet media one
1
0
0
@snowboardvstree
Tony Meehan
1 month
An Ingress object on the controller is using an ` annotation to use a Lua script to implement an adaptive cache on requests to a specific endpoint [12]. If a request has a cache miss, it returns stale data but starts a timer to refresh the cache
Tweet media one
1
0
1
@snowboardvstree
Tony Meehan
1 month
Another worker memory leak was observed by PRRT in a different ingress-nginx controller configuration. The following log message was observed during the problem:
Tweet media one
1
0
1
@snowboardvstree
Tony Meehan
1 month
As others had done in the issues above, we added a `worker-processes` limit to our deployment configuration. This fixed the problem in production. PRRT created a new CRE rule PREQUEL-2025-0071 to detect this problem. CREs—Common Reliability Enumerations—are standardized rules.
1
0
1
@snowboardvstree
Tony Meehan
1 month
And we observed the same errors in the ingress-nginx controller logs:
Tweet media one
1
0
1