Misc. notes, code, and other content I want to post publicly that don’t warrant a full blog post
I recently encountered a bug in one of our services at my job at Osmos. Our service is written in Rust and connects to GCP PubSub via its gRPC interface.
We were running into errors in our logs like this:
Error, message length too large: found 5360866 bytes, the limit is: 4194304 bytes
The service in question had been running for over 2 years without seeing this issue before, and the message size limits shown are smaller than the PubSub message size cap of 10MB.
I often need to expose some service running locally on my computer to the public internet for some reason or another. Demoing a website, exposing an API, giving someone access to download some local files, stuff like that.
The popular solution for this is tools like ngrok. You download their CLI application to your computer, specify a port, and your local service is available at a URL like https://a78f837.ngrok.io/.
The downside of this is that there are limits for the free versions of these services. You’ll get limits on session duration, get a random subdomain every time, have network speed limits, or other stuff. You can pay for them as well to make most of these limits go away, of course, and that’s what I used to do with an alternative service called <tunnelto.dev>.
There’s a service https://tunnelto.dev/ which I’ve used in the past. It’s an ngrok alternative for exposing local services publically for things like demos, testing, etc.
I heard about tunnelto.dev when it was announced on Hacker News and gave it a try along with several others on my team at Osmos. It looked fresh, was written Rust, and was at least partially open source - all great. I even signed up for the (very cheap) paid plan which gives custom subdomains and some other stuff.
I recently had the need to build a custom renderer for graphs generated by graphviz for a project visualizing computation graphs for RNNs.
Graphviz has an output format called plain and plain-ext which generates a very simple text-based layout specification for all nodes and edges in the input graph. It’s pretty well spec’d out in the official docs for the most part: https://graphviz.org/docs/outputs/plain/.
Here’s an example of what plain-ext output format looks like for a simple graph: