This is cool, I'd say that the most common tool in this space is bgzip[1]. Have you thought about training a dictionary on the first few chunks of each file and embedding the dictionary in a skippable frame at the start? Likely makes less difference if your chunk size is 2MB, but at smaller chunk sizes that could have significant benefit.
> While only Checksum_Flag currently exists, there are 7 other bits in this field that can be used for future changes to the format, for example the addition of inline dictionaries.
so I don't think seekable zstd supports these dictionaries just yet.
With multiple inline dictionaries, one could detect when new chunks compress badly with the previous dictionary and train new ones on the fly. Could be useful for compressing formats with headers and mixed data (i.e. game files, which can contain a mix of text + audio + video, or just regular old .tar files I suppose).
Yes, dictionaries should be totally possible. However, I've never tried them to be honest because I usually only compress big files. They can be set on the (de)compression contexts the same way as with regular zstd.
Using it right now, the community feels non-existent and the documentation is as barebones as it gets. Luckily my requirements are easy since I only need schema-based sharding so from an operations perspective, it's "just" managing one database clusters for each shard but I would just not use Postgres the next time and instead go with Vitess since at least you're not all on your own then.
How much power is the Pi port capable of delivering, or are you sending additional power to the PCIe adapter from somewhere else?
What SmartNIC are you using? Most SmartNICs that I'm aware of suck a decent amount of power, many more require significant external airflow. Are you using the Mikrotik active cooled one? https://mikrotik.com/product/ccr2004_1g_2xs_pcie
The Pi port can deliver 5 or 10W max at 5V IIRC. So I'm not using it :D
The 12V comes from an external power supply through a barrel jack, from which I also derive the 3.3V rail. The Pi provides no power whatsoever. I should publish the design files somewhere.
As for the NIC, it's a Netronome Agilio-CX which is fully programmable using eBPF and such.
Because in most of the US, it is dramatically cheaper to charge an EV than fuel a similar gas vehicle.
These costs in this article are surprising to me, and very questionable without any actual numbers behind it. As a PHEV owner who can fuel with either gas or electricity, the 13c per kWh I pay is dramatically cheaper than gas at circa $3 a gallon, to drive any distance at all.
Confounding factors across the US may be that in some places using more electricity results in an increase in your marginal rate, in others it results in a decrease. Typically EV charging is not broken out as its own line item, so owners may not know exactly how many kWh their car is consuming. That doesn't change the fact that only a small number of places with very expensive electricity will have electric charging cost anywhere near gas.
Disease, disaster, war all cause significant inflation because they harm or destroy both things and productivity in the real world without destroying money.
If factories shut down and supply chains are disrupted and we only make half as many cars this year, how much would people be willing to pay for those cars? Much more.
There is no enforced maximum length for either input or output right now. In practice, the remote machine times out trying to analyze a song after 10 or so minutes. For output, your machine will take forever to generate really long results.
I had forgotten about this check actually! I just removed it and deployed the changes. You can try again but am unsure if it will break something (it will spin indefinitely, but I would give it up to 10 minutes). Good luck!
I haven't measured, but I find it very likely that such a neglected corner of Java behaves just like it did many years ago. Finalizers were never a widely used feature of the Java language, and are now deprecated to be fully removed in the future: https://www.infoworld.com/article/3649089/how-to-handle-java...
Many states still only require $15,000 of liability coverage to drive, so there's going to be a lot more uninsured / underinsured motorist claims in the future.
The Rivian owners insurance will frequently end up paying out, via that underinsured motorist coverage.
To detail, though the Rivian driver has under insured insurance, the at fault party is still responsible for that difference, and the insurance company will take the at fault party to court if they can recoup a portion of the remaining $35k at low expense.
