skysight-inc/HackerNews huggingface dataset:
LZ followed by entropy coding seems to be the general strategy of choice for many compression algorithms, so this design of Zstandard was quite familiar to me. The FSE reminded me of the Q/MQ/QM-coder algorithm which is used in some image formats (and is surprisingly simple yet powerful, although relatively slow.)

Nonetheless, I like to learn a file format by studying a worked example at the bits and bytes level.

I did the same when I was playing around with various image and video codecs (JPEG, GIF, MPEG-1/2, etc.), and I agree that it definitely helps with understanding as well as debugging; you can get to the point of being able to decode, slowly, by just staring at a hexdump and "reading" the bits and bytes as if it was a new language.
JPL is working on decoding the message. So far, it appears to read:

From: Mr. Boss, CEO (mr_boss9735@hotmail.com)

Hey John, are you busy? I need you to do something for me. Need you to wire some money. Don't call Mary, this is a personal matter for me. I'm not at my desk, so just email me back and let me know when it's done.
A used iPhone - a iPhone 7 is an excellent webcam and is probably about $80, or less with a busted screen
https://www.wired.com/story/spoof-jam-destroy-why-we-need-a-...
I'm a huge supporter of publicly funded research. I think the things that have come out of DARPA, NASA, the NSF and other US funding bodies are incredibly important.

Having said that, what you've said is basically wrong.

> I have rarely seen a start up on improving optical fiber or electronic chips.

Unless you are trying to be pedantic by saying it has to be a startup rather than a private company this is completely wrong.

TSMC, Intel, Samsung and IBM do most of the work improving electronic chips manufacturing processes.

I'm not very familiar with optical fiber work, but I know NTT in Japan does a lot of R&D in the area.
lack of standard is crippling but offshoots of factions defying the pecking order is a good thing. Giving options besides big G is a good thing. Unfortunately it means most projects starting for browsers will start with chromium based as the market share is mainly there.
For me its more like old 'dinosaur' cooperate mentality slows down r&d on alternatives, maybe its more of a fear taking a major step, while other startups with main focus on green energy taking the field and attention. Yet still countries like Norway recognized this years ago and started investing on green.
Also, because of zoning regulations having minimum lot sizes, it is hard to find new construction in US cities that has comparable square footage, so you can’t actually take advantage of the lower sq ft cost by keeping the same amount of space.
I attest to this. I have fingerprints filed with at least 10 different civilian fed agencies.
Thoughts on Impact
> people for bodily autonomy are going to be seen as having bad intentions by American Christians,

You mean anti-vaxxers? (My body, my choice, right?)

> People against immigration and helping the poor or workers in general are going to be seen as having bad intentions by many

And what about people who disagree with what you think "[helps] the poor"?
I took it as over-heating/cooling during peak electric production time (daylight probably) when power is more available in order to reduce usage during off-peak times. I think it would require compulsion or a large amount of voluntary adoption on the part of the customers to really make much of a difference though, and I doubt that the latter is likely on a meaningful scale (though I could be wrong of course).
Are your tools publicly available. I've created over a dozen books using my rst-based tools. But I'm planning on using on markdown and pandoc (plus custom filters). (Just write a filter to handle LaTeX index entries).
OpenSUSE Leap Micro 5.2
Why is interstellar space higher radiation? Would have thought most radiation would come from the sun, so as they get farther from that there’d be less…?
"overpriced" is likely, "garbage" is a very long stretch, to me.

you don't get to define "garbage" for everyone.
That confirms something I suspected: blockchain adds nothing to this solution, and is present only because of the fad.
I wouldn't describe it as a reformulation, but as a different solution to the same problem. The goal of entropy coders in general is to encode each symbol using -log P bits, where P is the probability of that symbol. Huffman, arithmetic encoding, range coding, and ANS / FSE are different systems that solve this problem.

https://en.wikipedia.org/wiki/Entropy_coding

Huffman coding works by using an integer number of bits for each symbol and then creating a prefix-free code. This is computationally cheap but wastes some space.

Arithmetic coding works using interval arithmetic. Each symbol corresponds to an interval, and you multiply each successive interval together, renormalizing after each step. This is close to optimal but computationally expensive.

ANS / FSE work by using a state machine. A particular symbol can be coded using a variable number of bits, but that number is an integer. The average number of bits is close to -log P. Like Huffman coding, coding and decoding is fast--each symbol uses an integer number of bits, and you don't need to do any multiplication. Like Arithmetic coding, it is close to optimal in terms of space used.

These techniques share one thing in common--you only need to record symbol frequency in order to recreate the codebook. In Huffman coding, you typically encode the symbol frequency log 2 (i.e. the symbol length). In FSE and arithmetic coding, you typically encode the symbol frequency as a dyadic rational. You use a deterministic process to recreate the exact same codebook given these frequencies.

(Then the question is, "How do you encode the symbol frequency efficiency?" For Deflate, the answer is, funny enough, the symbol lengths for the Huffman codes are themselves encoded using Huffman codes! The codebook for that Huffman code is then coded using a fixed codebook.)
> The problem with battery supply is that it would be better to use that supply on EVs to displace oil rather than on massive stationary grid storage for intermittent sources.

If your electricity generation is fossil moving to EVs is of questionable benefit.

> Instead, for the maximum cleaning up of energy, we should build nuclear for the grid and use batteries on transportation.

We are talking about solar power costs exponentially dropping and your suggestion is to build nuclear, the slowest to build and already much less economical than solar. By the time your nuclear power plants are build you could buy ~10 times the capacity in solar and likely would not need any battery storage.
Nice ad hominem.

Sure, in a state where the legislature/executive are captured by domestic industry, you’re right that that’s the case.

It’s clear you live in the USA.

Outside of the USA, governments tend to predate on wealth, and having globally portable money secured in accounts of your choosing is a huge asset.
I did KDP for an author, from Word. It wasn't nothing. I valued my labour at $0 to get experience, There are a LOT of fine-grained issues to resolve, bringing a book to printable state.

Binding is it's own special hell: There are huge expectations of barcoding, which plays with your cover artwork, and the positioning of things on the cover is a function of the width of the spine, which is a function of pointsize, margins, wordcount, paper density/weight/thickness. I became very dependent on other peoples templates and calculators to "get this right"

Perhaps the oddest part of this, is the join over paper and ePublishing: they are very unequal in terms of DPI expectations, for both font and artwork. I think the golden rule here is "preserve your pixels as long as you can" but there is also "think about metadata, in images and in fonts and text" because producing print ready PDF and ePub formats, the meta is what the printery/bindery is going to work with. EPSF and other stuff comes to the fore very quickly.

Page numbering is another bugbear: some places demand you DONT number pre and post, some expect it to reset, some expect one to be roman numerals, the rest in decimals. some want it spine, some want it edge, some want it centered. Get too close to the margins, now the printer hates you...
Not sure if it’s my circle, but you seem an exception. I live in a tiny village and haven’t touched cash for years (somewhere 2018), nor has anyone I know. Personally I hear what you are saying as I had my accounts frozen (in my country, you can basically sue a company and start by freezing the assets of the company and their owners without any proof) a long time ago, so I always have a lot of accounts no one knows about (the tax office does but they are not allowed to provide those to lawyers). However, cash… Nah. I can kind of see that someone might put gold somewhere just in case the entire system collapses (which will end cash too), but outside that…
People should have fewer kids anyway, I see this as an absolute win.
It may be useful in some areas, but other areas increase the yield using double cropping, the idea is to grow each year a second crop after the harvest of the first one. For example see the figure 7.1.4 in https://serc.carleton.edu/integrate/teaching_materials/food_... or the figure 1 in http://blog.umd.edu/agronomynews/2019/09/06/interseeding-cov...
Usually there's a gateway scam aka other marketing companies take over the google business pages in an automated manner.

In Germany, the "lieferando" people registered hundreds of thousand domains for restaurants, and claimed their google business pages. So when people try to call them directly, they still land at lieferando's order service.

This is the method they use to extort restaurants that aren't on the web and force them to go on their platform, without leaving them any alternative because the marketing company still controls their google business pages; which of course means the restaurant will never get orders if the marketing company takes that one down or enters it as "closed" or untrustworthy with artificial downvotes.

It's basically foursquare and yelp all over again.

If you are more curious about this, there's the crimeflare project which was basically hosting a resolver and scraped it for all domains that are hosted on the ASN of cloudflare because those kind of scammer companies and/or blackhats usually use cloudflare to host their stuff.
Hmmmm sure I can maybe agree with this, maybe? I don’t think you can stop it though… any ideas?
That is different use case. How would I prove that a file existed without a middlemen?

I would gladly switch since the method I am currently using isn't exactly cheap.
Yes, GPS is not particularly secure. But I don't think that addresses the threat model above.

(In general, jamming is always a possibility with anything wireless. That is just not going to change. What might change is spoof resistance, which can be accomplished with schemes that are a lot simpler than anything DeFi can conjure. There's a decent amount of work on related schemes in the vehicle-to-vehicle communication space.)
I can think of many things you could be getting at, but.. what are you getting at?
Thank you for posting this and previous year's Ask HN. Knowing that it's possible to run some successful && semi-passive && one-person && work/life-balancing SaaS businesses for such a long time is inspiring.
> Were the murders you mention streamed live on video games?

My point exactly. No murders were streamed live on videogames (or anywhere, in 1993), yet they got congressional hearings. Live-streaming has never been a condition for dragging everyone remotely related to an atrocity through the mud.

Of all the sites being investigated, the killings were only streamed on Twitch. If live-streaming was the issue, why involve the other sites?
How to get your Instagram back if it gets deleted
The potential is way beyond just "proof of membership", but that's the only tool that's currently out there and in active usage, as far as I know.

When I say coordination, I mean all sorts of collective decision-making and agency can take place using crypto as a medium, if someone has a vision and enough people are invested in making it happen, see: https://otherinter.net/research/squad-wealth/. Basically, if you need to get groups of people to align themselves and act in concert, and it's happening over the internet, crypto has the potential to make that happen. The technology is fundamentally social in nature, whereas an iPhone is fundamentally a personal object that happens to include some social tooling.

I don't know how it's going to look. Maybe groups will work together to purchase and maintain land. Maybe you'll see digital guilds or unions forming around creative niches. Regen (https://www.regen.network/) is working on communities for landowners who want to get carbon credits. It's really early. Maybe nothing will happen at all, and I'll look back on these posts with embarrassment. But it's exciting to work on projects building stuff that really doesn't exist yet, if only to see what happens.

(oh, and, people really aren't talking about this side of crypto at all. this is an entirely separate thing from bitcoin and defi)
pardon me, and *why it's still a complete mess. because it undeniably is
Yup, correct. I used Monodraw [0] for that (and the diagrams in the book). Highly recommend Monodraw, easily one of the loveliest pieces of Mac software I used. And it just got an update!

[0]: https://monodraw.helftone.com
Shame this comment is languishing at the bottom. Updoot
I know it's pretty unlikely you're in NYC, but in case anyone is:

https://www1.nyc.gov/content/leadfree/pages/request-water-te...
Yep that is it. It’s certainly not massively easier to do cross country transactions with it and much cheaper…

Its massively telling how much this and other forums completely neglect that a world outside the west exists.
I thought it was more along the lines of "Send more beer"
Yeah a lot of weird morality policing— these are massive industries being served by the crypto space rn
Landfills were demonized for a long time because they were easy targets.
Lots of US grain goes to produce ethanol which can be cut back.

Lots more goes into livestock feed around the world. People might be able to afford grain but not meat and lots of grain is available to be reallocated to humans.
Those systems are older than the 6502, so they must be extremely simple seen from today's complexity. Amazing what one can achieve without complexity. How much technology today gets wasted for no good, like e.g. serving ads.
https://en.wikipedia.org/wiki/Heliosphere

Basically sun both gives out radiation but also keeps it out.
"As part of the interplanetary magnetic field, the heliosphere shields the Solar System from significant amounts of cosmic ionizing radiation"

https://en.wikipedia.org/wiki/Heliosphere
Which is to say, never? I mean, sure there is a chance after Xi some open market president will appear, however, it is more likely, as all opposition is no longer in play, that it will get more closed and there will be more use for cryptocurrencies from that perspective.
Doesnt matter how utopian the first generation of martians are, the second and subsequent generations will look at the first generations as entitled and the spiral will start. Same with any system, once you have different classes, politicians will come out of the woodwork and exploit it until they are at the top of the pile

I seriously hate this shit with humans dumping on other humans and I hope it ends up an AI running everything.
I do not yet trust crypto to be an effective store for value.

Call me old fashioned, but I want to store my money in something safe and reliable like Beanie Babies.
I wonder if a continuous wave signal is part of the science package. It might be the last thing they can reliably send, given it has no digital dependency and is just a tone, at a set frequency (ideally coming of a thermally stable crystal or something)

You can do stuff with a continuous wave, analyse the doppler shift, align to it, irrespective of the bitstream.

I imagine at some stage, we will lose signal. Do we get radar bounce back? (some early astronomy was about bouncing radar off planets, Robert Buderi talks about it) -The dish, if it stays in some kind of alignment, might reflect enough to be detected.
Technically not. The one party in question would only arguably win with some heavy repeals being passed.
Florence coffee bar customer calls police over price of espresso
pip3 install pytorch

worked for me. I think it's something with your brew installation.

fragmede@samairmac:~$ python
Python 3.9.7 | packaged by conda-forge | (default, Sep 29 2021, 19:24:02)
[Clang 11.1.0 ] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
>>> torch.__file__
'/Users/fragmede/projects/miniforge3/lib/python3.9/sitepackages/torch/__init__.py'
>>>
Usually don’t take their advice if they are literally making a mistake while delivering it.
> They forgot one con off pull based deployments which is that you need to put a repository key in your cluster where your code is running.

Conversely for push-based deployments, there's a process running somewhere outside your cluster that has admin access to your cluster. Did you analyze the threat models for both push and pull, and decide that push is less risky?
Crossing over out of the Slow Zone and into the Beyond might cause this sort of interference.
Well, I could be wrong. The AOC rules certainly came fully into force then. And as a kid in France <= 15, I'd buy Gruyére in the grocers, and it wouldn't have the snazzy Swiss cross printed on the rind. Perhaps until then, "Gruyére" was a generic term, and they'd sell you Gruyére or Comté, whichever they had.
Imagine that even with a warp drive, we are stuck in this little “air bubble” in the ocean
There's something to be said about having the energy sourced domestically, and it would make a nice baseload service. I believe that dealing with the waste water can be challenging but again, having a spectrum of energy source would be really nice.

Rebuilding The Grid with HVDC would help too, as well as an ammonia economy to utilize excess power from wind. It all seems very technically doable, it's the politics and petrol people that stand between us and a carbon free energy ecosystem (well, with reasonable exceptions for aerospace and other special cases)
Regulation of the cryptocurrency space, for example, such that huge amounts of funds can't be kept and moved anonymously and without consideration of (for instance) local taxes in these countries the rich shop between.

Those who do so must be held to the same standards as those already resident.

In the UK recently we have seen (yet another) backlash against this in the form of the outcry against the wife of the Chancellor of the Exchequer, who was using "non-Domiciled" status to avoid masses of tax, despite having been resident in the country for multiple years.

I've no issue with people moving around, but moving around specifically to avoid contributing to the country you're actually residing in needs to be ended, and regulating cryptocurrency may have to be part of that.
ohhhh... wow. ok. This got my juices going. Next time. Saint-Nectaire is perhaps my favorite cheese... their "Michelin" sounds a lot like the home burger I developed living in Auvergne. Which was: 50% steak hache / 50% ground pork, smashed thin with two patties, rocket, grilled onion, Charroux mustard, mayonnaise, St Nectaire on one patty and Blue d'Auverne on the other, on a hollowed out flattened wide baguette. Monster. Most of the necessary things aren't available in the States... but it's very cool that the King Marcel burger seems to match this flavor profile.

It's been my experience that most "American" foods - and Chinese food too - are much better in France. Like, this is embarrassing, but compared to any roadside chain in America, the Buffalo Grill is incredible. It would be the best restaurant in most cities under 50,000 people in the US. It looks like an Applebee's and then they have freakin steak tartare which would be inconceivable in the US. And it's actually edible.
A tangential thought: will we see animation studios buy mac studios for their rendering farms? What do they use these days, aws ec2?
Also, grass is green, sky is blue.
One advice: if you have two monitors, put one with the conferencing software and camera to the side, so you have to turn your head to look at the conference. One issue in video conferencing with multiple people is inability to tell if the person is actually paying attention. That way you will give clear indication that you are not engaged in something on your main screen.
Exactly right. I look up into lens thatbis just on the top of monitor. the angle between camera lens and people's faces us just a few degrees. I often shift my gaze straight into the lens too, just because I can...
Harvard professor: Work from Anywhere is our destiny
Gold isn't really for when the entire system collapses. It's for when your own country collapses but some other place where gold is valuable doesn't. It's easier to shove a few grams of gold up your ass and make it to somewhere stable than to shove a roll of hundreds up your ass. This is actually what happened in Vietnam, as I understand, as some individuals bribed their way out with fisherman's boats using what gold they had.
There's some hideously toxic metals in certain semiconductors, e.g.

https://en.wikipedia.org/wiki/Gallium_arsenide

https://en.wikipedia.org/wiki/Cadmium_telluride
> How would I prove that a file existed without a middlemen?

How are you defining "middleman"? You can do this with any basic commitment scheme: take a cryptographically secure hash of your file and publish it somewhere that's either (1) trivially copyable, or (2) difficult to tamper with. Alternatively, you could do an online scheme where someone asks you for your proof and you present them with your hash after being challenged. That's a gross oversimplification, but it's the general idea.

(In general, "prove that a file existed" is not something that you often want to do in the real world. What is it you're actually trying to accomplish?)
Shouts out to bogota
Voyager 6. Lost in a black hole.
Absolutely! These are also industries. Maybe our morals are not aligned with it but it is one of the biggest industry.
For anyone else seeing this comment, I recommend the following blog post:

http://bactra.org/weblog/918.html

"Attention conservation notice: Over 7800 words about optimal planning for a socialist economy and its intersection with computational complexity theory. This is about as relevant to the world around us as debating whether a devotee of the Olympian gods should approve of transgenic organisms. (Or: centaurs, yes or no?) Contains mathematical symbols but no actual math, and uses Red Plenty mostly as a launching point for a tangent."

I made it about a quarter of the way through before I had to return my copy to the library - not because it wasn't well written, but my attention span has been shot by the internet and smart phones.
Someone needs to combine this variant with four player chess.
Thanks, I'll add that to the list of possible use cases, although that will take additional time. The solution won't be ready anytime soon, so please sign-up for the announcement list on the website if you're interested.
"Everything is securities fraud" actually kinda props up the assertion that an intelligible principle was not achieved in my book. Not gonna lie.
Well, for a draft, you just got one hell of a community proof read.

Good luck with the final article!
https://www.gutenberg.org/files/21970/21970-h/21970-h.htm
Scientist uncovers clues to aging in mitochondria
Nah it’s not a US thing; tax codes are the same most everywhere.
Teachers, nurses, and janitors
Things last a lot longer in a vacuum
Show HN: Build Machine Learning Web Apps – In Python
this is interesting. why do you think this is better than just using python?

do you have any research with students that show this is a “better mousetrap”?