skysight-inc/HackerNews huggingface dataset:
A few things:

Disk access can certainly be parallelized, and NVMe is blazing fast, so the bottleneck is more the CPU than disk. There are systems that are built around around modern hardware that realize this (redpanda.com, where I work is one such example)

Parsing is a lot of the compute time and some SIMD tricks like SWAR for finding delimiters can be helpful. Stringzilla is a cool library if you want to see a clean implementation of these algorithms: https://github.com/ashvardanian/StringZilla

See my reply here about the file being cached completely in memory after the first run: https://news.ycombinator.com/item?id=38864034
What the legendary @Horse_ebooks can teach us about AI
Would be nice to get a link directly to a post. F.e. links are a bit malformed due to formatting and wanting to see an original post, I had to ctrl+f over the whole thread with parts of the sentence.
Collaborative platform to train your models?
Hi, with my team we are training an OS LLM and want to train it/test it together (control of the experiments, evaluation, comments etc...)

For now we use weight & biases but personally I'm not a huge fan of their UX.

Do you have any other tools that you recommend ?

Thanks!
Those are suitable for error detection for relatively short files, in the kilobyte range. They can be used for error detection in big files only if you compute one per page, e.g. one for each 4kB page.

They are not useful as file identifiers. I have found multiple CRC32 collisions even in a single directory (a big one, with around ten thousand files).

For error detection in a big file, you need at least some 64-bit CRC, though SipHash is likely to be a better choice than a CRC.

For identifying uniquely a file in a multi-TB file system, which may have many millions of files, even a 64-bit hash is not good enough, a hash of 128 bits or more is needed to make negligible the probability of collisions. I have verified this experimentally, finding several 64-bit file hash collisions in my file systems.
A three month expiration time with automatic renewal after two months (as letsencrypt recommends) is a sweet spot for me. When something breaks this gives you 30 days to figure out that something went wrong and to fix it with zero customer impact. The 30 day grace window is also long enough that let's encrypt will send you two emails (at the 19 day and 9 day thresholds) to make you aware that something might be going wrong.

If we lowered the expiration time to say 3 days, with automatic renewal after 2 days, then any breakage on your side or downtime on let's encrypt's side would quickly escalate into https errors. That in turn would train users that those just happen, and make them ignore the big red scary page even when it's an actual attack. That sounds much worse than the small risk from a 30 day certificate.
Well if it's like my cat, it licked its butt beforehand and cost me vet bills a couple of times so YMMV.
"Using JSLint for Evil" is one of my favorite talks :)

https://youtu.be/-hCimLnIsDA
Reconciling Privacy Sandbox initiatives with EU data protection laws [pdf]
Google to start third-party cookie cull for 30 million Chrome users

The [Chrome Browser] Privacy Sandbox is a set of APIs for delivering and measuring online ads in a way that, hopefully, avoids privacy problems.

According to privacy researcher Dr Lukasz Olejnik, Google has more or less accomplished its goal with Protected Audience – one of the Privacy Sandbox features.

On Tuesday Olejnik published his University of Edinburgh law school dissertation [PDF], titled "Reconciling Privacy Sandbox initiatives with EU data protection laws."

And his assessment of Protected Audience, formerly known as FLEDGE, is that "it is possible to use this system in ways compliant with EU data protection law."

It may even be implemented, Olejnik suggests, in a way that doesn't process personal data at all – thereby avoiding the need to present a consent prompt under Europe's General Data Protection Regulation (GDPR).

https://www.theregister.com/2024/01/04/google_set_to_start_c...
No, no no no sorry this just makes me so sad.

It has nothing to do with the food, nothing at all, it has to do with intimacy and care. THIS is where I live and I invite you here, I take care of you because I care about you, THIS is food that I made for YOU, I'm sharing a part of my life, this is how I cook because I like it or because that's what my family usually eats or because I tried something new.

Maybe it's because I'm. Mediterranean and it's part of the culture but the idea that you invite someone to eat and it being about the food is oh god so depressing to me. It's like gifting someone a poem and caring about how good the poem is.
I make a 7-hour, ~600 mile trip 3-4 times a year. Most of that trip is through very rural areas in the Southeast, and I’m generally doing this at the end of the year (cold temps), or in the heat of summer, when batteries have the least range. It does seem like the next generation of batteries will be where I need them in the next year or so, but I’m also not going to spend $50k on a mid-tier vehicle, so we’ll see.
I also assumed the same, so I looked back in time. If you read some of the early HN posts, the quality, length, variety is the same as is now. (length seems longer now).

There's even a bunch of "what did this site become" comments from way back too!

I think it's we who change, we mature, grow older, more grumpy or less grumpy.
I have that device, it has no wireless connectivity (built on rp2040). The only IO is usb and microsd card (hijack for spi?). I have Nim drivers for a similar rp2040 based product (Inky Frame) which works great and has wifi/bluetooth (Pico W).
As of now FrameOS doesn't run on rp2040.
We are turning into subscription slaves (2023)
I imagine letsencrypt is checking if any certs were issued from the hijacked IP-range during the outage, and is moving to revoke those certs?
AI SEO Metadata Generator
Absolutely. I drive a small two seat convertible, and I could just as easily go without it on account of taxis, friends cars, rentals, home delivery, etc. And in many cases, I do rely on those.
Honestly when you talking about ion engines in any technical detail I also start to get lost very fast. People have some basic familiarity with normal rocket engine, its basically a car that caries its own ox. People understand fire and things going boom. These Ion engines just don't fit into any day-to-day mental models.
> Getting Americans to ditch driving altogether would be the most effective way to reduce emissions

And build more sidewalks, please. It's ridiculous how bad it is in some places.
I am very glad to see something like this is finally reaching mainstream consciousness.

Not being able to do this on Linux (and it unfortunately looks like this is also Windows only) has been a major source of frustration for me when writing C++, especially given that something like it (edit and continue) has been available in Visual C++ for near on 20 years.
You are nitpicking my phrasing to fit your rhetoric device - 'finding a partner' does include finding a partner... for the night.

Of course people want a meaningful job to some extent. According to Herzberg's dual-factor theory, challenging or meaningful work is a motivator that gives positive satisfaction in the workplace. But Herzberg successfully identified that the hygiene factors such as salary (meaningful in the 'transaction' sense of a job) are much more important.

'Transacting your time and expertise for money' is one of the main drivers for working (a hygiene factor), 'fulfill a mission' is merely a motivator. We have known and taught this to managers since the 70s.

A competent employer will of course know about this - be it through having competently trained management or just experience. Managers know that some candidates are completely happy with a high hygiene + low motivation mix. In some situations, this is completely fine and not 'acting like a sourpuss' as you describe it.
Food delivery drivers in our area are from what I've noticed mostly using scooters. Because in traffic they can get one where in half the time; not to mention costing less to own and operate then even a Prius.

That said when my partner and I see a Prius it's synonymous with Uber i.e. that Uber just cut me up.

I have noticed that the MG5 is making in roads though as the electric taxi of choice.
Nim is great for embedded! I have that Waveshare frame and I plan to write Nim firmware/driver for it. It has no wireless connectivity though, only usb/microsd.
Both businesses and developers benefit from subscriptions because it's easily estimated costs, and easily estimated income where you keep contact with the customer.

The ones who don't benefit is individuals. I wish more products had one time costs for hobbyists (individuals with zero revenue) while having subscriptions for businesses and commercial. Lots of products have loopholes for education/OSS/etc so adding "hobbyist" doesn't seem like a big difference. And I think it would drive sales. If I use a product at home I'm likely to lobby for buying subscriptions at work.
Houses are long-term investments. These rooms change their purposes over time
> Yes, they say, MD5 is broken for encryption, but since they’re not doing encryption, it’s fine for them to use it.

Unless I missed it, this article seems to not refute the most fundamental point: MD5 was never broken for encryption. Hashing is not encryption.
MyLikes – All about recommendations sharing
Huh? What emergency? You will always have solar on your roof.
I think in emergencies, gas will run out much quicker than electricity?

And where do you live that you have a mess of public chargers? The quick charger network is excellent where I live (Benelux)
actually i think you can also just average each chunk and then add it to existing data. like read N rows(say all have one location to keep it simple), average the data from the chunk, update/save min and max, move on to next chunk, do the same but now update the average by adding to existing/previously computed average and divide by two. the result will be the same - disk IO will be the most limiting aspect. this "challenge" is not really a challenge. there is nothing complicated about it. it just seems "cool" when you say "process 1 billion rows the fastest you can".
sounds fun; i see the arch aur has a few options as well. have you tried https://www.cipherdyne.org/fwknop/ ?
You can try looking in your youtube History
(10000 * (1.05^10) - 10000) * .67 = 4213. 14213/(1.032^10) = 10372; or about a .36% return.

Not surprising that a lower tax rate gets to the same number sooner through compounding.

BUt the bigger issue is that you have to pay tax on interest as it is accrued, not all at the end. So in your case there's a 3.35% return vs. 3.2% inflation or a .15% net return.
I'm a bit confused. You worked as a consultant selling hours, one a software product sold for a price and also on an internal enablement tool for the same company?
People get overly excited by some "last man standing" success stories of a COBOL developer based in US of A. My only encounter with COBOL developer was a freshly graduated girl based in post Communist country, her earnings were something around 25k EUR annually. I pointed out that her career might be something of a dead end but she was more like "a job is a job". Oh, and they were using some dinosaur version control as well.
What exactly do you think AWS does mate, during black Friday?
Yeah, I was wondering the exact same thing.
One good test to see if you're doing it right, by the way: do these things with people who devote most of their time and energy to it, and see if you can still enjoy yourself. If so, you're doing it right ;-)
Forbidden but not disabled either. Sounds like entrapment to me.
The higher up the org chat you report to is, the safer your position becomes. At one job, I reported directly to the still-reigning cofounder of a long lived company. Never have I felt a stronger sense of job security than that.
If I remember correctly, he was happy to do so, because the hilarity of issuing a license "for evil" to a company.
Not really. Today there are many EVs to choose from.
Looks great! Something I have planned to code for Pimoroni's Inky Frame (7 color) is a calendar firmware that syncs with Google Calendar etc.
Making Real-World Reinforcement Learning Practical [video]
There were many similar LK-99 pictures that were later identified as caused by other magnetic / optical effects.

One popular theory explaining the LK-99 "levitation" pictures is that the material is diamagnetic (repels magnets), but has iron impurities (attracts magnets). So a small fragment might have a tiny fleck of iron in a corner, which is stuck to the magnet, but the bulk is repelled. This makes the sample "half float", with one corner always touching. After a while you start noticing the consistent look of the samples almost-but-not-quite floating askew.

Another effect is that if a picture is taken in a dark room with a camera that has the iris wide open, optical effects can blur the point at which the sample touches the magnet. A macro shot of a tiny sample especially is susceptible to this effect, and it can make the sample look like it is truly floating, with a visible "gap". Better focus (or focus-stacking) would reveal the small point still in contact with the magnet.
It's based on a real world filter, which actually is a separator. By that analogy anything that sticks to the filter is considered a waste
This seems both appropriate and helpful to me. If I was an airplane customer I'd love to know what my alternatives are now that it's being shut down.
> But instead of spending the money on a house big enough to host those dinner parties, you could host them at a fancy restaurant

I feel bad for you
In France we have a "bonus for scrapyard" to avoid that [1]. You get an extra discount if you prove that the old car you're replacing is going to be removed from the road.

I don't think it's well thought through given how broken the rating of cars is, but that's a step in the right direction I guess.

> Also, EVs right now just shift the problem around until we manage to produce electricity from renewable sources

Until we manage to actually reduce the amount of cars. The solution for transportation is quite clearly less and smaller vehicles, all EVs.

[1] https://www.economie.gouv.fr/particuliers/prime-conversion
Gas is sold in 9/10th of a cent fraction. What now?
I have the T-Watch 2020 collecting dust on the shelf.

Biggest downside is the battery which can't last a single day (and has to be charged through USB micro port with a flimsy plastic cap). The "speaker" and microphone are both very low quality. Other than that the hardware works as advertised. It's a complete ESP32 device in a very small form factor that could be repurposed as home automation interface.

Software support is quite bad. The arduino examples are mostly useful to confirm the HW is working. The provided OS with UI and gestures is not robust or pretty. It's best to drop to the toolchain that espressif provides, and there are some repositories that make this easy. Last I saw, there's no good foundation to start writing "apps" on top off, you have to treat it as bare metal embedded system and start from scratch. This is where I shelved it, after about two weeks of board bring-up with MicroPython and C++.
Yes, but you could apply that reasoning to a coffee mug incident too. It would still be unusual to say "I was involved in a coffee mug containment breach" rather than "I dropped my coffee mug" or "The cat pushed my coffee mug off the table".

It's a sign of motornormativity that we use different language for road traffic collisions as they have become so commonplace that they rarely even make the news. Everyone knows what a "car crash" is, but a "coffee mug crash" is not in common usage.
> As anyone can understand, Israel would likely close its border to such an awful region.

Murdering or ethnically cleansing the population to then take over the area isn't "closing the border". The IDF created a situation in which 500.000 people might die in the next 12 months, without further bombing. The murder continues either way.

And under international law, the obligations of Israel as an occupying force are clear.

> The occupying power must take measures to restore and ensure, as far as possible, public order and safety.

-- https://www.icrc.org/en/doc/resources/documents/misc/634kfc....

Instead:

> Israeli forces continue their attacks on Palestinian refugee camps throughout Palestine, including in the West Bank. They destroyed more infrastructure in Tulkarem refugee camp last night including roads and water infrastructure. Water access is controlled by the occupation.

https://twitter.com/Shepherds4Good/status/174285862996590192...

While some at best condemn the now unmasked calls for ethnic cleansing and even genocide, but not the actions.

The claim that reducing Gaza to rubble and murdering or dislocating all the people there is the only way to ensure safety is nonsense, it ensures no such thing. It would remain a giant crime even if that was the intent, that "intent" isn't even real. Hamas was supported over moderates by Netanyahu precisely to prevent peace. That's all on record.

> Israeli finance minister Smotrich: "In the context of de-legitimization - Hamas is an asset (for Israel) and the Palestinian Authority is a liability"

- https://twitter.com/pgosh_MTP/status/1741169302051402195

Wanton destruction of civilian infrastructure, just one very clear example one of many, many such war crimes: https://twitter.com/muhammadshehad2/status/17317722618482647...

> If we act strategically correctly, there will be immigration and we will live in the Gaza Strip. We will not allow a situation where 2 million people live there. If there are 100-200 thousand Arabs in Gaza, all the talk is about the day after will be different.

- https://twitter.com/GLZRadio/status/1741347524693127398

Denying that this is ethnic cleansing, and blaming the victims for the collective punishment and crimes against humanity, is a terrible thing to do. It's also futile.
A truncated SHA-256 is both more secure and also faster to compute on any modern CPU than MD5, and a visual comparison would work identically.

If a visual comparison is believed necessary, it should better be made easier, e.g. by overwriting the two hash values, using text of different colors.

Otherwise, even a bash script, or even just one bash command line can easily compare the output of two sha256sum executions and print an appropriate message.
Different people have different incentive structures. Owning or having access to private property is highly appealing. Its more economical and convenient to buy than rent for some things, and until prices and transactional friction decrease this will not change.
Jan 3, 2024 Lecture by Sergey Levine about progress on real-world deep RL. Covers these papers:

A Walk in the Park: Learning to Walk in 20 Minutes With Model-Free Reinforcement Learning

Grow Your Limits: Continuous Improvement with Real-World RL for Robotic Locomotion

Reset-Free Reinforcement Learning via Multi-Task Learning: Learning Dexterous Manipulation Behaviors without Human Intervention

REBOOT: Reuse Data for Bootstrapping Efficient Real-World Dexterous Manipulation

FastRLAP: A System for Learning High-Speed Driving via Deep RL and Autonomous Practicing: https://sites.google.com/view/fastrlap

Q-Transformer: Scalable Offline Reinforcement Learning via Autoregressive Q-Functions: https://qtransformer.github.io/

Deep RL at Scale: Sorting Waste in Office Buildings with a Fleet of Mobile Manipulators: https://rl-at-scale.github.io/
I also use vi for config files or for quick edits when I ssh to a server or even on my machine, when I pass by a directory and I know I'll just add a line or two to a README. No need to run emacsclient for that, even with my alias ec.

Furthermore it's easy to sudo vi file, no idea how to do it with emacs. And even if I knew, I think it's a good idea to contain an edit to a protected file into a short lived process.
Not at all. tinygrad is a deep learning framework.

If you check the dependencies of TinyGPT-V you'll see that it does not depend on tinygrad but rather torch...
https://github.com/DLYuanGod/TinyGPT-V/blob/main/environment...
Many things are “almost digital-only” these days it’s incredible that companies making these decisions couldn’t see what they’re doing, I think you do see it, but it’s cheaper to not use human staff. Imagine doing everything offline and how much longer it would take you even if it was possible - nobody has the time.

My elderly parents don’t bank online, can’t purchase plane tickets/hotels online confidently, tried to request a senior citizen card from the government but I had to do it and we had to provide some rediculous ~10 scanned documents to do it… the list goes on…
It was super obvious, which is why elections occurred in even more hyper-connected settings. Election day meant drinking in the pub with your fellow landowners. If you were going to vote for bullshit, you had to stand up in front of your neighbors to do it.

There’s no reason why people can’t get along and agree on how things in their area should work. Under social contract theory, the whole point of the government by the people is to figure out how to get along with each other.

The Progressive Era began a hundred years later when we adopted the secret ballot. The system is perfect for capture by middle-class social reformers and muckrakers.

You’re right, I think this setup is showing its age. I literally never have to interact with or care about people living in the local countryside. The choice we face is do we try to reconcile with our neighbors or do we abandon social contract-driven government and use power centers to prop up a technocracy? Either could work.
> Since an LLM has no sense of self or instances

While I'd be surprised to learn they have anything a normal person would call a sense of self, it would only be mild surprise and even then mainly because it means we finally have a testable definition. (Amongst other things, I don't buy that the mirror test is a good test, but rather I think it's an OK first attempt at a test).

We're really bad at this.

> In a way, doesn't it already "talk to itself" when generating sentences, e.g., its output token gets added to the input tokens successively?

I'm not sure if that counts as talking to itself or not; I think that I tend to form complete ideas first and then turn them into words which I may edit afterwards, but is that editing process "talking to myself"?

And this might well be one kind of "sense of self". Possibly.
Rumour has it Brian Chesky is in talks with Airtable...
Two problems: Infrastructure. Price. Solve this and nobody will think using ICE cars.
Definitely more than meets the eye.
> Maintenance is always on the chopping block

I wonder if someone or someplace figured a way to make software maintenance and support to be better valued. It's like, it's reasonably easy to market and sell internally the start of a project and consume from some internal investment (CapEx like) budget to make it, but once you have done all of that was in scope, you delivered, it's a lot harder to keep it going at the same steam and get budget for the continuous maintenance (OpEx like). Also, why it's so hard to get promotions or market work in good maintenance.