skysight-inc/HackerNews huggingface dataset:
Dear reader: your intuition is right: it's not "better" to reduce the information by a factor of 32.

The game the article plays is to do a KNN search to deal with the fact this flattens similarity significantly.

TL;DR from the field:

- this is extremely helpful for doing a first pass over a _ton_ of documents in a resource constrained environment.

- it is extremely unhelpful unless you're retrieving 10x the documents you want via binary, then doing re-ranking via the FP-32 to rank the remaining.

- in general, it's unlikely you need the technique unless you're A) on the edge, i.e. on consumer devices from 3 years ago or B) you have tens of millions of vectors on a server. All this stuff sounds really fancy, but when you implement it from scratch, you quickly learn "oh its 384 numbers I gotta multiply together"

Source: I do embeddings, locally, to do retrieval for RAG. I "discovered" this about a year ago, and it deeply pains me to see anything that will misinform a lot of people.

Free bonus I haven't seen mentioned elsewhere yet*: you can take the average of the N embeddings forming a document to figure out if you should look at the N embeddings individually. This does over smooth too, ex. my original test document is the GPT-4 sparks paper, and the variety of subjects mentioned and length (100+ pages) meant it was over smooth when searching for the particular example I wanted it to retrieve (the unicorn SVG)

* edited to clarify given reply. also my reaction to reading it, "that dude rocks!!", made me wanna go off a little bit: if you're not in AI/ML, don't be intimidated by it when its wrapped in layers of obscure vocabulary. once you have the time to go do it, things you would have thought that were "stupid" turn out to be just fine. and you find like-minded souls. It's exhilirating
I would actually like to have books that had "Thinking Fast and Slow" as a prerequisite. Many data visualization books could be summed up as a bar chart is easily consumed by System 1. The visual noise creates mental strain on System 2.
Once you use ZFS it is hard to go back to anything else because of this.
I can see a business model for inhouse LLM models: Training a model on the knowledge about their products and then somehow getting that knowledge into a generally available LLM platform.

I recently tried to ask Google to explain to me how to delete sender-recorded voice-message I had created from WhatsApp. I got totally erroneous results back. Maybe it was because that is a rather new feature in WhatsApp.

It would be in the interests of WhatsApp to get accurate answers about it into Google's LLM. So Google might make a deal with them requiring WhatsApp to pay Google for regular updates about the up-to-date features of What's App into Google. The owner of What's App Meta of course is competition to Google so Google may not much care of providing up to date info about WhatsApp in their LLM. But they might if Meta paid them.
There's an important omission in the article and the top comments here don't mention it either: Accidentally tapping "Allow" does not allow the attacker to change the password on their web browser. When you tap Allow on your device, you are shown the 6-digit pin on your device and you can use it to change your password on your device. The final part of the attack is that the attacker calls you using a spoofed Apple phone number and asks you to read out the 6-digit pin to them. If you choose to give out the 6-digit pin to the attacker over an incoming phone call, then they can use it in their browser to reset your password.

It's surprising that Krebs chose to omit this little detail in the security blog and instead seemed to confirm that someone could completely give away access to their account while sleeping.
update: anchor was on the other side furthermore that anchor wouldn’t help much in last 45 seconds at 7.5 knots.
I think it's very complicated and I'm not sure what it does, or why it has a go http server and calls itself a specification.

But it's clear that your goal is to reboot on-prem servers through your phone. Something I've wanted to do with rundeck and a very simple web app that uses the rundeck API.
Check here https://www.programmingfonts.org/#ubuntu
I am researching whether to buy puts on AVGO (Broadcom, owner of VMware) since I believe their Vmware revenue will crater in 12 months or so. They took on 32 billion in debt to buy VMW also, which will tank their stock price, I think.
The TikTok bill isn't just about TikTok
Launch HN: PointOne (YC W24) – Automated time tracking for lawyers
Hi HN!

We’re Adrian, Katon, and Jeremy from PointOne (https://pointone.ai). We’re building an app that automatically figures out what lawyers are doing and generates timesheets for them. Here’s a quick demo: https://youtu.be/yrL3e1hgaNc, and here’s an even quicker one: https://youtu.be/giIaAxZp2M0.

If you’ve ever hired a lawyer, you know most of them bill by the hour—or more specifically, by the 0.1 of an hour (hence our name!). What most clients don’t realize is how painful it is for lawyers to track all their work in 6-minute increments. Lawyers hate time tracking, and many say it’s the worst part of their jobs.

Adrian started out his career as a corporate lawyer at Fenwick & West. The first thing he was taught was how to track and bill his time. Between the 70-hour work weeks and billing to 10-15+ clients per day, staying on top of timesheets is surprisingly hard. To make things worse, law firms are extremely particular about how narratives (that is, descriptions of tasks performed) are crafted—down to the punctuation and diction required. So, Adrian became chronically delinquent in submitting his timesheets, and the firm threatened to take away his bonus multiple times as a result.

Attorney time tracking is not a new problem, and companies have been promising to solve it for years. But pre-LLM attempts at automatic timekeeping never worked as advertised. We were inspired by products like Rewind, and felt that a narrower vertical application could finally solve this problem for lawyers.

Our product is a desktop application that a lawyer turns on at the start of their work day. It runs passively in the background and captures logs from everywhere they work: the OS itself, Word, Excel, calendar, emails, web browser, Slack/Teams, etc. We then clean, pre-process, and interpret the logs. Modern LLMs enable a bunch of cool features. For example, we can pull subtle context from an attorney’s browser activity to associate that work with a client. And for each client and project, we use these models to generate a time entry with a narrative description that matches both the firm’s and the client’s style preferences.

Besides the fact that lawyers hate timekeeping, using PointOne lets them be sure that they’re not letting time slip through the cracks, and frees up hours per week they can spend on other things. It also helps firm leadership by getting more consistent narratives, and faster timesheet submission.

Given the sensitivity of the data captured, privacy and security are massively important. As such, we have customizable data retention periods, we do not use firm data to update models, and we encrypt all data (in addition to employing other standard practices for processing confidential data).

Since our app primarily works for legal workflows, it might not be super useful for most people here (maybe some though!). We would love it if you could check out our demo video, leave your thoughts in the comments, and introduce us to any lawyers you know.
I think "beloved" is a bit of a stretch... tolerated perhaps, for their simplicity and versatility, in that you can make them work for most kinds of data transfer and configuration if you don't mind shoehorning your needs into that spare box. But beloved? hardly...
Toilets, showers, sinks, storm drains, and last but certainly the most severe, the supporters section of Millwall's Den.
But in this post we're seeing this "mindset" trickle to the Rust ecosystem, for something as "complicated" as command-line argument parsing
https://archive.ph/2024.03.26-101959/https://nymag.com/intel...
For the sake of completeness, xcp-ng is an alternative to migrate VMware ESXi VMs too!
Nvidia CEO Jensen Huang explains why he's all in on humanoid robotics
I'm honestly kind of shocked to discover that Manhattan's only getting one now. Like, taken on its own it is one of the densest large urban areas on earth. I'd assume driving in it is a fairly miserable experience, anyway; where on earth do people park?
Did I suggest otherwise? I said I ended up seeing four doctors before one suggested what worked for me. YMMV. Consult a physician, etc., etc.

I need to have my iron levels checked semi regularly. I would imagine any doc suggesting iron supplements would suggest the same.
interesting. Like "I've started a 5 min timer and I will use this time to work on organizing documents for a package." or setting an alarm to remind themselves to set a timer for task?
Link without paywall (from my subscription): https://wapo.st/3TPlwJX
That sounds like a 'end justifies the means' sort of argument; certainly one that explains a lot of Jeff Bezos's business choices, but a rather objectionable stance ethically.

If parent poster considers the general development or use of AI to be in any way harmful, then riding the hype train to fund/promote worthy goals doesn't absolve them of culpability under conventionally-held morality! However, if parent simply considers AI to be morally neutral, no harm is caused by profiting from it, whether for altruistic purposes or selfish ones.
This was actually a surprisingly good short watch. Nothing really new, but edited together well. Nice to see that at least one person in the US military is paying attention to this and speaking up about it.
For me personally:

I am a Christian. I'm not just a cultural, go-to-church-on-Sunday-because-that's-my-social-club kind of Christian - I genuinely believe it. I believe in a God who cares, who cares for me personally. And I believe in an eternity that is to come. I'm living for that, not for here.

So my health, my career, my economic prosperity, and the political sanity of my country are... nice. I value having them. But if I lose one or all of them, I don't lose my hope, because my hope isn't in any of those things.

I keep having to fight to remember that, as one or more of those things gets repeatedly threatened by events. My natural reaction is fear - I could lose a lot! Oh no! I have to remind myself that what I can lose is not where my joy is, not where my hope is, not where my future is.

Yeah, I still try to protect my health, my career, and my finances. But I don't (usually) do so from a position of panic, desperately trying to keep problems from destroying my life.

Politics... I can't do much to stop that train; it's going to hit us (one way or the other) and I can't dodge. But Jesus isn't running for president (no matter how much people want to put Trump in that neighborhood). The none of the previous elections brought the kingdom of heaven; this one won't either. If the side I want loses (or the side I dislike most wins), I'll be disappointed, but not in despair.
> Our profession (like many, many others, if not all!) requires judgement to do the best job.

And is almost permanently open to retrospect + disagreement of "you shouldn't have done that this way and followed maxim A, you should've followed maxim B instead" and vice versa... :)
21 years of London's congestion charge and its effect will give New Yorkers a good idea on the effects to expected: https://en.wikipedia.org/wiki/London_congestion_charge#Effec...

A bit embarrassing that Germany, the USA, Japan and Russia embassies are among those refusing to pay the toll... I'm very very curious how NYC will treat the British ambassador.
Sometimes I feel like I'm seeing something completely different from what is described in the popular narrative. This is a good example. I wrote a post detailing:

* What does Sora actually do?
* What does it not do?
* What will it likely be useful for?
* And finally, what will be needed to actually replace the majority of video generation use cases?

https://shorturl.at/auIK0
Bevy Isn't Ready for Large-Scale Game Projects Yet – A Novice's Experience
There has been a lot of hype surrounding Bevy. I fell for the meme and have been using it for approximately the last 6 months.

My personal opinion of it has wildly alternated between "the piece of technology that will bring humanity into the Fully Automated Luxury Gay Space Communism era" to "an unspeakable tangle of spaghetti which has imprisoned my hopes and dreams".

Now, it stands firmly at some place in between.
I fully support reducing car traffic in Manhattan. Free street parking in particular needs to go. Why we're subsidizing car ownership when you live in Manhattan is absolutely beyond me. Walk down any street in Greenwich Village and look at how expensive the cars are parked on the street. That's what we're subsidizing.

But there's a problem: the 3 airports (JFK, LaGuardia and Neward) have fairly terrible transit options. So to get from Midtown to JFK, you need to get on the E line, get off at Jamaica and then catch the AirTrain. If you're at Termiannl 8, the AirTrain part takes like 20-25 minutes by itself. And it's expensive. If you don't happen to be on that line you first need to get to it. Alternatively you can get to Penn STation and catch the LIRR to Jamaica and still take the AirTrain. So you migh tneed to take 3 trains.

Why are the transit options awful? Because airports make too much money from parking and no government is going to mandate or pay for good transit options. There should really be an express train from JFK into Grand Central and Penn Station (and ideally across the Hudson into New Jersey).

Ubers and taxis will be paying this $15 charge so that will bring the cost to pretty close to $100 each way from Midtown to JFK. NYC already tacks on a lot of taxes and fees onto Ubers making them so incredibly expensive. I can remember trips 10 years ago that were $16 that are now closer to $40.

If you buy a parking space for your car in Manhattan it's realistically going to cost $300/month, minimum. Possibly $500+/month. Street parking should cost $20/day, minimum.

And in an ideal world, the Subway would also be free.

So while I support this, it's glossing over huge systemic problems and inequity and doing nothing to the massive gifts we continue to give the already wealthy.
If you're coming or going with a lot of luggage this is incredibly unwieldy
It's fair to say that the consensus is that the PSX had a superior library to the Sega Saturn, particularly in the US. 1997 was a banger of a year - FF7, FF Tactics, Tekken 3, Symphony of the Night, etc.
>Disable Secure Boot and Fast Boot in the BIOS. If Fast Boot is enabled, accessing the BIOS by pressing F2 is difficult. Instead, I have to use Settings > System > Recovery > Advanced startup in Windows, and after rebooting, choose Troubleshoot > Advanced options > UEFI Firmware Settings to access the BIOS.

You can reboot into uefi directly using console command.
Don't remember exactly syntax from the top of my head, but it's trivial to find it online
What distros are there that normally dynamically link everything but statically link sudo? OpenSUSE, Debian and Ubuntu (the distros I have on hand) do not, at least.
There is no "CBD" in Manhattan. It's a made up term created for this program to make the pill less bitter. Let's be real, it's half the fucking island and where mostly everyone in the city works and shops. That's no small number.

It's everyone making deliveries to those businesses. It's every one doing manual labor jobs requiring tools. It's city workers on low salaries who have to live so far out in the boroughs where the MTA isn't even a good option to get to work anymore. The whole FDNY is losing their shit over this congestion pricing in particular because it hits them fairly hard.
Great, now expand it to all of Manhattan, instead of just 60th and below.

And while they're at it, build the QueensLink so people actually take transit instead of just turning it into a park so that it can never be built.

It boggles my mind how unable NYC seems to be able to invest it its largest comparative advantage to every other city in the country: its density and transit access.
Aren't the Macs good for inference but not for training or fine tuning?
it always bums me out to see inflammatory comments like this on hn. also you're wrong and dumb and all that
>I'll throw in a free bonus no one has mentioned yet, at least publicly: you can take the average of the N embeddings forming a document to figure out if you should look at the N embeddings individually.

Hey, I do this! :D

But I've seen it mentioned in several places, it wasn't completely my own idea.
wow, it looks like "dual process" theory is basically the same thing.

I don't know if there's a better text on dual-process theory out there (perhaps by the original authors), but regardless of who originated it, I think it's something worth learning about for everyone (and if you don't have a better source then Thinking Fast and Slow is a very good one).
Faune to innowacyjna aplikacja do czatowania, która integruje zaawansowane modele AI, takie jak Mistral i GPT-4, kładąc nacisk na prywatność użytkownika i prostotę projektowania. Ta aplikacja jest przeznaczona dla osób poszukujących prostego i bezpiecznego sposobu na poznanie możliwości sztucznej inteligencji bez konieczności rejestracji lub subskrypcji.
a) You are confusing a congestion charge zone (CCZ) with an emissions charge zone (ULEZ) which specifically targets vehicles that do not comply with the latest emissions standards. These are two separate schemes, with different objectives. It is the later that was linked with Labour's by-election failures, in the very outer boroughs that have fairly poor public transport.

b) The INRIX scorecard is citywide. Assuming that they went with the conventional definition of "London", ie. whatever lies inside M25, this is an area of 1579 km2. The Congestion charge zone has an area of 21 km2, which is about 1.3% of the total.
> I don't think it's possible to have an "open training data" model because it would get DMCA'd immediately…

This isn't a problem because OpenAI says, "training AI models using publicly available internet materials is fair use". /s

https://openai.com/blog/openai-and-journalism
Is there something that can make transcripts of Youtube videos without subtitles in Hungarian? Preferably not requring log in.
I tried to do that today but all the bots either claim to have no access to Youtube or try to bs me.
I think the term you're looking for is "Bentley-Saxe dynamisation" https://www.sciencedirect.com/science/article/abs/pii/019667...
Yes, the teaching process is often a two-way and long conversation.

Stack Exchange works in the case where the questioner already has enough mastery over the material to ask a well-posed question. But many students don't even have the mastery and they never get around to asking questions on SE, and if they do, that question is quickly closed. So you never see those students online at all. Maybe on more niche forums where there is more back and forth.

As a former physics prof, the students most in need of help are precisely the ones who can't ask questions. In that case, someone has to sit with them and with a back-and-forth figure out what they don't now. Then teach them that.

So I agree with you. This is a product mainly for above average students trying to understand a bit more. No problem with that. You can choose your customer. But I want to highlight that any sort of teaching methodology (edtech or meattech) will serve some students at the expense of others.
They had promised a $4B overall investment in september. This is the last tranche i guess?
Good practice for whom?
YubiKeys aren't HSMs, Yubico sells an HSM though.

https://www.yubico.com/product/yubihsm-2-series/yubihsm-2-fi...
I know I am nitpicking but Kahneman was not an economist. He was a cognitive psychologist. In fact he is the only psychologist ever to win a Nobel prize in economics.
You can get that info from code coverage, via `cargo llvm-cov` etc, though that would require exercising all code paths into the deps or else you might underestimate how much of the deps you need to vendor. But at least if you underestimate in this way, you'll probably just get a compiler error rather than anything breaking at runtime.
Can this service expand to include coding/programming?
Okay thanks for pointing that out.

I figure if they do this, they have to throttle or nert it somehow since it is cheaper than ChatGPT Plus which also gives access to GPT-4.
Who would drive into Manhattan to buy anything? Seriously, if you are already in the Suburbs, why not just go to a store there. If you are in any other burrough, you will find easier parking there. If you are anywhere else, it'll also probably be cheaper. No one drives into Manhattan to buy anything. If you don't live in Manhattan, you go into Manhattan for work, an event, etc.
To back this up:

I'm retired military, with a health insurance plan that most people would kill for. It may be the best you can get in the country, seeing as I pay no premiums.

My ER copay is $75 or $136, depending on my plan (HMO or Self Managed; both have the same $4200 max out of pocket per year).

[0]: https://www.tricare.mil/comparecosts
There's at least an argument to be made that this is because all the models are heavily trained on GPT-4 outputs (or whatever the SOTA happens to be during training). All those models are, in a way, a product of inbreeding.
> Spam is hard. No real platform has solved it completely, and none ever will. Spammers evolve, platforms catch up, spammers evolve again, and so on until the last post is posted and the last user signs out.

I find it hard to believe there's not some state of the art technology that can detect (or thwart/disrupt) when a user is legitimately accessing X through the mobile app / website, or a bot hitting it through the API and/or a headless browser scripted type fashion
Hey, author here. Right now we don't have any streaming or eventing support, but I am working on it as we speak. My first goal is to support describing SSE and JSONL HTTP streaming endpoints, but I want to work toward an AsyncAPI emitter as a peer for our OpenAPI emitter.
Pick any trending topic on X and most of them are bots repeating the same takes with slightly AI-enhanced variations. It's a plague.

That and the Hubermanbros thinking he really, truly is showing them the way.
Let's be clear here, this is a toy. Beyond being a fun project to work on that could maybe get my foot in the door were I ever to decide to change careers and move into hardware design, this is not going to change the GPU landscape or compete with any of the commercial players. What it might do is pave the way for others to do interesting things in this space. A board with all of the video hardware that you can plug into a computer with all the infrastructure available to play around with accelerating graphics could be a fun, if extremely niche, product. That would also require a *significant* time and money investment from me, and that's not something I necessarily want to deal with. When this is eventually open-sourced, those who really are interested could make their own boards.

One thing to note that is that while the US+ line is generally quite expensive (the higher end parts sit in the five-figures range for a one-off purchase! No one actually buying these is paying that price, but still!), the Kria SOMs are quite cheap in comparison. They've got a reasonably-powerful Zynq US+ for about $400, or just $350ish the dev boards (which do not expose some of the high-speed interfaces like PCIe). I'm starting to sound like a Xilinx shill given how many times I've re-stated this, but for anyone serious about getting into this kind of thing, those devboards are an amazing deal.
Nikki and I actually met at Meta and we really enjoyed using Workplace. When we tried using it with just us two, it fell short and wasn’t built for small product teams (ie. newsfeed ranking, integrations with tools in our workflow).