skysight-inc/HackerNews huggingface dataset:
> To help improve Daft, we collect non-identifiable data.

> To disable this behavior, set the following environment variable: DAFT_ANALYTICS_ENABLED=0

> [0] In short, we collect the following:

> On import, we track system information such as the runner being used, version of Daft, OS, Python version, etc.

> On calls of public methods on the DataFrame object, we track metadata about the execution: the name of the method, the walltime for execution and the class of error raised (if any). Function parameters and stacktraces are not logged, ensuring that user data remains private.

Is this telemetry really necessary?

[0] https://www.getdaft.io/projects/docs/en/latest/faq/telemetry...
> (I will exclude the cost of generating the crypto)

The cost of generating crypto is very real when you're talking about single-digit ms latencies :( RSA-2048 TLS certs add about 2-3ms to any connection, just on server-side compute, even on modern CPUs (Epyc Milan). (I believe a coworker benchmarked this after disbelieving how much compute I reported we were spending and found that it's something like 40x slower than ECDSA P256.)

> To go back to your HN example - HN loads fast because it is ONE IPv6 address (for me) and very lightweight so tcp slow start ramps up pretty darn fast, even going all the way to San Diego.

I used HN as an example not because it's bloated, but due to its singly-homed nature to illustrate how much content placement matters. Yeah, we could quibble about 80ms vs 65ms RTT from improving peering but the real win as I mentioned was in server placement. Throwing a CDN or some other reverse proxy in front of that helps as far as cacheability of your content / fanout but also for TCP termination near the users (which cuts down on those startup round trips). This is why I can even talk about Los Angeles for www.google.com serving even though we don't have any core datacenters there that host the web search backends.

(For what it's worth, I picked Chicago as a second location as "nominally good enough for the rest of the US". Could we do better? Absolutely. As you point out, major CDNs in the US have presence in most if not all of the major peering sites in the country, and either peer directly with most ISPs or meet them via IXes.)
That data is anyway sold to anyone and everyone.
Formally Verified C Code Generation from Hybrid CSP
It is because the world got that much wealthier. When you get wealthy you start eating like a king and not a starving peasant.

GDP per capita in China in 1990 was $320 A YEAR.

GDP per capita in India in 1990 was $360 A YEAR.

Then you get people posting on the internet about how bad things are economically, on a device that costs 5 years of labor of the average Chinese person in 1990. As if the modern world is just a given and has always been this way.
nonsense.

"Biden goes to court to renew warrantless surveillance law"
https://www.theregister.com/2024/02/29/fisa_section_702_wyde...
Suburbia done well can be great. Not everyone wants to be crowded into cities with noise and crime and no access to nature.

Suburbia can still have mixed use areas. We had a shopping center in our development for all the basic needs. We had parks and nature preserves and even areas with condos for cheaper housing.
The F-111 Was Faster Than You Think
Thank you! <3

WebP also has a near-lossless encoding mode based on lossless WebP specification that is mostly unadvertised, but should be preferred over real lossless in almost every use case. Often you can half the size without additional visible loss.
I was thinking that, if I was a millionaire, I'd make a full-length PCIe board full of vertical MicroSD connectors along with a FPGA to turn it all into a NVME drive. Just for the lulz.
The Microsoft patent is for an "improvement" that I don't believe anyone is using, but Internet commentators seem to think it applies to ANS in general for some reason.

A few years earlier, Google was granted a patent for ANS in general, which made people very angry. Fortunately they never did anything with it.
I was goofing on it to a certain extent, but the central problem with MMT -- as I see it -- is that the "deficit spending doesn't cause inflation" part of it will work, until it doesn't. MMT has developed (in popularity, at least,) during a highly unusual period of economic stability and peace in the developed parts of the world. Extrapolating that experience into perpetuity is beyond foolish.

Put another way, go ask some African nation that got "bailed out" by the IMF if their "deficits didn't matter."
jep, bw limit of the digital channel.

had that same issue with a 1920x1200@60 display on old hdmi connection and with a 1920x1080@60 tv on dvi-hdmi.

lowering the refreshrate slightly (59.9 Hz) made it work
KDE Plasma Mobile 6
> I do mean radical; cars shouldnt be able to go faster than 30 mph

You might just ban them at that point. Why waste ANY resources on a car? We could return to horse drawn carriages, they are biological and therefore more environmentally friendly [1]

[1] https://www.historic-uk.com/HistoryUK/HistoryofBritain/Great...
I believe they were referring to that WebSocket issue, not JXL.
In the link related to Geoff being fired from CSS Tricks:

>Anyone who knows me well knows that I never have one job, but many eggs in a number of baskets.

That's one of the wisest approaches to life: having multiple sources of income so that in case you're laid off, it won't affect you that much -at least financially.
Origin of this story: https://en.wikipedia.org/wiki/Anekdote_zur_Senkung_der_Arbei...

edit: s/background/origin
AI is going to continue to have incremental progress, particularly now in hardware gains. No one can even define what AGI is or what it will look like, let alone be something that OpenAI would own? Features progress is too incremental to suddenly pop out with "AGI". Fighting about it seems a distraction.
Interesting. I wonder why most of these are being sold by startups and not the giants that use them regularly.

I do remember a cool thing that some foreign Huawei guys I worked with used to use. It would call a ride sharing service, pick the more cost effective one, and then handle the claims for that. Presumably it checks that the location is work/home and only applies for such conditions.
> Is this somehow bad? You own your data.

It's not a question about owning the data, it's about data loss. What's the point with having conversations if you cannot rely on them being persistent throughout the history?

> If you are concerned about it getting lost, back it up: the app even supports automating this for you (backing up to your Google Drive or iCloud

This is only supported on mobile devices I believe? But sure, I guess I have to backup all my convos every week or so?
I was like: Is Google in the HDMI Board?
No, neither Microsoft.

https://hdmiforum.org/about/hdmi-forum-board-directors/

I see people from Apple Panasonic Sony Nvidia Samsung etc.

Hardware companies. Maybe you have to buy your way in the club.
Which is what? About 25 000 km? Doesn't sound unreasonable. Ive seen studies suggesting it might be an extra order of magnitude.

If you assume battery capacity as a limiting factor, EV don't even break even compared to hybrids.

Cars, all cars, are terrible. I say this as a car guy who doesn't give a rats butt about GW. The externality of cars are far more damaging than CO2 emissions.
Check out Nix's plasma-manager.
Methinks someone is a gardener.
I was once tasked with deploying a piece of software on a closed network (military), to run on a old custom OS - it wasn't a huge program, around 50k lines of code.

I did encounter a bunch of bugs and problems underway, and wanted to reach out to the devs that wrote it - as it was customer made for my employer.

Welp, turns out it was written by one guy/contractor, and that he had passed away a couple of years earlier.

At least in the defense industry you'll find these sort of things all the time. Lots of custom/one-off stuff, made for very specific systems. Especially on the hardware side it is not uncommon that the engineers that made the equipment are either long gone or retired.
How about shutting down ID.me? People are forced to sign up to this private company in order to access many public federal and state services, including unemployment and to log into Health and Human Services PMS. Signup involves photos of two government IDs, SSN, private email, cell phone number, a biometric facial recognition scan, and a live, recorded interview. Once you’re signed up, the website has ads trying to sell you shit too. I’m not kidding.

It’s really an outrageous privacy invasion and a fat target for hackers.

https://nordvpn.com/blog/is-id-me-safe/
> heavy handed racial diversity

Hmmm, intresting term... there is another term when one racial group is sidelined and push out in favour of others... it escapes my mind at the moment.
It's kind of rich coming from him, but he has a point.

I guess this approach can still work if it's made sure that whatever successors to LLMs there are have rights, but I still get sharecropper vibes.
Yes, "bare" single-user VM with no publicly available services is something you barely have to manage if at all. It's not like it's bare metal where you have to deal with it failing.

4 rented/hosted offsite backups seems overkill. But I can understand that the number of on-site backups doesn't really matter for the safety, because there are several event types that can destroy them all at once. 1 owned backup device in a different location seems perfectly reasonable. Hosted stuff can easily go away if you stop being able to pay for it or lose access, for any reason.

Anyway, of course some "I trust backblaze with everything, incl. quality of their backup software" setup, will be much less complicated and will require much less knowledge.
For benchmarks it is generally recommended to use JMH [1] instead of coding your
own warm-up, timing & GC profiling implementation. Playing around with a quick
JMH set-up [2], there are a few new findings though:

| Benchmark | Count | Preallocate | Time (ns/op) | Allocation (B/op) | Allocation (op) |
|-----------+-------+-------------+--------------+-------------------+---------------------|
| OnHeap | 10^6 | true | 6231838 | 16000020 | ~ 1 |
| OffHeap | 10^6 | true | 6819142 | 54 | Should also be ~ 1 |
| OnHeap | 10^6 | false | 9719988 | 33554598 | ~ 17 |
| OffHeap | 10^6 | false | 19450448 | 773 | Should also be ~ 17 |

1. The difference between on/off-heap Python-like implementation is less
significant (~ 10%) provided that we preallocate things correctly.

2. The off-heap (MemorySegment) implementation slows down as the number of
allocation increasing.

EDIT: Profiling with JMH (using -prof async) shows that the off-heap
implementation spent quite some time on jdk.internal.misc.Unsafe.getIntUnaligned
in its resizeIfNeeded method, which should be the culprit here - Java array are
guaranteed to be aligned (at least in HotSpot JVM), and aligned operations are
much more efficient than unaligned ones, which should be able to explain the
performance hit.

--- 55482970432 ns (18.53%), 5548 samples
[ 0] jdk.internal.misc.Unsafe.getIntUnaligned
[ 1] jdk.internal.misc.ScopedMemoryAccess.getIntUnalignedInternal
[ 2] jdk.internal.misc.ScopedMemoryAccess.getIntUnaligned
[ 3] java.lang.invoke.VarHandleSegmentAsInts.get
[ 4] java.lang.invoke.VarHandleGuards.guard_LJ_I
[ 5] jdk.internal.foreign.AbstractMemorySegmentImpl.get
[ 6] gc_less.python_like.IntHashtableOffHeap.resizeIfNeeded
[ 7] gc_less.python_like.IntHashtableOffHeap.put
[ 8] gc_less.benchmarks.OffHeapBenchmark.testPutOffHeap

[1] https://github.com/openjdk/jmh

[2] https://github.com/gudzpoz/gc_less/commit/17dcc3eb57b89f2642...
DVI and DisplayPort, here we buy.
Quite costly. I heard that the grow API is cheaper
> Hidden as a orthodox priest!

A throwback to the ancient world to the Middle Ages, hiding spies among the clergy!
Quite expensive. Heard groq API is cheaper?
are you implying that DP-HDMI cables have some active components in it that modifies the signal?
> I've done my best to explain to you how you've not been using the site as intended

And completely side stepped all other questions, not about myself.

There's no argument to be had you can simply clarify these issues from your perspective for the benefit of all instead of tip toeing around them.

I don't think you are dismissive, it does appear you are avoidant, to a growing number of users.

That is also said sincerely - I'm sure from your perspective you are trying your best and spread thin - but we can be sure with or without me the thorny DEI/NerfedLLM issue will only grow over time and the lack of clarity only creates more problems.

Food for thought.
With the risk of sounding to defend this culture, sprinkled with a tiny bit of whataboutism:

I also worked in a very PC cultured, all colors and genders and opinions and whatever welcome, very western, woke style company and a new joiner, who was allegedly unhappy with his job, disappeared without a trace from one day to the next. After many weeks me questioning, what happened, I got at least a "he is alive and reasonably well" answer.

Not saying that this is common, but when it's about saving face, companies, regardless of their previously projected image, can turn to such autocratic style when it comes to communication. Basically what they radiate: "just stop asking and move on", your colleague is not of concern anymore.
I think it's probably (accidentally?) proportional to actual distribution (worldwide not in the west)
Scale and custom stuff. It’s a lot easier to hardcode things than build stuff for the masses.
Apparently it reads 2024 as two different numbers: 202 and 4
Citi Bank's credit card "Merchant Offers" showed some offers as expiring in "-1 days".
Are there other news sites carrying this?

The stories about the threats against the journalist Dan McCrum who was investigating Wirecard between 2014 and 2020 are mental.

I've just checked and McCrum has shared this link as well on Twitter so I count that as a reason to trust it.
https://archive.ph/vQVFG
Show HN: Unlost – Semantic search and ask your memory (Open source RewindAI)
A true open source alternative to Rewind AI. It supports semantic searching and short QA on things you've seen or heard. Mostly focus on search UI.

I think building a jarvis like assistants would benefit from having a memory layer which serves as context which is exactly what Unlost is all about. Excited to see new ideas/suggestions.

Existing alternatives:
(paid) https://www.rewind.ai/
(open source) https://github.com/jasonjmcghee/rem
Is this not simply a risk vs reward calculation? Newer video codecs present a very notable bandwidth saving over old ones. JPEG XL presents minor benefits over WebP, AVIF, etc. So while the dangers are the same for both the calculation is different.
Typical telegraph article. If you you are able to understand German, you can see that he neither said or implied it, so this is at best an error during translation, but more likely an intentional "misunderstanding" to get more clicks.

Honestly, I'm not sure why the telegraph is even allowed as a source on hn, you might be better off reading tea leaves than that rag.
Leap year: French readers enjoy only four-year newspaper
Bringing Business Leaders Back to School
The K–12 education challenges we face today and their implications for the long-term health of the economy are just as important as they were 40 years ago ... Yet corporate leaders are largely missing in action, and the silence is deafening
It’s not always a computation problem.

Unexpected bank holidays (happened to me in 2002 during a financial crisis), official days of mourning, etc. Nothing to compute there: a government declares a holiday and you just enter it into the table.

Sure, you can compute Easter (you can just look up Knuth’s explanation of the algorithm for this…), but you can’t compute government decrees.
I get that, but the model needs to be downloaded at least once? Do you download the models as part of the Dockerfile, then?
It's Google's platform, so ultimately they can do what they want. If they don't like how you are integrating billing they can kick you out.
Only if Hetzner enters in LLM hosting for masses, it'd be fun
As a marketing consultant I personally created a couple of websites that gained a lot of traction (in their niches) for a big corporation. When I handed over the keys to the employees of said company, they stopped working on it after just of couple of weeks. They simply couldn't be bothered.

I was still hosting the websites. A year later they told me to pull the plug. I asked if I could take over the websites instead and continue to run the websites on my own. They were okay with that.

So they paid me handsomely for those websites and now they don't have any problem with me competing with their main site for some very attractive keywords. They also don't have a problem with me earning affiliate money through their own program, as well as their competitors.

Big corporations are just weird man. Online marketing is such an afterthought for many of them. And their employees simply don't care.
Borg – Deduplicating Archiver 2.0.0b8 documentation
Recently, I stumbled over a 2.0 Milestone for borgbackup (still beta, don't use for production stuff!): https://borgbackup.readthedocs.io/en/2.0.0b8/changes.html
Looks super cool! Having a few issues with Win10:
i) Antivirus kept blocking the installer, so had to manually add an exception
ii) Can't log in using the desktop app. After creating an account using email and adding the code sent to my email I get an ERR_TOO_MANY_REDIRECTS.

Also a bit curious about the Windows app - seems to be running on Microsoft Edge? Why did you end up choosing Edge?
I think I agree with you on a fundamental level, but there must be solutions to this problem where the answer is "everyone should live in a city" (or a relatively urban environment) I would go to any lengths not to live in a city again.
When CO2 isn't being taxed, of course they don't jump directly into solar. It's like when emissions from a coal plant aren't penalized, they don't install scrubbers or filters. Never mind that the Clean Air Act caused reductions in emissions that were worth 40x the cost of the controls.

What you are just talking about there is that negative externalities are not controlled by market forces, but have to be regulated.
I can't copy and paste formulas to more than one cell at a time?

if I highlight a range of cells to copy something to, only the last cell will be populated?
Upvoted in the hopes a DO exec sees this and pushes for at least something beyond keeping it frozen forever.
Everyone has their price.
What’s your point? I can’t imagine that you’re showing how many of these calls you miss.
The Netflix documentary [1] on the Wirecard scandal [2] is great.

[1] https://www.imdb.com/title/tt21836620/

[2] https://en.m.wikipedia.org/wiki/Wirecard_scandal
Absolutely right - I'd forgotten about that. The fun of regulation driven services.
Horse poo covering streets is not particularly friendly to the environment.
When did this happen? From what I head and what I see go is starting to get quite popular. Not Java level of course but it shouldn't be impossible to hire go devs now. Especially that it's not the hardest language to learn.
I am forever grateful for the work Chris and his team did on CSS Tricks. It taught me a lot, but also brought a tone of fun and exploration to CSS…which at the time had so many inexplicable, demoralizing, quirks.

So…Chris…if you’re lurking this thread…thanks for what you made. It helped me out!
As much as the implementation usually leaves much to be desired, soviet-style microdistricts with a few apartment blocks, a park and playground, and a handful of local shops is a pretty decent option. Put a few of these around a primary school and a shopping mall and you have a really decent suburban area where everything you might need is in a 10 min walking distance, and kids can be left alone in that microcosm until they leave for high school.

Western individualism doesn't really play with that collectivist setup though, everyone needs their own private building, their own private micro park, etc.
What we really need is a "na na" railroad diagram [0]

(na na)+ [two bits|Batman!|(hey ){3} goodbye]

0: https://en.wikipedia.org/wiki/Syntax_diagram
Cloud Is Overkill
Microsoft is working with Nvidia, AMD and Intel to improve upscaling in PC games
Why are these studies always factor in the carbon impact of production when they are looking at technologies that are at least a decade away from mass market adoption? Is there any reason to assume that production/mining won't be electrified and produce zero emissions?
Snowden was a huge propaganda asset for Russia.

He wouldn't release suspicious activity from Russia, but tried to blame the west in everything.

Ps. Look at the raw numbers + eg. GDP). Russia can't start a new cold war, the original cold war was one between equals.

Russia is only big in km2
Any time I've seen that on actual packaging, it does come along with "<trademark> is a registered trademark of <corporation>". Though usually those same boxes use official published logos from <corporation>.
Luminal: Fast ML in Rust through graph compilation
Hi everyone, I've been working on luminal for a while now.

Luminal is a deep learning library that uses composable compilers to achieve high performance.

Current ML libraries tend to be large and complex because they try to map high level operations directly on to low level handwritten kernels, and focus on eager execution. Libraries like PyTorch contain hundreds of thousands of lines of code, making it nearly impossible for a single programmer to understand it all, set aside do a large refactor.

But does it need to be so complex? ML models tend to be static dataflow graphs made up of a few simple operators. This allows us to have a dirt simple core only supporting a few primitive operations, and use them to build up complex neural networks. We can then write compilers that modify the graph after we build it, to swap more efficient ops back in depending on which backend we're running on.

Luminal takes this approach to the extreme, supporting only 11 primitive operations (primops):

- Unary - Log2, Exp2, Sin, Sqrt, Recip

- Binary - Add, Mul, Mod, LessThan

- Other - SumReduce, MaxReduce, Contiguous

Every complex operation boils down to these primitive operations, so when you do a - b for instance, add(a, mul(b, -1)) gets written to the graph. Or when you do a.matmul(b), what actually gets put on the graph is sum_reduce(mul(reshape(a), reshape(b))).

Once the graph is built, iterative compiler passes can modify it to replace primops with more efficient ops, depending on the device it's running on. On Nvidia cards, for instance, efficient Cuda kernels are written on the fly to replace these ops, and specialized cublas kernels are swapped in for supported operations.

This approach leads to a simple library, and performance is only limited by the creativity of the compiler programmer, not the model programmer.

Luminal has a number of other neat features, check out the repo here: https://github.com/jafioti/luminal
This is because they target MLIR.
It's Unix parlance for a forked child process that detaches from its interactive terminal with the setsid() syscall, becomes a child of init, possibly closes or redirects the 0/1/2 file descriptors to logging facilities, possibly changes its CWD, and no longer receives terminal-originating signals like SIGHUP, SIGTTIN, SIGTTOU, etc.

Apart from that, a robust non-daemon program should use the same defensive techniques. In a short-running command-line utility, it might seem "acceptable" to leak memory, not close resources and not do adequate error-checking, but that's just sloppy programming.
OpenAi is also being investigated by the SEC. If "Altman hadn’t been consistently candid in his communications with the board" is interpreted as being misleading then that could be interpreted as misleading investors and therefore securities fraud.

https://www.wsj.com/tech/sec-investigating-whether-openai-in...