skysight-inc/HackerNews huggingface dataset:
Data center GPUs are not only used for LLMs. Meta makes hundreds of billions and invests tens of billions on GPUs, using them directly in its core business, not just for cute chatbots. OpenAI is not the clear winner in revenue generation from "AI" if we define AI as deep learning models trained on GPUs.
Love the Shopify effort on the LSP, I even reported issues. But, no, it's not stable or easy to setup unless you use it on specific scenarios. Also I have very high cpu usage nas crashes every day.
We didn't evolve reading and writing. Literacy is just a recently developed hack. Memorization was the only way for the vast majority of human history.
The Federal Trade Commission Act of 1914 states:

> The Commission is hereby empowered and directed to prevent persons, partnerships, or corporations, except banks, savings and loan institutions described in section 57a(f)(3) of this title, Federal credit unions described in section 57a(f)(4) of this title, common carriers subject to the Acts to regulate commerce, air carriers and foreign air carriers subject to part A of subtitle VII of title 49, and persons, partnerships, or corporations insofar as they are subject to the Packers and Stockyards Act, 1921, as amended [7 U.S.C. 181 et seq.], except as provided in section 406(b) of said Act [7 U.S.C. 227(b)], from using unfair methods of competition in or affecting commerce and unfair or deceptive acts or practices in or affecting commerce.
It's one thing to be taken in by con artists, it's another to publicly boast about your limitless credulity and your complete and utter lack of judgment. Sequoia aren't innocent senile grandmas who got conned by high-pressure scam calls, they're gullible trend-chasing morons who were victims of their own starry-eyed greed.
Maybe -march=native gives it an edge as it compiles for this exact CPU model whereas numpy is compiled for a more generic (older) x86-64. -march=native would probably get v4 on a Ryzen CPU where numpy is probably targeting v1 or v2.

https://en.wikipedia.org/wiki/X86-64#Microarchitecture_level...
I find a similar trend with education in general. Some states have phased out programs for gifted students.

Instead, many of them aren’t stimulated enough and end up going down a troubling path (worst case) or they don’t really reach their full potential during those formidable years.

Teachers are expected to make the content match the lowest denominator, outside of the occasional exceptional teacher
Ask HN: Vision Pro owners, are you still using it?
If so, what are you using it for?
As an american citizen, I imagine.
Eh, I'm much more likely to accidentally reformat all my drives on my desktop than a NAS. Sure I can just restore from backup but it's just a security blanket to not have to worry about it
https://en.m.wikipedia.org/w/index.php?title=Acquisition_of_...
RTT estimation will triangulate the minimum path delay and I hazard other info like flight exclusions and truck gps manifests will identify the locations. Nothing about datacenter locations stays secret long. (Obviously there are ways RTT can be fooled, misled or be inaccurate)
How to (not) Survive Lightning [video]
The current FTC has a terrible track record and all their things are being struck down :(
We’re thrilled to introduce the new Syncfusion Blazor OTP Input component as part of our Essential Studio 2024 Volume 2 release.

The Blazor OTP Input is a form component designed to streamline the process of entering one-time passwords (OTP) during multi-factor authentication. It offers extensive customization options, making it adaptable to various application needs. Features include configurable input types, adjustable input lengths, multiple styling modes, customizable placeholders and separators, and more.
Was there ever an alternative to 8thwall for Mobile Safari?
Command + down arrow also works to open

Command + up arrow is a good shortcut to go up one level, surprisingly hard via gui
Publishers Target Common Crawl in Fight over AI Training Data
> Although Common Crawl has been essential to the development of many text-based generative AI tools, it was not designed with AI in mind. Founded in 2007, the San Francisco–based organization was best known prior to the AI boom for its value as a research tool. “Common Crawl is caught up in this conflict about copyright and generative AI,” says Stefan Baack, a data analyst at the Mozilla Foundation who recently published a report on Common Crawl’s role in AI training. “For many years it was a small niche project that almost nobody knew about.”

> Prior to 2023, Common Crawl did not receive a single request to redact data. Now, in addition to the requests from the New York Times and this group of Danish publishers, it’s also fielding an uptick of requests that have not been made public.
FTC commissioners are appointed, and approved by the Senate, just like judges.

The distinction you’re trying to draw doesn’t exist.
For sure! I made sure to have an open ticket with them until it was resolved so I'd have someone to call if some other automated system decided to shut down our services for it.
Depends on the extent to which you understand the Silicon Valley venture capitalism era as a permanent evolution, as opposed to an unsustainable trend!

In my nonacademic opinion, codegen is way, way less meaningful and powerful of a perspective to take on the problem than Program Synthesis. That said, I’m curious - are you mostly referencing commercial and OSS work with this comment, or does this also include institutional textbooks and tutorials and such?

FWIW, Program Synthesis is still much more popular in print according to Google Ngram - tho it’s losing ground fast!

https://i.imgur.com/bhDPzho.jpeg

Is there a similar tool that would accurately measure usage in blogs, manuals, and github pages, I wonder?
Yes but they were generally very small unheard of companies. I’ve worked with some in the past.

Apple keeps making baby steps towards the webxr spec in Safari but it could be many years before we see it finished.
But are they using it for anything else? Even GPT-2 was "good enough" for high school writing assignments. The fact that this power user class of young people hasn't found any other use cases for LLMs despite vast improvements in LLM capability doesn't reflect well on the merits of LLMs as consumer software.
I read this comment before the post, and now I feel bad.

I watched a spy movie from the 1960s recently with someone. We got 20 minutes in before she was confused about why the movie is just about a depressed drunk who lost his job in a spy agency, before my movie-watching accomplice looked up the plot of the movie on Wikipedia. Spoiler alert, there's a twist, and the movie didn't tell the viewer that.

It's interesting that modern movies have to make you think you understand something, before they pull the curtain back and reveal there's a twist. Otherwise people will get disengaged and stop watching before the twist occurs.
You'll see this often on the Internet: proof? Proof? Citation? Boy, no one's going to do any work for you. If you believe the wrong thing, the consequences are your own.

In fact, only people with no better use for their time will spend their time teaching you. This means you're being taught only by people whose time is worthless or for whom it is useful for you to believe in something.

If you're not paying for the knowledge, you're not the customer, you're the product. I never elucidate for those beneath me in understanding. I only discuss with peers.

Perhaps the only capable person I know who does different is Taleb but his pleasure appears to be in calling someone "imbecile" after proving them wrong.
I've been trying to tell people my hammer is perfect for cutting their hair, they won't listen.

Until... I show them.

They become unresponsive, but their hair is removed.

Job done.
Why doesn't Windows need such a directory to store folder customizations in Explorer?
1. I've been a doomer since before the term was invented, and I never had any worry about synthesis research based on symbolic techniques. Gödel is our friend here: they're not powerful enough to model themselves. The best you get is stuff like https://ieeexplore.ieee.org/abstract/document/7886678?casa_t... . An important component of the Sketch synthesizer is its simplifier, and this paper used Sketch to synthesize a better simplifier, and that speeds up synthesis times by 15%-60%. But that's a one-time improvement. The exponential take off comes from somewhere else.

2. Let me see if I understand your question: I think you're saying "The frame problem of AI and philosophy, https://plato.stanford.edu/entries/frame-problem/ , was the major blocker in AI systems, and now it's been solved by deep learning. What is the corresponding problem in program synthesis?" I think your "pretty damn robust" comment is important, but haven't yet figured out what you mean.

Part of the reason I found this confusing is that the literal frame problem also appears in PL and synthesis, primarily in the verification of heap-based imperative programs. See the "frame rule" of separation logic.

So anyway, what do I see as the big challenges stopping synthesis from reaching its dream of being able to generate well-designed large programs with little input?

My two answers:

First, there's the problem of finding good abstractions. You see this in very old work:trying to prove an imperative program works is easy to automate EXCEPT for the problem of finding loop invariants. This has remained a challenging problem in the 50 years since it was first described. Craig interpolation is the classic solution, but it only goes so far. The synthesis view is: figuring out how to write loops is not straightforward because you need to summarize infinitely possible states. And that's loops; designing data structures and finding good invariants for stateful applications is harder still.

Second is what I like to call the "semantic veil." Generally, for any given chunk of code, there are multiple goals and abstractions that yield the same chunk of code. See my analogy to dairy-free chocolate chips in https://www.pathsensitive.com/2023/03/modules-matter-most-fo... . So deducing the intentions of a piece of code from just the code itself is literally impossible. Unfortunately, the way humans design programs is much better understood as being about these higher-level organizational structures, and not about the code itself. This is an area where I'm excited about the potential of LLMs: they can make excellent use of the information in priors and in natural language to guess said intentions.
> This means the ability to train 50 GPT-4 scale models every 90 days or 200 such models per year.

Not anywhere close to that.

Those 350k GPUs you talk about aren't linked together. They also definitely aren't all H100s.

To train a GPT-4 scale model you need a single cluster, where all the GPUs are tightly linked together. At the scale of 20k+ GPUs, the price you pay in networking to link those GPUs is basically almost the same as the price of those GPUs themselves. It's really hard and expensive to do.

FB has maybe 2 such clusters, not more than that. And I'm somewhat confident one of those cluster is an A100 cluster.

So they can train maybe 6 GPT-4 every 90 days.
For the lazy:

To prevent this, remove `anon` from the `wheel` group and he will no longer be able to run `/bin/su`.

To prevent this, remove `anon` from the `wheel` group and they will no longer be able to run `/bin/su`.

“awesomekling commented on May 2, 2021
This project is not an appropriate arena to advertise your personal politics”
> Communism would have been a far bigger disaster for Germany than fascism - which is really saying something given that the outcome of fascism was the destruction of the nation and decades of foreign military occupation.

Huh? Chemnitz, Leipzig, Potsdam etc were communist.

Germany is still under foreign military occupation. Only one of the armies left. The communists formed a Sinatra doctrine that the other foreign military occupation never did.
> I don't see how you can equate US forces in Vietnam with Ukraine considering peace talks to end the war in their country.

Why? What makes peace negotiations in Vietnam (1968-1973) different from peace negotiations in Ukraine, and how is it relevant?

> If the US invaded Mexico, he would presumably consider the US invasion a war crime but might still consider Mexico making concessions their best course of action.

Well, he didn't call for negotiations or any concessions or from the Vietnam side, instead explicitly called for unilateral pull-out of US forces.
That's a good question. I get the impression the system is fairly opaque even to the people working there. I was told it was "resolved" and had my ticket closed a bunch of times, only to have another 30+ copyright violation emails the next time someone uploaded a batch of files from MacOS.

If the person who finally managed to figure it out ends to reading this, thanks for the resolution :)
Yikes, let the dead rest in peace
My synology NAS drops turds in lots of directories too.
Bitcoin falls below $58K in 2 months
> That link doesn't work at the present time.

Try:

$ A='https://web.archive.org/web/20240701123410'
$ B='https://staging.cohostcdn.org/attachment'
$ C='11357255-b6b9-4a57-98eb-823776a4a828'
$ D='KowloonWalledCityGrandPanorama.jpg'
$ wget "$A/$B/$C/$D"

(or https://web.archive.org/web/20240701123410/https://staging.c...)
I agree that the tech sector in general went through a lot of growth in the past 20 years, with a lot of new products.

But, I think the level of interest rates has a large impact on which projects are funded. With interest rates at zero (actually negative given inflation), almost anything is worth trying because you don't need a big return to come out ahead. And lots of those projects fail (never produce a product which can be sold), but while the projects are active people are employed. It's sort of like Venture Capital, but inside big companies: when interest rates are low, they run a lot of different riskier projects expecting some of them to pay off enough to make up for the failures.

When interest rates are higher, a project has to have a more certain return and a higher projected return in order to get funded. So weak projects are cancelled, or not started, people are laid off and hiring becomes really slow.

The mystery to me is why the rest of the economy didn't take off. Real estate did, and equities (stock market) did. But not the "main street" part of the economy or the industrial part of the economy. I think that since these parts of the economy did not take off, overall inflation remained relatively low.
Amazing how poorly btc has done relative to stocks lately. Good thing I did not succumb to the hype. Tech stocks keep crushing it compared to everything else.
Thunder Bay teen's duct tape prom dress makes finals in international contest
Holy cow, that’s crazy!
I found an ex-office HP computer with and i5-4670 on the side of the road and have been thinking about setting it up as a home server. Does anyone have a recommendation for how to set it up as a NAS, VPN, Home Assistant and Plex server?
what about jart's tinyBLAS?

https://hacks.mozilla.org/2024/04/llamafiles-progress-four-m...

also https://justine.lol/matmul/
It's a great experience. The movie Postcards from Earth is very immersive and I enjoyed that. The storyline is a pretty standard degrowther story so not innovative but it depicts it beautifully. It's definitely a striking theatre and a very enjoyable venue. It has a sort of futuristic Tomorrowland feel, which I enjoyed.
If you think about classical synthesis as fancy tricks around optimizing SAT encodings & search, neural synthesis becomes about how to solve np-hard problems there instantly. There are other perspectives as well, but that's already a dual LLM paper for a bunch of individual classical papers, without losing safety. Ex: leapfrog the concolic execution papers via a fast oracle.

Likewise, a lot of cool work is about automating the proof theory much better. Terrance Tao has been going down that rabbithole, which is amazing, and I hope the security community does too. I know Dawn Song, one of the big names here, is.

Another big area is making programming more accessible by assuming synthesizers, and language design decisions around that. A lot of that work has been shifting bc LLMs too. Ex: Historically PLs had zero domain understanding, just logic, and that has really flipped since GPT4, so the concept of a DSL is now also flipping.

Finally.. a lot of neural synthesis can and does entirely ignore the SAT aspect. There is a lot of depth to it on its own, and amazing results.
- OpenBLAS isn't _that_ optimized for any specific modern architecture.

- The matrices weren't that big. Numpy has cffi overhead.

- The perf difference was much more noticeable with _peak_ throughput rather than _mean_ throughput, which matters for almost no applications (a few, admittedly, but even where "peak" is close to the right measure you usually want something like the mean of the top-k results or the proportion with under some latency, ...).

- The benchmarking code they displayed runs through Python's allocator for numpy and is suggestive of not going through any allocator for the C implementation. Everything might be fine, but that'd be the first place I checked for microbenchmarking errors or discrepancies (most numpy routines allow in-place operations; given that that's known to be a bottleneck in some applications of numpy, I'd be tempted to explicitly examine benchmarks for in-place versions of both).

- Numpy has some bounds checking and error handling code which runs regardless of the underlying implementation. That's part of why it's so bleedingly slow for small matrices compared to even vanilla Python lists (they tested bigger matrices too, so this isn't the only effect, but I'll mention it anyway). It's hard to make something faster when you add a few thousand cycles of pure overhead.

- This was a very principled approach to saturating the relevant caches. It's "obvious" in some sense, but clear engineering improvements are worth highlighting in discussions like this, in the sense that OpenBLAS, even with many man-hours, likely hasn't thought of everything.

And so on. Anyone can rattle off differences. A proper explanation requires an actual deep-dive into both chunks of code.
Yes, it was sarcasm.

>Seems to me the thing to do is to follow in the TVA’s footsteps- which is owned by the federal government.

Such a thing is complete anathema to the mentality of Texas voters, which was the whole point of my comment. Texas won't even connect their power grid to the other states, which is why they had people freezing to death not long ago when they found out the generation facilities weren't designed for freezing temperatures.
I was waiting the whole time I read this to find a /s somewhere. Anywhere. Yikes.
Location: India

Remote: Yes, in India.

Willing to relocate: No.

Technologies: Java, Javascript, Nodejs, Golang, Python, C/C++, Assembler, HTML, CSS, Git, bash, Docker, SQL(Oracle, PostgreSQL, MYSQL, DuckDB), Redis.

Résumé/CV: https://drive.google.com/file/d/1HummmW442v1dfvPphOF-EYJXSG6...

Email: anjan.jobs.2024@gmail.com

Linkedln: https://www.linkedin.com/in/anjanbacchu/

Github: https://github.com/anjanb

20+ years experience developing Products as SaaS. Backend focused Generalist and Fullstack Software Engineer/Lead/Architect.

Have 10 years experience in USA and Switzerland working for Startups and Fortune 100/500 companies developing products. Huge Experience recruiting, onboarding and mentoring Engineers at all levels.
I think taking notes while reading fiction would be relatively unusual (outside fields like literary criticism), but taking notes while reading non-fiction is quite common, especially when grappling with denser material.

For example, I kept extensive notes while reading Bertrand Russell's History of Western Philosophy. The work assumes you're internalising as you go along, which is somewhat inescapable given the nature of the material. The author can't stop to re-explain some finer point of Aristotle's every time it is engaged with in the subsequent two thousand years.

Pausing to take notes helps one reflect on the material and solidify their understanding, but also gives them a quick reference later if necessary. I just use my phone's Notes app, to keep the barrier as low as possible.
I don’t see where he’s saying we can’t have automated moderation, though. Rather, just that there’s no 1A rights assumed for BigCorps’ systems, and that there’s a danger to individuals’ rights if the court really concludes that BigCorps do have these 1A rights.
https://evanthebouncy.github.io/program-synthesis-minimal/

Here's my take on it, you can view it as a modern extension to Armando's work (he's my PhD advisor)
The Kowloon Walled City Panorama
oh man, don’t get me started on gui applications usurping the Documents folder.
Interesting this is top of HN but no comments.

A lot more folks interested in the answer than able to answer perhaps.
Llama isn't even in the same stratosphere as the big models when it comes to coding, logic, and other interesting tasks that I think are commercially viable.
I have learned to pay special attention when the phrase 'in a sense' is being used - sometimes it is in a relevant sense, sometimes not. Unfortunately, I'm not knowledgeable enough to make the call on this one.
i'm kinda interested in doing that too. do you wear the CGM all day? what's your recommendation? looking to link to my Apple Watch as well if possible.
Online-gambling giants conquer U.S. with tactics deemed too tough for Britain
I remember playing around with setting up a Hackintosh, and found all those errors in the system logs --- then realised that an actual working Mac generates much the same (ignorable) errors.
SEEKING WORK | REMOTE | FULL-STACK Java Javascript | Location: Bangalore/India.

Location : Bangalore, India.
Remote: Yes
Willing to relocate: Yes in India.
Technologies:
Java, Yourkit, Spring,
Oracle, Postgresql, Mysql, DuckDB, MongoDB,
Redis, Hazelcast, Ignite
Javascript, Nodejs, React,
Golang, Python,
HTML, CSS, Git, bash,
Docker
AWS, Azure,
C/C++, Assembler,

Résumé/CV: https://drive.google.com/file/d/1HummmW442v1dfvPphOF-EYJXSG6...
Email: anjan.jobs.2024@gmail.com
Linkedln: https://www.linkedin.com/in/anjanbacchu/
Github: https://github.com/anjanb

20+ years experience developing Products in multiple domains to be deployed in DMZ as well as SaaS. Backend focused Generalist Fullstack Software Engineer/Lead/Architect.

Have 10 years experience in USA and Switzerland working for Startups and Fortune 50/500 companies developing products and supporting them.

Experience in recruiting, onboarding and mentoring Engineers at all levels.
I'm still missing the point, I guess, as I don't think the question is logically possible.

One might as well say: it is logically possible to have a universe where the physics are identical to our present world, except the core of the Sun is chocolate... therefore fusion can't be the explanation for why our Sun radiates so much energy.

Getting back to the zombies, presuming there could be a zombie clone of me which is indistinguishable from the real me but it isn't conscious is one that needs far more support than just asserting it. I've heard people try to explain: well, imagine if a powerful computer was simulating you in every respect, that would be a p-zombie. But that is question begging, as it presumes that such a creature wouldn't be conscious.

I feel the same way about Searle's Chinese Room -- the power of the argument is there only if you have already decided that consciousness is mystical.
Seems that nobody will ever satisfy your metaphysical expectations.

I am content with the old-fashioned Turing test: if my interlocutor can communicate reasonably intelligently, I am happy to treat him/her/it as an intelligent being.
It warms my heart to see program generation getting some light.

If you are into this then follow me here. I'm working on a program synthesis project in my spare time, a fusion of PG and LLMs.

https://youtu.be/sqvHjXfbI8o?si=rg6EnqkHtUjs1Cki&t=423