skysight-inc/HackerNews huggingface dataset:
> I'm still waiting on a Python project that compiles to pure C

In case you haven't tried it yet, Pythran is an interesting one to play with: https://pythran.readthedocs.io

Also, not compiling to C but to native code still would be Mojo: https://www.modular.com/max/mojo
> The Intel fanboi

Is that pronounced “fan-BWAH”?
- The ability and want to learn. I offer the following advice to every firefighter I teach: the day you think or believe you know everything, is the day you quit. (I'm a software dev. by trade with fifteen-odd years experience as an operational firefighter (and still am to this day)).

- Find a domain or two you have an interest (better yet, a passion) in, that isn't IT, and pair your IT skills to it. My day job is (more generally) emergency management, so I pair my geospatial analysis and programming skills to solve problems within the emergency management domain.

I don't think AI will completely take over, simply because of [1], though it will somewhat remove or reduce the need for 'generalists', where much of the workload is handled by AI, at the prompting of a software developer or engineer, much like how many farm hands were replaced by farming machines when they became a thing. That said, I think we're still half a century off AI truly replacing most software developers.

Humans will still be required to 'know what 'good' looks like' and ensure that whatever slop AI spits out actually fixes the problem. This is where domain-specific knowledge is incredibly valuable. See how you can apply your skills to make your interest or passion field better, using AI to your advantage, by exploiting your technical skills with domain-specific knowledge.

Most people think of firefighters as just that - putting out fires. That's only partly true though. We use a shiny, and fast, red toolbox on wheels to solve the problems of others, whether that be (actual) firefighting, rescue, first aid, replacing smoke alarm batteries, engaging with the community, even fixing things. Firefighters now days are closer to problem-solvers than they are firefighters. We just happen to respond to emergency calls too.

Be the problem solver in your domain. AI, in my opinion, won't be able to truly problem solve, or think outside the box, for many decades to come.

[1] https://www.commitstrip.com/en/2016/08/25/a-very-comprehensi...
The "open" and "permissive" license has an interesting section on "AI Ethics":

> AI Ethics. NVIDIA is committed to safety, trust and transparency in AI development. NVIDIA encourages You to (a) ensure that the product or service You develop, use, offer as a service or distributes meets the legal and ethical requirements of the relevant industry or use case, (b) take reasonable measures to address unintended bias and to mitigate harm to others, including underrepresented or vulnerable groups, and (c) inform users of the nature and limitations of the product or service. NVIDIA expressly prohibits the use of its products or services for any purpose in violation of applicable law or regulation, including but not limited to (a) illegal surveillance, (b) illegal collection or processing of biometric information without the consent of the subject where required under applicable law, or (c) illegal harassment, abuse, threatening or bullying of individuals or groups of individuals or intentionally misleading or deceiving others

https://developer.download.nvidia.com/licenses/nvidia-open-m...

Besides limiting the freedom of use (making it less "open" in my eyes), it's interesting that they tell you to meet "ethical requirements of the relevant industry or use case". Seems like that'd be super hard to pin down in a precise way.
I find the same problem with gmail on my iPhone. Every time I clock a link it asks me to use Chrome or the default browser. I set a default browser for a reason dammit, just use that one.
> A judge says "If the shareholders knew everything, they wouldn't have approved that"

That's not what the judge said. It's more like "this award didn't follow the requirements for such an award for a corporation in Delaware". It doesn't at all depend on some prediction about what the shareholders would or wouldn't do in other hypothetical scenarios.
If you read the article, it uses that construction. To quote: "The Japanese parliament has passed [...] a law that compels Apple to allow access to third-party app stores and payment providers on devices that run iOS." There's quite a bit more required of Apple, too, if you read further.
> “Please, God, kill me now.”

Who among us hasn't had that exact reaction?
But what they will push out? Anything living eats whatever gives waste on which other depends as nutrition one way or other except human.
As a German living in Berlin I’m not exactly an outsider, though I do have an outside perspective. In Germany business environment is not harsh compared to many other places. Based on my observations here people are part of the problem too.
Glad to hear that apple did not get away with this. I just hope that they can end up actually allowing sideloading, meaning we can install any ipa, just like you can run any executable on a mac. Is the mac less secure because of this? No.
Amazon Has Upended the Streaming Ad Market, and Netflix Is Paying the Price
AWS's pricing is just ridiculous. Their 1-year reserve pricing for an 8x H100 or A100 instance (p4/p5) costs just as much as buying the machine outright with tens of thousands left over for the NVIDIA enterprise license and someone to manage them (per instance!). Their on demand pricing is even more insane - they're charging $3.x/hr for six year old cards.
Great suggestions here. I'm using Warp Terminal regularly (https://www.warp.dev/) which works for me very well but Alacritty and iTerm2 (my last go to) are only being mentioned. Should I be worried!
I mean these results: https://digitalassets.tesla.com/tesla-contents/image/upload/...

Disastrous.
Wow, that is a great article. Incredible research and depth. Thanks for the contribution.
It's amusing because Linux started as a hobbyist solution. I think the results will speak for themselves. Asahi Linux is quite usable with some limitations. Corporate support for Linux doesn't guarantee usability based on past efforts.
I wonder how long NVIDIA can justify its current market cap once people realize just how cheap it is to run inference on these models given that LLM performance is plateauing, LLM's as a whole are becoming commoditized, and compute demand for training will drop off a cliff sooner than people expect.
Delve is a great debugger for the Go.
For your future reference, the colloquial English expression "For all we know" implies that a humorous exaggeration follows.
To some people, it makes a difference if the fibre is all yours or if you're sharing it with someone else.
>> The minority argued that if you are exerting constant pressure backwards

But that isn't how it works. The pressure on the trigger has to be varied for the gun to keep firing. She seems to think that keeping your finger in the same place constitutes "constant pressure" but that's simply not true. If there was constant backward pressure, then your finger would follow the trigger when it moves backwards in recoil. In that case, the bump system wouldn't work. To be fair I think she just genuinely doesn't understand this and the majority are partially to blame for overcomplicating it.

With a semi-automatic firearm, you must relieve the pressure/force on the trigger between shots and for that reason it cannot be "a single operation of the trigger". If this fits the definition of "single operation" then you'd only be allowed to fire a semi auto once. Firing it again the following year on your birthday would make it a machinegun.
I don't really care about Tesla. I care about not contributing to increasing the wealth (and thus power) of the likes of Musk.
> However, based on open-source codebases for these different devices' kernels, it appears MediaTek is actively maintaining several different trees for this driver, likely based on the associated kernel version, and these two devices use separate trees.

This one sentence just perfectly sums up everything that's broken in the embedded (i.e. everything non-x86) world. Everyone just forks random stuff at random points in the BSP's life time, and no one makes even the slightest effort to upstream it to mainline Linux (if that's possible at all given that Android's Linux fork itself does a lot of things differently than Linux upstream likes).

> I found two vulnerabilities in this driver. CVE-2023-32837 was a textbook OOB read/write in an array of structs. Various different members of the struct were accessed and modified, creating several different possibilities for exploitation, but also making them significantly more challenging. Interestingly, MediaTek partially fixed this bug in July 2021, although the exact date this patch went out to OEMs is unclear.

And that's the second point of danger. All the forks floating around make distributing patches in an efficient way all but impossible.

The fact that it's Google complaining here makes it all the more hilarious IMHO. Google are the ones who could fix this in an instant: demand upstreaming (or at least, reasonable efforts towards that) as a part of getting the Play Store certification.

A side note towards root exploit hunters: MediaTek's stuff is particularly gory. I'll admit my knowledge is some years dated, but I can't imagine that their code style and code quality has improved over the time...
Beyond the data, OpenAI is getting access to the most valuable users on the planet. Everyone using this will see that "ChatGPT" is what's used when Siri is not smart enough. It really puts their brand out there in a big way. They want to be a household name, like Google.

It's also smart for Apple because they can slowly improve Siri (one can dream) so that it falls back less and less on ChatGPT. They can also make a deal with Google (Gemini) and others, so that they can start giving users the choice of what LLM to use, which means they can start charging Google or OpenAI another 10Bn++ for being at the top of the list, or being the default choice entirely.
Bleh. At that point just dissociate. By the time you've got PTSD symptoms it's usually too late to simply prevent memories from being recorded.
True, but these are also medieval farmer’s fields, about as all-natural and organic as possible. They are certainly more natural than a parking lot, and barring very much stone construction would probably rewild within a generation or two.

Edit: The more I think of it the stone construction really is the most unnatural part. Especially the ancient tradition of building those little walls using the stones you cleared in order to plow.
Yes, it very much did hit a nerve.

Gumbo does not disclose anything about what group with special privileges you're supposed to be a part of and that's the entire point - I don't want to know. I don't care if you're black, white, or purple. Don't care about your gender, sexuality or personal life either. Never did, never will.

Which is precisely why bringing up minorities when you are just an anonymous jumble of letters and the attempted guilt trip is a bunch of insufferable manipulative hooey. It is not a "fair question" by any stretch of the imagination, you know nothing about me other than I don't subscribe to your garbage worldview.

You already exposed yourself as an insufferable bully with this: "The only people I’ve talked to who oppose DEI efforts were either blatantly sexist/racist"

Nice try. You go place burdens and play these games with people who have patience to put up with your nonsense. Strain as hard as you will to be offended and oppressed, no such luck bud, and absolutely nobody called you any names either.

I don't need you to be upset, your emotional state does not concern me one iota.

Talk about a lack of self control. You are extremely out of line.

You obviously will disrupt every workplace and gathering with tantrums and false accusations whenever you don't get your way. Tough cookies, you ain't getting your way with me no matter what.

"If you don't agree with me you are a bad person" is the most childish kindergarten bullshit imaginable. Take a look in the mirror, enough woke sharia. Enough.
Llama-3 is one of the models provided by AWS Bedrock which offers pay as you go pricing. I'm curious how it would break down on that.

LLAMA 8B on Bedrock is $0.40 per 1M input tokens and $0.60 per 1M output tokens which is a lot cheaper than OpenAI models.

Edit: to add to that, as technical people we tend to discount the value of our own time. Bedrock and the OpenAI are both very easy to integrate with and get started. How long did this server take to build? How much time does it take to maintain and make sure all the security patches are applied each month? How often does it crash and how much time will be needed to recover it? Do you keep spare parts on hand / how much is the cost of downtime if you have to wait to get a replacement part in the mail? That's got to be part of the break-even equation.
I mean, no, I came to scan the comments quick after reading because there's a lot of bad info you can walk away with from the post, it's sort of starting from scratch on hosting LLMs

If you keep reading past there, they get it down significantly. The 8 tkn/s number AWS was evaluated on is really funny, that's about what you'd get on last year's iphone and it's not because apples special, it's because theres barely any reasonable optimization being done here. No batching, float32 weights (8 bit is guaranteed indistinguishable from 32 bit, 5 bit tests as definitely indistinguishable in blind tests, 4 bit arguably is indistinguishable)
I thought it was generally known they were operating at a loss?

even with the subs and api charges, they still let people use chatGPT for free with no monetization options. Sure they are collecting the data for training, but that's hard to quantify the value of.
Anyone else finding this very difficult to read? I’d really recommend feeding this through a grammar checker, because poor grammar betrays unclear thinking.
At the risk of hijacking the comments, I've been trying to use OTel recently to debug performance of a complex webpage with lots of async sibling spans, and finding it very very difficult to identify the critical path / bottlenecks.

There's no causal relationships between sibling spans. I think in theory "span links" solves this, but afaict this is not a widely used feature in SDKs are UI viewers.

(I wrote about this here https://github.com/open-telemetry/opentelemetry-specificatio...)
I went to school before smartphones. Back then we used to stare out of the window, throw paper aeroplanes, whisper talk to friends or - mostly - just sit there being insanely bored and checked out. There was never a time when teachers all held their students in rapt attention.

At least with the phones those students might well be learning something, or at least getting some reading practice. Even in the most pessimal case it's not useless. When I was at school there were still teachers whose entire teaching methodology was writing out notes and diagrams on a rolling blackboard, and we copied them onto paper. Literally just human photocopiers! You think we were engaged? No chance. I remember about three facts from years of being in those classes, and those facts are useless. Even scrolling Instagram would have been 10x more educational!
Aviator (YC S21) Is Hiring Engineers to Build a DevEx Platform
What specific sharing are you talking about, the wavelength, the individual strand, the entire cable, the trench?
Security, sec ops.
...what? The game was made by a teenager. The only reason they're now old is because 55 years have passed.
Who would that be? I could imagine HFT maybe.
These costs don't line up with my own experiments using vLLM on EKS for hosting small to medium sized models. For small (under 10B parameters) models on g5 instances, with prefix caching and an agent style workload with only 1 or a small number of turns per request, I saw on the order of tens of thousands of tokens/second of prefill (due to my common system prompts) and around 900 tokens/second of output.

I think this worked out to around $1/million tokens of output and orders of magnitude less for input tokens, and before reserved instances or other providers were considered.
Google AI might kill you: identified Destroying Angel as edible"button mushroom"
And this is the improved situation! The original iPhone did not permit installing an alternate browser.

It also did not allow Flash in 2010, and this was during the height of its popularity. https://en.wikipedia.org/wiki/Thoughts_on_Flash

Same thing with other plugins or interpreters that would sidestep the app store: https://stackoverflow.com/questions/12972802/appstore-ios-ap...

These are not technical limitations, they are business, building a walled garden to enshrine the app economy.
For the company as a whole, no, it's not worth it long term.

For the division chief who smashed their targets, got a big bonus and a promotion, and used it to jump to a higher-paying role at another company? You better believe it was worth it!
3-10 minute video is a crazy ask to put into the second page of the application, after already asking a large write-up in the first page. Don't have people invest their time and switch it up with something you know is off-putting and rely on sunken cost to get applicants. Bonus red flag points for no salary or hourly pay information.
True, it's definitely feasible to make non-aluminum satellites. I do tend to go get up on my systems engineering soap box when people just talk about launch cost as it's a conversation I have too frequently in my job as well.

The mass consideration has certainly changed things in general. One of the things we have seen is a shift from aluminum honeycomb panels to just machined aluminum plates which weigh more for the same stiffness but are easier and faster to manufacture.

Steel might also drive more spacecraft to have to do a controlled re-entry (something the Starlink satellites are not currently designed for) as with the higher melting point and more mass it is more likely to survive re-entry. Although it does have a lower specific heat capacity than aluminum so I'm not quite sure on that one but usually the things I have seen that we expect to survive re-entry are titanium tanks and large glass mirrors. They also have the benefit of being in the center so there is a bit of an ablative shield.
Yeah, that's kind of why I think it's important to reinvent the wheel sometimes.

The "logical" choice if you want a custom OS is to start with a Linux, glue together Grub and a kernel and if you're really ambitious maybe write your own windowing system on X or Wayland or something. I think it's safe to say that's what most of us on this forum would do, and it's certainly what I would do, and I don't think that's an incompetent decision.

But I think it's important for people shoot for the moon and inject entropy into the process. Terry definitely had a very interesting way of thinking than the average engineer, and I think there are more than a few clever ideas buried within TempleOS that we might not have otherwise. If we don't occasionally inject entropy into the process, I think we find plenty of local maxima, but miss a lot of potentially higher potential maxima.
ArcGIS, SPSS; a lot of unwieldy packages with legacy format considerations allow you to specify a virtualenv.
Many companies use this style of "support" in place of employing real people and don't provide a method to escalate to a real human. What guard do I have, as a consumer, against trash like that? What makes yours unique?

When I call for support I expect to receive support. I have never ever had an AI or robot support assistant that actually provides the help that I need when I call.

How do you address the possibility of LLM generating absolutely false information?

Do you actively tell the user where they can contact a real human to provide feedback about the terrible customer support response that your product will undoubtedly provide? Or is this just another dumpster fire of "it sounds like you're having trouble with our product. here's our FAQ..."?

Does your product integrate with internal company APIs? How do you deal with the risk of customers abusing that?
How is inference latency for coding use cases on a local 3090 or 4090 compared to say, hitting the GPT-4o API?
The Wonderful LLMs
It's not about the level of calculus knowledge for me - it's about building this from scratch with 1960's technology in 50 lines of basic and very little prior art.

It's easier to be the second person to do something.
being 6 orders of magnitude off in your cost calculation isn't great.

groq costs about that for llama 3 70b (which is a monumentally better model) and 1/10th of that for llama 3 8b
> Shortening this propagation delay (e.g. using Android APEX to ship updated kernel drivers) would go a long way to minimizing the Android driver patch gap.

Oh, I didn't realize APEX could ship kernel modules; that's neat.
No. Unfortunately, also same ol', same ol'. Rant somewhat follows, if mildly cohesive.

Elsiever's famous for acting that way. Yale, Harvard, Cambridge are known for the same.

Try exploring doing anything with academic publications. Every use falls into about the same case as the archive.org case. "We own an indefinitely copyright that lasts 70 years after our institution collapses, and if you're even allowed to read the articles without paying a fortune ($50 to find it's a 2 page scam publication, $10,000 for a subscription), you may only do so for personal consumption with no distribution." https://www.elsevier.com/about/policies-and-standards/pricin...

The prices are funny. Ever heard of "Applied Surface Science", 0169-4332? $25,462 subscription for surfaces ... that are applied. How about "Colloids and Surfaces A", 0927-7757? $20,167 subscription to find out whether you'd ever care. Frankly, all journals with the word "surface" are expensive. Magazine prices be like "daaaamn" (Friday). To be fair though, you can learn how to anesthetize your own subjects (Advances in Anesthesia) for $282.

Review completely happens in the dark if you really pay attention. Peer reviewed? Do you peer review their articles? Have you ever actually met anybody who does? They always seem to be in far away fortress schools you never meet with fancy title names like the "Dogsworth Diapers Emeritus Lifetime Chair of El Supremo Tacos." In years of academia, I think I got asked to look at a paper once for a prof. who was lazy.

The only way they're a "bastion" is in the sense of a medieval fortress paywall that takes away all opportunities, does nothing with what they've hoarded, and then stacks money for score like a game mechanic.

Obvious, I'm a huge fan of modern academia. Take all above as somewhat bias.
Smacks of the "starving kids in Africa" fallacy, you could make the same argument that tech people should be thrilled for current thing being available at $X for X = $2/$20/$200/$2000...
Ditto 1.0: Community-Based Nostr Client and Relay
Oh, fond memories.

I learned BASIC programming when I was 11 in 1981 (I think that’s right) at a summer computer camp on an Apple II.

I made a simplified version of lunar lander… it was ridiculously fun to make and play.

One of my cohort mates who was in the “advanced” Pascal class is still my friend to this day.
Story time: Chrome is a Frankenstein of C and C++ code (both directly and through called libraries, static or dynamic). Now C++ has `std::string` obviously. C of course has `const char *`. To facilitate interoperability C++ has various methods to implicitly or explicitly convert between the two.

At one point it was found these every keypress on the OmniBar resulted in 25,000 string copies.

So my point is that you can write C++ as carefully as you can but on any sufficiently complex code base you'll going to need a pointer to something and then you've really lost all control and safety so the safety in C++ is a bit of an illusion.