skysight-inc/HackerNews huggingface dataset:
> Id quit the moment I realized what my job was about

there's a scene in Arrested Development where Buster believes he's playing a airplane simulator video game, when in reality he was piloting drones for the Air Force the whole time

https://www.youtube.com/watch?v=IWKjZzm9VnU
if you just extend the metaphor in the diagram, and imagine a negative length to just refer to direction, sure it does :)

personally, I love visual proofs because they can communicate an idea efficiently, sure they have their pitfalls, but its less about the actual mechanism of the proof and more about the core idea that lets me appreciate how its working- and visual proofs add a pseudo-physical intuition that helps me appreciate it.
My opinion: the high-prevalence of implementations using Spark, Pandas, etc. are mostly driven by (1) people's tendency to work with tools that use APIs they are already familiar with, (2) resume driven development, and/or to a much lesser degree (3) sustainability with regard to future maintainers, versus what may be technically sensible with regard to performance. A decade ago we saw similar articles referencing misapplications of Hadoop/Mapreduce, and today it is Spark as its successor.

Pandas' use of the dataframe concepts and APIs were informed by R and a desire to provide something familiar and accessible to R users (i.e. ease of user adoption).

Likewise, when the Spark development community somewhere around the version 0.11 days began implementing the dataframe abstraction over its original native RDD abstractions, it understood the need to provide a robust Python API similar to the Pandas APIs for accessibility (i.e. ease of user adoption).

At some point those familiar APIs also became a burden, or were not-great to begin with, in several ways and we see new tools emerge like DuckDB and Polars.

However, we now have a non-unique issue where people are learning and applying specific tools versus general problem-solving skills and tradecraft in the related domain (i.e. the common pattern of people with hammers seeing everything as nails). Note all of the "learn these -n- tools/packages to become a great ____ engineer and make xyz dollars" type tutorials and starter-packs on the internet today.
That’s exactly my point, I think you get better alignment with “show don’t tell”.

Rectangles and dotted lines only get you so far. Being removed from actual code makes you forget the real constraints - the stuff that actually slows you down doesnt appear in google docs. “Here’s what I’m thinking (points at Draft PR)” gets you farther in my experiencre.

And yes it’s 100% an opinion. It’s a personal blog not a peer reviewed article :) I’m happy to be wrong.
1. Networking and keeping contacts. Not LinkedIn which I have found to be completely useless and full of lunatics and weirdos. Good old fashioned email and exchanging details when you work with other people. Check in with people occasionally to remind them you still exist. I have to turn work away.

2. Mostly bullshitting people then winging it.
Good idea haha
Until what age?

I've always seemed to need a lot of sleep. I'm a night-owl.

For about 1 month, a few years back, I suddenly started waking up early, like 6am (in Winter). Had a couple of hours before anyone else was up. It was great. I didn't plan it, it just happened. And as easily as it arrived, it departed. I've tried to forcibly repeat it, but I just wake and feel awful, am super sleepy and get nothing done.

Wish there were a switch.

I can go to bed at 8pm, get 12 hours of sleep and still feel awful in the morning.

I'm middle-aged, fwiw.
Discussion (91 points, 4 days ago, 45 comments) https://news.ycombinator.com/item?id=42390683
You could know the market was going to go silly with stocks like Yahoo in the late 90s. But you also had to pick the right time to dump everything.
To be fair, at the time you made your comment, those arguments against robomartin were only correct, not valid. Some of them were not even correct. They were almost entirely unsupported assertions rather than valid arguments from verifiable facts. Hopefully my comments have improved that situation.
It has 7.5 on IMDb, most people seem to like it (I give it an 8).

https://www.imdb.com/title/tt0120663/ratings/?ref_=tt_ov_rat
A well-written, thoughtful, and diplomatic response by Ed. I wonder if he was a good boss to work for
If you're using EBS for shuffle/source data you've already behind.

If you can afford it you should be using the host NVME drives or FSX and relying on Spark to handle outages. The difference in performance will be orders of magnitude different.

And in this case you won't have the ability to store 64TB. The average max is 2TB.
Probably Star Raiders. Great Game!
No it’s weak because it aims to explain reality as a simulation for humans (whereas humans are a tiny irrelevant part of reality), and it does not fundamentally differ from past faiths and religions of humans being played by the gods.
I don't think this code can make use of the tensor cores, or the wgmma instructions that you typically need to get peak performance out of them.

Programming these is a nightmare as you need to have several in flight concurrently for peak performance.

Perhaps you don't need the extra flops as you end up bandwidth bound?

Regardless the good thing about the code in the blog though is it'll probably work pretty well for other accelerators, if you port it to HIP or similar. If you use wgmma I'm not sure it'll even be portable across Nvidia generations.
Thanks for the suggestions. I think a comparison table would be useful, but I want to make sure I do it right since I'd be comparing my work to someone else's.

As for the compilers, I’ve tested the library with GCC, Clang, and MSVC, and with the -pedantic flag like the GP mentioned. The library should build with any standard-compliant C99 compiler.
Hard agree. I don't know if "design doc" is the right word—I call them technical analyses—but writing up a doc that connects business & product needs to implementation details is highly useful to get everyone on the same page in terms of requirements & deliverables.

If I'm clear on the requirements & everyone else is clear on what I'm delivering, this is unnecessary. Sure, jump straight to prototyping. But this is rarely true for any serious project. There are always unknown unknowns that you need to tease out from the stakeholders, and a technical analysis is a great way to do that.
Yeah it's really odd how much OS/2 software has been lost considering the last IBM release of OS/2 Warp was only December 2001. Thanks for your work. Personally, I am currently debating buying a ThinkPad T23 or T30 and dual booting OS/2 Warp 4.51 and Arca OS 5.1
Check out:

- https://www.fractionaljobs.io/

- HN - who wants to be hired

- Talk to people you have worked with.

- Keep your eyes open all times. E.g. I always pop into careers of a HN post, I keep a list of companies I am curious about. I do this even though I am not looking for a job.

- Negotiate - ask a FT job if they will do PT or contract.

- Find an agency to join as a contractor

[edited for clarity]
I work from home. For a while, I was using Focusmate to keep me on track, which worked very well. I implemented something similar using a standard smart bulb connected to Apple Home, and then I just controlled it using shortcuts and Hammerspoon such that it would turn red when my webcam was active, and turned off when it wasn't. I mounted it in a normal lamp outside my office door. It worked really well to reduce family interruptions when I was trying to work. I haven't been doing this for a while now, but I'll probably come back to it at some point.

I called it my Roxanne light :-)
Box jellyfishes are on a different level. Jellyfish on steroids level of sting.
It's more likely that someone who holds this belief will be able to move substantially faster with an LLM, than it is that an LLM would take over this task in its entirety.
I agree writing is beneficial. But I also find this works with coding. And they go hand in hand for exploring in my experience.

And in the end a good PR has a lot of writing too and has this effect. IMO this sort of well documented draft PR serves as a better design proposal because pure writing causes you to forget important constraints you only remember when you’re in the code.
Exactly. Good breakdown.
Hey, first of all, thanks for having a look. Honestly, I never thought it would grab any attention, but your feedback is definitely valid. This small driver was something I quickly put together as a simple prototype, borrowing parts from Pimoroni’s C++ driver https://github.com/pimoroni/pimoroni-pico/tree/main/drivers/... (you probably find some answers here). I initially needed it as part of a Pimoroni GFX PACK driver concept I was working on.

Now that it’s got some attention, it seems worth spending more time improving it.
> The following report corrects the most common and pernicious federal tax myths.

It's worth highlighting how much work the "federal only" limitation is doing here, especially when you get things like (3) “The Middle Class Pays Higher Tax Rates than the Rich”

There's a good chance people making that complaint are referring to all their taxes, a broader set that includes state income tax, property tax, sales tax, gas taxes, etc., almost all of which are regressive instead.
You should read the article. Vim does run everywhere, including inside Emacs. You don't "choose vim over Emacs," you choose vim, and optionally Emacs if you want to use Emacs in whatever context. evil-mode is a great vim; using that won't stop a vim user from using native C vim instead of emacs lisp vim when logged into a remote system

(source: vim user for twenty years, Emacs ten)
All you can do now is to go to the source data.

If you want long term trend data, it’s easy to get good data for free. It’ll be boring and most trends will be positive (thank our lucky stars we live in the technological era). Unless you have a real passion, you’ll most likely not visit one of these sources twice (World Bank, IMF, FRED in the USA, tradingeconomics.com, the SEC)

If you want short term, real-time data, you’ll likely have to pay for it. The downside is that there’s a deluge of data and almost all of it is useless (unless you care about up-to-the-minute prices for beans in China or whatever).

The job of journalists is to mine all this info for something sensational or, failing that, spin some short term data bump into a big story.

Way back in the 1940’s, there was so little data out there that the WSJ could simply print all the current market events and call it a newspaper. There was so little entertainment out there, that people bought and read that paper!

Information dissemination remains an unsolved problem.
Never tried but try finding really small companies (<20 employees - the fewer, the better).
Robotic Adaptive Interview Strategy Based on Interviewees' Speaking Willingness
Here's where the comparison with WeChat maybe breaks down.

I lived in China for years, right during the time that WeChat (WeiXin) came out and evolved to become the "everything" app (vanquishing Weibo and others).

But I've only used WhatsApp for text messages and didn't even know that it had all these other features until I read this article.

So maybe it isn't really comparable to WeChat in that sense -- or maybe it is, I don't really know actually.
Could it be that it is more sustainable to have them as blends?
That used to be true when a pig would feed an entire family for a year. You're about 100 years out of date if you think this is still the case.
Can't you just get an OPEN/CLOSED sign for like $1?

Or write "BUSY" on a piece of paper and tape it to the back of your screen?

Or just tell who ever is bothering you to fuck off for five minutes

Or just keep a loaded gun on your desk as a deterrent

Or just stop working with other people and achieve enlightenment
Lit has an experimental SSR plugin:

https://lit.dev/docs/ssr/overview/

I also sort of made SSR work under next.js (not to be mixed with server-components), but that took a lot of hacks and going off the beaten path:

https://www.npmjs.com/package/@lit-labs/nextjs
It's always easy to ignorantly criticise technology choices.

But from my experience in almost all cases it is misguided requirements e.g. we want to support 100x data requirements in 5 years that drive in hindsight bad choices. Not resume driven development.

And at least in enterprise space having a vendor who can support the technology is just as important as the merits of the technology itself. And vendors tend to spring up from popular, trendy technologies.
What’s the best way to check in? I feel kind of inauthentic when I do it.
I don't understand - why does the existence of a CLI tool mean we're risking a grey goo situation if an LLM helps produce Dart code for my production Flutter app?

My guess is you're thinking I'm writing duplicative code for the hell of it, instead of just using the CLI tool - no. I can't run arbitrary binaries, at all, on at least 4 of the 6 platforms.

Beyond that, that's why we test.
When you are in the flow all you want to do is code, so I think having it be automatic is a big value add.
This perspective is pretty pervasive from what I have seen. However, I think the analogy should be taken to its logical conclusion. There are many, many examples of long lived structures built by carpenters and other craftspeople (in England there are residential dwellings dating back 1,000 years). The materials and maintenance have proved themselves and show that it does not take the large legal framework of engineering to design a structure fit for purpose. However, craftspeople and apprentice style training are not acceptable for the design and certification needed for modern skyscrapers, large format factories, bridges, or transportation infrastructure.

I am more than willing to use, support, and even participate in software that is not critical and think a more-bright line separation should exist to delimit the arena for which craft scale software is appropriate. The other side of that is I am willing to acknowledge the existence of arenas not suited to less than formal and legal requirements for the design and ‘construction’ of software artifacts.

Controversially, I think societally we use software in too integrated and too many areas that are better left sequestered and siloed. There really is no reason that a general computing device should be used for both untrusted internet connectivity and storing and accessing banking or medical information. The ubiquity of protected purpose built hardware should have been a goal, with a more general open computing hardware environment used by informed choice.
Your post is composed of outright lies and, charitably, ignorant analysis. It reads more like propaganda than an actual argument.

> They recently shot someone for fare skipping rather than simply removing fares, even though it's a massive loss to the city to staff the subway just to recoup a small percentage of lost revenue.

This is an outright lie as you likely know. They shot a man who charged at them with a knife. Don't believe me? Watch the body camera footage.

What's more, no major metro area in the entire world has fareless transit. Fares a key part of funding the operations of the public good and so is not something you "simply" do. NYC MTA prices are already extremely low (compare them against any other comparable Euro system) and have the option for low-income residents to pay half fares.

> has the highest police budget of any metro area in the world.

Simply taking a total budget and comparing it to other another total budget is at best a poor choice and at worst looks like more of a propaganda choice. Budgets would need to be scaled by population as well as local costs to make them remotely comparable. But what's more, to the extent that it's even true, it's quite marginal. The NYPD budget '25 is proposed at $5.75B[1] whereas, for example, the London MOPAC/MPS budget is 4.36B GBP[2] which converts to $5.5B. This was just the first major metro I checked!

What's more a _perhaps_ more reasonable way to look at this would be police officers per capita. Here we can see that NY is comparable to many other major metro areas [3] and significantly below some (eg Paris and Madrid).

But most importantly, the presence of police officers is not remotely authoritarianism. The enforcement of laws is not authoritarianism. The manner of restrictions, the immunity of the police and authorities above laws, the form of trial system, etc are what make up authoritarian systems and it is quite obvious that none of these characteristics remotely define NYC and it's a comedy to suggest so.

[1] https://council.nyc.gov/budget/wp-content/uploads/sites/54/2...

[2] https://www.london.gov.uk/sites/default/files/2023-12/MOPAC%...

[3] https://discovery.ucl.ac.uk/id/eprint/10183480/1/global_citi...
WeChat is most definitely an "everything" app in the sense of this discussion: messaging, shopping, money transfers, bill payments, cab hailing, transportation (planes, trains, etc.), utilities, hospital appointments, customer service, news, etc. etc.

Source: I used it for years in China at the time it evolved into the "everything" app
Sure, if I know the Powerball winner or some weird meme stock spike a day in advance, but that's getting a bit off the topic of seeing the front page of a major news source a day earlier for the most part. (And even the meme stock takes money to really take advantage of)
Fractional Jobs – Job Board for Fractional Work
I once visited a lab near Berlin where they told me that cell-free synthesis is basically like cell-based synthesis, just that they kill the cells first and use what's inside. The major benefit, I was told, was that you don't have to keep the cells alive.

It sounds very odd at first glance but seems very fascinating to me (and I know way less about biology than I would like to), this idea of dissecting a system into its pieces because we know how to use the pieces in a superior way to the original system itself.
Aka “Ready, fire, aim” from the Pragmatic Programmer.

This approach is fine but make sure your iterative prototyping is refining some sort of e2e / acceptance test, with good comments / README describing the intent.

It’s really easy for the prototype to end up being shipped and painful refactoring happening once you’re successful.

For me, a lot of the time this ends up being a question of what is known vs unknown. If you have a clear customer requirement but technical uncertainty then iterating on prototypes is usually better. If you have unclear customer requirement then shipping MVPs iteratively is usually better. If you have organizational uncertainty (eg you need to compose components from multiple teams and align roadmaps, as is common in big companies) then the design doc is often the place to start.
Could you elaborate on why you think so?
They probably did post that link, but HN helpfully rewrote it to point to old Reddit, which is usually better than new Reddit, but also doesn't get updated with new functionality like this.
I bailed at create an account.
I’m just here to fulfill the Hacker News rule that any post mentioning the Antikythera Mechanism must have a comment linking the excellent Clickspring build videos.

https://youtube.com/playlist?list=PLZioPDnFPNsHnyxfygxA0to4R...
https://www.bbc.co.uk/programmes/m0024x0g

Up to date and with a very good discussion of the 254:19 gearing.

Also much more detail on the history of the mechanism.
Indeed I was even taught it in 2d before 3d (and higher).

Even Pythagoras applies to any dimension, although admittedly it doesn't quite fit its usual statement in terms of triangles for higher dimensions: if a vector v has components (v₁, v₂, ...) then its length squared equals v₁² + v₂² + ...
Apple hasn't really been known for good mice especially since they switched to usb. Their best mouse was the Mighty Mouse and not by much.

The entire magic mouse concept is half baked since it relies too much on invisible touch areas for much of it's functionality. It's also way too thin for most people to use comfortably for extended periods of time. It's a really bad design overall but the bottom mounted charging port was the straw that broke the camels back.

Apple could release a "pro" mouse that mostly copies the functionality and form of the MX Master 3s, and it would likely be a home run.
I totally agree. The prototype being shipped is the #1 risk. And why even though I prefer this approach, it may be impractical if organizations can’t be disciplined.
Purpose, my guess: Fun, joy of understanding, tinkering, learning and education.

Such projects can grow and eventually somebody learning on this builds the next Language or Qemu.
iOS isn’t much better. Paste in a number and just want to add a country code? No way.
Very unusual that new text appears at the top. Is there any specific reason why you chose to do it this way?

I played for a bit but the frustration soon became too real, haha :-D
(How) I Build a Feature
Python Meta Circular Interpreter (2019)
Buttondown Alternatives
I think Elon's target was WeChat, and the article implied that WhatsApp had essentially the same functionality as WeChat, but that may not actually be the case, or maybe only in some countries like Brazil.
> The fundamental issue is treating AI as a magic code generator rather than a collaborative team member.

The fundamental problem is the tools being marketed and onboarded that way. I don't blame them for getting frustrated.

You can't expect everyone to simply understand the limitations of LLMs and how the tool might be implemented. There is a user discovery issue at play here.
I hated it on first watch, when it came out, due to expecting something different. Now I absolutely love it. I get why people don’t like it, like how Tom Cruise goes around almost but never actually having sex, the movie always hints at a satisfying wrap up but never delivers it, which is totally intentional. It works with many different interpretations, you can read it through cultural, psychological, and probably other lenses. Still I’m wary of talking about it since it’s probably too effective at portraying a paranoid mindset.
Here's one case that I think is strong: At work some teams use JSF, some use React. We need to deliver components to both. We chose lit and we're very happy.
guy has a seriously simple use case
Open source companies that go proprietary: A timeline
Check any radiation map to see what's probably happening. Parts of New York, in the vicinity of the sightings, are showing extremely high radiation levels.

Its probably just drones searching for the source with the secrecy aimed at trying to avoid a mass panic.
To give some humility, we've been around for hundreds of thousands of years as a species and for most of that time we could not have done what you've stated above. Farming, cities, animal husbandry, etc. are very very new for homo sapiens.

You really can't use "thing humans do in modern times" as an indicator of the superiority of humans. For a start no individual human could do something like build an industrial process for exploitation anymore than an individual termite could build a city since no individual has all the knowledge required nor could they build that knowledge from scratch. If all it took was a singular individual and not a collective we would have achieved this much sooner in our history. Your aphid example is much closer to how humanity operates than you give it credit.
(2022) Small discussion at the time (100 points, 8 comments) https://news.ycombinator.com/item?id=29910776
Agreed. You can write prose or implementations or tests beforehand and I don't think it matters too much which you choose, just as long as you give yourself a phase 2 for incorporating the learning you did in phase 1 and put a reality check of some kind in between them.

The only problem with having the draft being implementation is that maybe you'll get pressured into shipping the draft.
Final vote on Dec 17.
So it’s a tautology.

Your hypothesis is undecidable, why would humanity in your scenario be more of interest than whales or octopus or bees or ants or fungi?