skysight-inc/HackerNews huggingface dataset:
>How would six terabytes fit into memory?

What device do you have in mind? I've seen places use 2TB RAM servers, and that was years ago, and it isn't even that expensive (can get those for about $5K or so).

Currently HP allows "up to 48 DIMM slots which support up to 6 TB for 2933 MT/s DDR4 HPE SmartMemory".

Close enough to fit the OS, the userland, and 6 TiB of data with some light compression.

>It seems like it would get a lot of swap thrashing if you had multiple processes operating on disorganized data.

Why would you have "disorganized data"? Or "multiple processes" for that matter? The OP mentions processing the data with something as simple as awk scripts.
Dealt with a project like this at work, these were part of my reading/reserach:

https://arxiv.org/pdf/2401.08315.pdf

https://www.spiceworks.com/hr/recruitment-onboarding/article...

https://hbr.org/2019/05/your-approach-to-hiring-is-all-wrong

https://drjohnsullivan.com/articles/ai-will-dominate-recruit...

https://drjohnsullivan.com/articles/predict-each-candidates-...

Kaygin, Esranur. (2023). Comparative Analysis of ML (Machine Learning) and LLM (Large Language Models) in Resume Parsing: A Paradigm Shift in Talent Acquisition.
----

From what I can tell, there is potential for non trivial assistance from LLMs in this space.
Did we fail to develop the next generation of designers?
A thump with the pointy end of a screwdriver will definitely fix this server
People keep saying it's normal etc but then you'll notice everywhere it's always the poor people who end up doing the slaughtering while rich people get to pretend it doesn't happen.

I'm not sure that being desensitised is a good argument. People can become desensitised to a lot of things, like slavery or other abuse. That doesn't make it ok.

The difference is factory farming really. I don't think eating meat is wrong, per se. (But I do think a lot of people wouldn't miss meat if they tried it, especially the only eats chicken breast type). But factory farming is disgusting.
I remember replacing a CLI program built like Lego blocks. It was 90-100 LEGO blocks, written over the course of decades, in: Cobol; Fortran; C; Java; Bash; and Perl, and the Legos "connected" with environmental variables. Nobody wanted to touch it lest they break it. Sometimes it's possible to do things too smartly. Apache Spark runs locally (and via CLI).
They can make 7 nm chips in quantity. And one or even 2 years ago there were fotos of a few exemplars of China made 5 nm chips floating around.
Concerning smaller structures, I have the gut feeling that they instead want to go for optical chips.
Seems like good news, town was almost dead, opportunistic capitalist brought it back to life by bringing jobs.

Only constraint is having to kiss the ass of Elon Musk and claim SpaceX is glorious, but it's still less problematic than a ghost town.
Risc-v is a hardware ISA optimised for education. Wasm is a sandboxed IR optimised for compilers. It would be phenomenally unlikely for risc-v to be better than wasm in the exact domain wasm was built to excel at.
Building the ENDGAME invisible PC [video]
It's not either or. There are best practices that can be followed regardless with no time cost up front, and there is taking some time to think about how your product might evolve (which you really should be doing anyhow) then making choices with your software that don't make the evolution process harder than it needs to be.

Layers of abstraction make code harder to reason about and work with, so it's a lose lose when trying to iterate quickly, but there's also the idea of architectural "mise en place" vs "just dump shit where it's most convenient right now and don't worry about later" which will result near immediate productivity losses due to system incoherence and disorganization.
Many game developers have been successfully using XNA/FNA with C# on all kinds of platforms (and, of course, Unity existed for a long time, and now we have Godot and Stride too). You get to access all the low-level bits when you need to, and you don't have to sacrifice productivity or performance for scripting otherwise.
This is like changing your profile picture to a model in a dating app, you are going to get responses but what are you going to do with them if there is no real match?

When looking for a job don't stress about gaming the system, look for an actual match that is good for you as well as the employer.
Granted. Lets add ourselves as employees AND improve the system as first action.

While we are at it, automate the first one on one, and automatically grant a promotion. Sounds like we need a recursive function....
We are a meet company and I often have calls with vendors. I very much dislike when they send zoom links.

It takes so much messing around with to actually get to the call, with meet it is one click every time.

Install the fat client, no thank you. Connect computer to audio? Why is that even a question? Zoom is living in the 2000s.
He was for OpenAI at least, he recruited key members and convinced them to go get big funding which they did seek from Microsoft instead of Elon himself. Likely OpenAI wouldn't have gotten anywhere without his involvement, they did break off from him since he wanted too much control not because he didn't help them.
I've been studying Rete for the past few years, and I've been working exclusively in CLIPS for the past year, a programming language that uses the Rete Algorithm at it's core. It's a very clever algorithm, and provides a lot of "nice features" that developers find themselves re-implementing in mature code bases. Things like:

- pattern matching
- custom DSL
- caching

I find it difficult to summarize in an "elevator pitch," and I only started seeing things fall into place after trying to use it in earnest on my own. I highly recommend reading the CLIPS documentation posted on the main CLIPS website. The PDFs are long, but quite complete and well written.

Self promotion: If you prefer something a little more interactive, check out the Tour of CLIPS I made: https://ryjo.codes/tour-of-clips.html

Just a heads up: this is not light reading. Rules-based programming is a confusing departure from traditional programming; there's more "magic" involved, similar to convention-over-configutation in other languages/frameworks. The benefits outweigh the upfront learning cost, though.

Here is a recent post on HN that recently got some traction and has some pretty good discussions: Tour of CLIPS (2022) - https://news.ycombinator.com/item?id=40201729

If anyone is working directly with CLIPS, let me know! I'm actively working on a low level networking library called CLIPSockets, and would like to work with the language full time some day.
For context, it should be noted that his platform disallows certain terms too, but sometimes worse (in a way).

For example: saying “cis” or “cisgender” flags your post as abusive and limits visibility. Saying the 6-letter (or 3-letter) f-slur does not.
> You can't follow people who occasionally post a banger but also post a lot of stuff you don't care about.

Well, you can. It depends how much you care about the part of their content that you like.

Mostly you'd follow someone else who does the job of filtering for you, and you'd hear about the great stuff slightly slower than people who followed that guy directly. You might not see that banger until the following day.
If you look at the article the data space is more commonly 10GB which matches my experience. For these sizes definitely simple tools are enough.
A similar thing has happened in France, where the government has restricted the rental of less energy efficient dwellings[0]. This is generally a good thing for the environment, but it has already had an effect on rental prices as those apartments are now taken off the market.

The exact impact is a little hard to work out, because, at least in Paris, it's also coincided with apartment owners wanting to hold on to empty apartments to rent them for the Olympics rather than to locals.

0: https://www.connexionfrance.com/practical/timetable-for-new-....
I think it is a mistake to write an entire article without talking about supply and demand. Demographics are one of the lest surprising things in statistics, they can sometimes be predicted decades out from an effect arriving. Housing construction is similarly easy to observe.

I'd personally bet that there is a gentle imbalance appearing between how much energy the average person can lay claim to vs. how much they need to build and service a house and this is a symptom of the energy squeeze. But it might not be and this article isn't doing much to prove or disprove what the actual problems are because we need more information to make useful observations.
The exception is when you have people with skills in particular tools.

The suggestion upthread to use awk is awesome if you’re a bunch of Linux grey beards.

But if you have access to people with particular skills or domain knowledge… spending extra cash on silly infrastructure is (within reason) way cheaper than having that employee be less productive.
Has MS figured out searching emails yet? After 25+ years of outlook they never seem to figure out email search.
and don't forget to scrape the fractional penny from everyone's monthly paycheck for your 'travel reimbursement'
This is exactly why I dread the future when people say "oh you will be able to tell the AI what to do, in normal language, and it will do it for you". I do not want to have 8h of "normal" text or speech conversations each and every day. It sounds exhausting. 8h of dealing with programming languages, though, that's fun!
Mongo allows a developer to burn down a backlog faster than anything else. That’s why it’s so popular. The language drivers interface with the database which just says yes. And whatever happens later is someone else’s problem. Although it’s a far more stable thing today.
Phase Blindness
There are machines that can fit that and more: https://yourdatafitsinram.net/

I'm not advocating that this is generally a good or bad idea, or even economical, but it's possible.
In `if i > x`, derivative with respect to x is mathematically 0 at all points. DiscoGrad gives you a useful smooth approximation that is not 0 and lets the function learn those conditional values.
If this works externally anywhere close to as well as it worked internally, this is going to be incredibly cool.
It suggests that the language center may not be sufficient for all forms of understanding. I guess there's a reason why we have the rest of our brains as well!

(Possibly the above might seem too glib at first. So, reasoning further...: )

But this is confusing, since natural language should -by necessity- also be Turing complete and thus be able to express anything expressible in the known universe. https://en.wikipedia.org/wiki/Turing_completeness

Would that mean that some form of Sapir-Whorf would apply, where in the case of some languages, a completely different part of the brain is activated even? https://en.wikipedia.org/wiki/Linguistic_relativity .

I think -intuitively- the best way to see it is some amalgamation of weak-form Sapir-Whorf and Turing equivalence should apply: Not all data structures are equally good at expressing the same things: Some are better than others, depending on the domain.
Do we know more about whether this works?

- People who work with hr tools, would a line like this cause any difference?

- People who send out resumes, did you have any success with a line like this?

Also, I noticed that the line itself contains “ChatGPT” - perhaps the improvement is because people search for ChatGPT mentions?
Housing is naturally a valuable thing. From birds with nests, to dogs and lions marking their territory. it’s something valuable that you self custody.
That's not how satellites work.
Can you even call voxel objects a mesh?
I love little projects, no problem with them at all. But when all author's submissions and comments are trying to promote his project(s), don't you think it's a bit too far?
Show HN: I made an AI startup idea validator. featuring Reddit analysis
It seems like you've already proved your conclusion false though if you ended up using an HTTP server anyway. The conclusion seems to be that Flask wasn't suitable for the task.
signed*
As I understand it, Musk has worked for years without getting paid. The "paycheck" you refer to is actually the OPTION to buy stock at an agreed upon price. So he has to pay to get paid. That set of stock options required him to lead the company to massive profit, otherwise he doesn't get the stock options. He did that. Having fulfilled the conditions of the agreement, vest his options.

If Musk leaves then the Tesla company will become "corporate", meaning they will only make decisions that appear to improve the next quarterly report. The thing that keeps Tesla ahead of everyone else involves massively risky decisions that require long-term goals, such as building out a charging network, moving away from the traditional linear conveyor construction for car factories, "inventing" giga-casting to eliminate parts, steps, and vendors, improving battery technology, use Ethernet rather than individual CANBUS wires, move to a 48 volt architecture to reduce copper use, etc.

Rest assured that a "corporate Tesla" will die. I suspect that's the whole point of this exercise. All of the major car companies need Tesla to go away because they can't compete. Only Tesla and BYD make a profit on each EV sold. You have to sell over 50,000 EVs to break even and the majors can't seem to do that. So the next best thing is to kill off Tesla.

Musk realized that you don't need a 500 person team working on chargers. Why have a whole "charger research team" if you can already make the best, lowest-cost to build, lowest-cost to install, chargers? You only need a small factory and an install team. Oh, and as for laying off 500 people, do you think a Union would let Tesla recover the nearly 1-billion dollars a year it costs to employ 500 people doing nothing valuable?

Musk doesn't need Tesla but Tesla needs Musk.
it doesn't have to do any sorting at all, as long as it returns back only a subset of the resumes
How much of the cost of housing is construction vs land costs, utility hookups, developer profit and permits?
Tiny houses are relatively energy inefficient (a lot of wall surface for the living space), inefficient in land usage and very expensive per square meter. And they are not suited for families with children. I wonder if these trade offs are worth it against building a reasonably sized prefab home.
It came with a few cohorts of Xooglers cashing their options out.

The amount of salesman hype and chatter about big data, followed by the dick measuring contests about whose data was big enough to be worthy was intense for awhile.
The Lumia phones were great. The first iterations of the OS tried to integrate 3rd party services deeply into the OS. (News, Social, Mail, Calendar aggregations) But the service-providers did not like that because: no advertising possibilities.

Then they had to shift towards apps, but at that time they were way too late.

If ARM matures, I could see a new Windows Phone.
Small, cheap, and weird: A history of the microcar
Politicians love every dollar?

Regular people own the overwhelming majority of homes, and they love every dollar of increase.

The finger pointing at corporations or politicians is totally misguided. It's the locals who collectively are invested in their homes and collectively (through the votes they cast) create the disastrous situation we are in.

Even the most bleeding heart liberal is all about "protecting the character of our neighborhood". Just look at San Francisco.
This year, I started teaching basic computer literacy to adult students, and that put the current UI and design into another perspective for me. So many things are made "easy" instead of straightforward, which makes explaining them difficult.

For example, the URL/search bar in browsers. It's not a web address, so if you mistype an address or it doesn't exist, the text typed in it will be redirected to search. Another browser feature, the back button. It will go to the previous page in history, but only within the current tab and browsing session. Try explaining that to someone with almost no experience using a desktop browser.

Many designs are based on already knowing what to expect. For example, GMail does not separate fields on email composer. Body field does not have a border nor label, it is literally a blank space you have to know to click.

Yet at the same time, terminology is somewhat archaic: compose, carbon copy, forward, paste, and a few other words still remain.
> I always assumed when the baby boomers retired there would be a flood of big family houses coming up for sale.

Here in Munich, they indeed are... and wherever possible, they and their often beautiful gardens get torn down, and the entire plot gets "densified" by creating as much indoor space as possible. What was one house for one family is now at least 6-8 apartments for DINKs, often built in shoddy quality with corners cut everywhere but priced and sold at record amounts (that still get paid because all the tech and car bros massively distort the wage market).

On one side, it's positive because the lack of housing is absurd.

On the other side, none of the surrounding infrastructure was built with that density in mind. Parking overflows everywhere because you physically (slope angle vs lot size) can't create enough garage spaces, traffic itself is getting more and more dangerous as the small streets have been built as tiny veins but now have to carry 2-3x the traffic load, public transport can't handle it as well, doctors/kindergartens/schools are on the verge of collapse, the grid operator doesn't allow PV or EV installation because all the density increase would first require a complete overhaul of the last mile distribution grid. And on top of that, biodiversity has taken a visible hit as all the trees and bushes getting ripped out and replaced by steel eyesores and yards being replaced by gravel so that the hipsters don't have to bother with mowing a lawn don't support insect life, so the birds vanish as well. No free-roaming cats any more either thanks to traffic.

Seriously, screw urbanization and gentrification. We absolutely need to revitalize rural areas again.
Follow hashtags. I don't follow anyone on Mastodon. That way I only see posts that are relevant to my interests.
I agree with this. BigQuery or AWS s3/Athena.

You shouldn't have to set up a cluster for data jobs these days.

And it kind of points out the reason for going with a data scientist with the toolset he has in mind instead of optimizing for a commandline/embedded programmer.

The tools will evolve in the direction of the data scientist, while the embedded approach is a dead end in lots of ways.

You may have outsmarted some of your candidates, but you would have hired a person not suited for the job long term.
The slow part of using awk is waiting for the disk to spin over the magnetic head.

And most laptops have 4 CPU cores these days, and a multiprocess operating system, so you don’t have to wait for random access on a spinning plate to find every bit in order, you can simply have multiple awk commands running in parallel.

Awk is most certainly a better user interface than whatever custom BrandQL you have to use in a textarea in a browser served from localhost:randomport
I just noticed the other day that my photos have a Siri tag which auto identifies plants. Voice memos doesn't identify bird songs.
The magic sauce: https://github.com/tan-ad/SignWave

*mentioned in acknowledgements and seemingly highschoolers, too.
The trick to Mastodon is to follow hashtags instead of people. I have a couple of people I follow but I mostly follow hashtags relevant to my interests. The signal-to-noise ratio is very high. This also means it is critical to include hashtags when you post or comment to attract attention.
I’ve had bad experiences with adding memory — even during DDR3 days — that I just replace the whole kit now. Otherwise I can get random instabilities, memory corruption, and that’s not even with XMP on.
You've nailed a lot of the problems I see with slack+meet

They do not integrate at all on these topics. Slack really could expand here (outside of huddles).
Its the groundstation that needs backing up and the location is surrounded by the sea.
That statistic says nothing about ordinary people's lives. All it tells us is that some people are making money. If prices force people to work in the tourist industry it is not a win.
Hydrolix seeks to make storing log data faster and cheaper
I think there is a law of convenience, and it also explains why many technologies improve at a consistent exponential rate. People are very good at finding convenient ways to make something a little better each year, but every idea takes some minimal time to execute.
No, but I am saying that OP’s company has a combination of risk and likely overuse of services from being a global gambling website.

Being a gambling website makes you an outsized target for attacks.

OP basically wanted to run DraftKings from the small business plan and CF understandably didn’t care to deal with a loss-leading customer like that.
I think it will be like middle-ware one choices their model by radio button. Apple may have a default model that they manage but a user could switch to various models based on whim.
Log files aren’t data.
That’s your first problem.
But that’s the only thing that most people have that generates more bytes than can fit on screen in a single spreadsheet.
But that doesn't show the first tweet in the thread like in the screenshot.

I recommend everyone sharing social media links to see what it looks like in a private browser window, because the logged out experience is usually bad and sometimes unusable.
Continuation-passing-style (CPS) in Hoot
What he means to say, is the grift is dead. All the best fish have been fished in that data lake (pun intended), leaving most waiting on the line to truly catch an appealing mackerel. Most of the big data people I know have moved on to more lucrative grifts like crypto and (more recently) AI.

There are still bags to be made if you can scare up a CTO or one of his lieutenants working for a small to medium size Luddite company. Add in storage on the blockchain and a talking AI parrot if you want some extra gristle in your grift.

Long live the tech grifters!
I can't say it won't work for every tool, but most of these AI solutions from the big vendors are just rebrandings of their existing ATS setups.

This doesn't mean that individual recruiters don't pull the CV out of their recruiting system and try it on ChatGPT, on the other hand