skysight-inc/HackerNews huggingface dataset:
I was recently working on parsing 100K CSV files and inserting them into a database. The files have a non-column-oriented header and other idiosyncrasies so they can't be directly imported easily. They're stored on an HDD so my first instinct was to focus on I/O: read the whole file into memory as an async operation so that there are fewer larger IOs to help the HDD and so that other parser tasks can do work while waiting for the read to complete. I used a pretty featureful C# CSV parsing library which did pretty well on benchmarks [0] (CsvHelper) so I wasn't really worried about that part.

But that intuition was completely wrong. The 100K CSV files only add up to about 2GB. Despite being many small files reading through them all is pretty fast the first time, even on Windows, and then they're in the cache and you can ripgrep through them all almost instantaneously. The pretty fast parser library is fast because it uses runtime code generation for the specific object type that is being deserialized. The overhead of allocating a bunch of complex parser and typeconverter objects, doing reflection on the parsed types, and generating code for a parser, means that for parsing lots of tiny files its really slow.

I had to stop worrying about it because 2 minutes is fast enough for a batch import process but it bothers me still.

Edit: CsvHelper doesn't have APIs to reuse parser objects. I tested patching in a ConcurrentDictionary to cache the generated code and it massively sped up the import. But again it was fast enough and I couldn't let myself get nerd sniped.

Edit2: the import process would run in production on a server with low average load, 256GB RAM, and ZFS with zstd compression. So the CSV files will live permanently in the page cache and ZFS ARC. The import will probably run a few dozen times a day to catch changes. IO is really not going to be the problem. In fact, it would probably speed things up to switch to synchronous reads and remove all the async overhead. Oh well.

[0]: https://www.joelverhagen.com/blog/2020/12/fastest-net-csv-pa...
It is <€1500 for the battery and <$1000 for the motor/inverter. People have diy built higher capacity electric ducati-type sports bikes on YouTube for about the cost of this clown car.

https://www.youtube.com/watch?v=JGDhgAUeBL8

https://www.youtube.com/watch?v=JxTZkSj_qV4

Range 200 miles, top speed above 100mph, street legal all for $6000-7000 by two dudes in some garage who make it up as they go along..
Except when you go to work and have to spend the day with your pants and shoes drenched. And if you have glasses, you quickly can't see anything.
…it’s 500kg. I don’t think you’re picking it up and walking away with it.
Imagine if other countries applied the same policy to US-based companies, because some US companies covertly sent data to the US.
Our post service uses this car to deliver parcels in our neighborhood along with a fleet of electric motorbikes. They take around the same space and move around at about the same speed, but I’m sure the postman using the car is a much happier fellow when it rains.
Tumblr to add Mastadon protocol support
Prison--no... we do too much of that in this country already. He should be defeated though.
I'm not a muse to a CPU, I'm a code monkey and I don't pretend to have 1% of the skills of the people who actually put in the work to make it possible.

Same with AI "art", you're an input and a filter, at most. Everybody has ideas of what to type in a prompt and everybody has an idea about what looks visually appealing to them
No to Spy Pixels
I agree with the sibling commenter that the parent poster was likely using the impersonal you. It is true that we don't know anything about you. You haven't volunteered any specifics, so we're kind of forced to guess if we want to try and respond in a productive manner.

To that end, I think that they chose a very good example. Abstractly, doubly linked lists are a special case of undirected graphs. So pointing out that a naive graph implementation is generally sup-optimal, and that usually one can more effectively model them using different data structures that Rust (and functional languages, and databases, and files, etc.) can handle just fine, neatly addresses problems that one might solve using a doubly linked list, as well as a whole host of other cases, in a single stroke.
IQM: An European Startup Shaping the Future of Superconducting Quantum Computers
Standards can be overrated, sure, but some things like Unicode support really need to be done rihht
"Saltpeter" AKA potassium nitrate was indeed harvested from latrines and other places where animal dung was collected/deposited. It was a valuable commodity as a key component of gun powder. Although gun powder would not come into widespread use in Europe for 2-3 hundred years after this event occurred.
This is simply amazing. There were so many images there that are photorealistic enough that I was trying to figure out was this a real live action project? Or had someone simply staged the images as part of a larger "art project " or something...

Took me by surprise that this was AI generated, although in hindsight it should have been obvious. For me, this is the moment I realized AI art had become something "useful", and the world isn't going to be the same.

I can see where this is going... The commercial implications are enormous. Speeding up the concept art process for movies, etc. As someone here mentioned, why not make entire movies this way? Once they figure out how to animate this stuff, it puts the movie industry out of business.

I can only imagine what my grandkids are going to be using this for.
I really doubt Butler would be in favor of these particular people pursuing space for these particular goals. Something tells me that a leftist black woman would see Musk, who holds antifeminist views, who seems like he wants to personally rule mars, who's wealth literally originates from apartheid, and who's power comes from deep pockets and not from creating a movement of dedicated survivors who achieve power through collective action, as the wrong person to be involved in space exploration.
how is "a fair distance" specified?
I used to bike year round in Canada. In the winter I would use a neck warmer to cover my face as I also had problems with my face getting cold. You'll adapt to the cold a little bit but even now when I go for a walk outside at < -10C and there's a slight breeze I need to cover my face.
I assume E: is for edit. I think GP was pointing out that the ParEdit website doesn't offer much in the way of explanation, and later found another site that did.
These cars are carbon positive in most cities as they increase pollution. These slow moving vehicles are slowing down traffic behind them. I see similar vehicles in and around my city in India and they end up clogging the lanes. As most of us are on ICE vehicles, we end up spending more time driving and increasing pollution.
Wikipedia lists some advantages & disadvantages of suicide doors here: https://en.wikipedia.org/wiki/Suicide_door#Advantages On a modern vehicle moving at most 28 mph they are unlikely to be dangerous.
The identity of your code can’t be stolen
Immersing it would probably ruin the electronics and heating element.
Guido van Rossum: Python and the Future of Programming (Lex Fridman Podcast)
Recent and related:

Tax filing websites have been sending users’ financial information to Facebook - https://news.ycombinator.com/item?id=33705532 - Nov 2022 (74 comments)

Tax-filing websites have been sending users financial info to Meta - https://news.ycombinator.com/item?id=33753058 - Nov 2022 (18 comments)
This is probably a just-so story. Australia is, by the numbers, a high-trust country, and is more diverse than Canada. Both are higher-trust than Japan. Contrary to your claim here, Japan and the US have in fact very similar surveyed levels of trust. What seems actually to be the case is that remarkably high-trust countries, surveyed at, I don't know, several SD above the mean, are rare. Several of them happen to be Nordic, and people extrapolate from there.

I'm sure being ethnically homogenous does smooth things over for Norway. But so does being small and galactically wealthy from extractive industry.
I see teenagers driving these things because I think they have such low horsepower that they don’t require the regular class of driver’s license.
Is anyone aware of an open source visual "atom viewer" for ISOBMFF files, similar to https://www.jongbel.com/manual-analysis/atombox-studio/ and Apple's old "Dumpster" and "Atom Inspector"?
Write simple sentences. Don’t use adverbs. That’s what my high school teacher told me. I still find it true.
I’m not that worried. Monthly subscriptions work mainly because they’re impulse buys.

The mental impact of paying three-four figures a year for a subscription is different from a 3.99 app store payment.

This will benefit some folks. I imagine that most people will simply pass, the same way they’ve been passing on all of the other non-Tesla car subscription/remote upgrade offers.
Mangle: Programming language for deductive database programming
You just can't fix the extreme edges this way. Above about 300K that "super light and loose shirt" is still drenched with sweat unless your "assist" is doing all the work or there's a pretty stiff wind.

Below about 250K the "nice warm clothing" needed to make this comfortable would become too bulky to make ordinary movement practical, so we skimp. We tell ourselves nope, we're just not going outside except to do stuff, and then we're coming straight back. Below 200K it's no longer practical to keep humans alive with anything resembling "clothing". You should use a building to keep warm instead. Earth is capable of both these extremes, although outside temperatures below 200K are usually only seen in the Antarctic interior during storms.
It used to be that stores would put on sales items that were languishing at storage. So it was a win-win situation, stores got plenty of customers looking for normally not wanted items at low prices, and customers got a day where they could get items that they didn't value a lot at lower prices.

But, of course, this situation isn't stable.
The Citreon Ami was featured on a recent episode of Top Gear, along with 2 other similar vehicles. They drive them around Paris doing various challenges. Link (if you're in the UK or have access to a VPN): https://www.bbc.co.uk/iplayer/episode/m001f0wl/top-gear-seri...
If blogging is like a webpage, then a Zettelkasten is like a Wikipedia for your brains.

Inspired by a thread on HN ~2 years ago, I’ve now written 1,075 interconnected notes, and no longer feel that I forget 80% of any non-fiction book I read.

Linking is key; it allows you to connect any new insight to your existing externalized knowledge base, resulting in deeper understanding and retention.

It also creates the space to connect thoughts across disparate domains, which spawns novel ideas at an even greater rate. For example, I might link an idea about neuroscience to my chess writings that links to a note about workout methods which links to a piano technique note. Now I suddenly see a new connection about applying a piano practice technique to leveling up my chess score.

It has changed the way I read, or consume information generally.

A great book that got me started is Ahrens, S. (2017). How to Take Smart Notes
Anywhere a bike can go, an electric wheelchair/scooter ("Rascal") can go. I intend on swapping out my bike for one of those when thr time comes.

There are also electric adult tricycles, etc.
Create a profile on Upwork and Freelancer. An engineer with the amount of expertise that you have should have no problems getting a solid flow of gigs.
I too use Make everywhere, but what I would give for an improved tool that had better syntax, composability, and simultaneously deployed everywhere. Sadly, it is good enough, so we shall suffer forever.
Driving 1.8 miles to the gym probably to have a go on a running machine is something else :-/
Tweet by Automattic CEO in response to another tweet about complexity of running a Mastadon server…

> Come to @tumblr. We'll add activitypub for interconnect. Don't stress.

https://twitter.com/photomatt/status/1594577983028740096?s=2...
https://www.justice.gov/atr/us-v-microsoft-courts-findings-f...

Search for "Netscape" if you're really interested.
> There seems to be a current trend in AI circles of mashing up film genres or visualising existent films either within different time periods or with different directors.

Out of boredom, I fed the prompt "Fight Club" into Stable Diffusion, and it generated some interesting images of a human that looked like a mixture of Brad Pitt and Edward Norton.

I've seen similar mixed up results when I type a prompt that includes two obscure animals, such as "an emu playing chess with a lemur". The AI spits out an animal that looks like a cross between an emu and a lemur, instead of the two separate animals playing chess.

I want to know more about how these algorithms work, but that level of detail is hard for me to comprehend. I remember struggling in my college algorithms class to write code to do something relatively simple: I think the assignment was to: given a XY plane with a set of points, I had to find a set of lines that would create an intersection of polygons that contained only one point each.
App needs to meet the standards of local laws, its not like China is just targeting American apps. The US has laws bases on color tone lol
It’s a good tool but a lot of behaviors are different with GitHub Action so you still can’t test everything locally.
Thanks for the reply! I think any canonical export format would be valuable and would give users some peace of mind :)
Or worse, sweaty and smelly. Be friendly to your colleagues
The Smartest Dog in the World
Have you really never been in a situation where you need to accelerate out of the way of another driver braking the law? For example, driving through an intersection and suddenly you notice someone is running their red light on a collision course. You must either go forward or backward. Much more difficult to reverse than to accelerate.
> Cars are WAY more dangerous than bicycles

wrong.

cars are more dangerous on average (the concept of average should be banned from any statistical analysis) because they travel many many many more kilometers than the average bike and mostly for very long distances at high speed.

But if you notice, I wrote "than slow 4 wheeled cars".

Ami is much safer than a bike, especially for the occupants.

Example: there are 3.75 million cars in Rome urban area (5 million residents)

There were 121 deaths last year caused by car accidents.

It's 32 per million vehicles.

Bike users deaths caused by street accidents have been 50 in the same year.

Meanwhile the number of people brought to ER for either having an accident with an e-bike or and e-scooter have tripled in the past couple of years. Mostly is people falling on their own and hitting their head. Main two reasons: lost balance on the e-scooter, going too fast with their e-bike.
Absolutely love this approach!
Which government is involved is what matters here. The governments involved in Airbus are allies.
We don't need to speculate - the article discusses his legal options. He explicitly chose not to pursue it for what he claims was the cost.

There is no multi-million dollar award - this isn't a TV Show or something.

Arbitration would determine, after examining all facts presented by both parties, if his account should be re-instated. Further, if his account is ordered to be re-instated, he would be awarded "reasonable attorney's fees", which would cover the cost of any legal representation he hired to argue his case.

So yes, he needed to pursue the legal path here, but chose not to. The quoted dollar amount in the article is peanuts, and like previously stated over and over, if he's so certain of his innocence and has all this supporting evidence, arbitration would ultimately cost nothing. ie. there's no reason to not pursue the legal path here.
Wow, I have long been a fan of Butler but this article was fabulous. The Parable books were good, but the special thing about Butler’s writing is how each series is as different from her other works as her work is different from all he rest of science fiction. It is a rich rich source of interesting ideas that expand your conceptual space. Xenogenesis, DNA traders save the remnants of humanity; Patternist: psychic battles and diseases that improve us at the cost of our humanity; Kindred, the shocking intersection between slave times and now; Wild Seed, life as someone that can shape shift and lives thousands of years; Flesgling, a weirdly sexy albino vampire overturns the vampire hierarchies; and so many short stories that leave you going “whoa.”

So don’t stop with the Parables, if you like expanding your conceptual space.
I don’t even grant the OP claim for Amazon. I scrolled Amazon’s deals and found all sorts of good discounts on good purchases from power banks to blenders.

I think everyone is just getting more spoiled and more likely to commiserate with others online about it.
Aluminium-based antiperspirants work for days between re-use if anyone is worried about sweating (and yeah, according to studies it is not as unhealthy as people think it is, at least not in those amounts, and no one told you to bathe in it).

Not being exposed to rain... well... I dunno, I live in Europe and people just dress up appropriately. Mostly it is just a matter of using an umbrella anyways... and proper clothes, seriously.
Could Dissolvable Cranberry Film Replace Plastic Packaging Someday?
That’s why I wish she was here: to articulate an alternative view
Also with advancements in converting natural language to programming, most programming and automation will be done by simply concise writing. Writing well will become more important in STEM than it already is.
I love your scientific calculator and graphing calculators!
foxconn workers have jobs... try south sudan and living in a slum that was built because the people around you want to kill you.

https://www.youtube.com/watch?v=ydnnRyPPLs4
Heheh company with 14 million LoC barely had tests :)

I don’t know what kind of companies you worked on, but let me tell you that the code that runs the world comes from an era before tests, and some of it is too complicated to even be tested.

Test it in production is the only way for a lot of it. Then you need observability and easy ways of rolling back. That’s about it. Regardless of the language.

Read the latest google book — code architects at google I think it’s called ? Has a couple of great chapters on testing at scale and how unittests are useless
> As was said here, our restrictions on Chinese companies are nothing compared to their restrictions on ours.

This is something that is widely believed in the US, but which is not actually true.

American companies have very large market shares in many sectors of the Chinese economy. Chinese companies are not active in the US market on any comparable level.

China used to have many more restrictions on market entry, but that was during a time in which investment was almost entirely in one direction (into China). Those restrictions were meant to prevent foreign companies from completely supplanting Chinese companies, which were technologically far behind and incapable of competing with foreign giants like Volkswagen.

The deal was that foreign companies got to exploit cheap labor in China and gain a dominant position in China's growing market, and in exchange, they took on local joint-venture partners, to which they transferred some amount of technology. As China has developed, those restrictions have been dropped from most sectors.

> As has been said here, what's wrong with deciding who your friends are and aren't?

There's a very big difference between not "being friends" and implementing broad sanctions intended to bankrupt another country's entire high-tech sector. The US is attempting to prevent any company anywhere in the world from doing business with any major Chinese tech company. This is really an unprecedented level of economic warfare, at least in the last several decades. I don't think many Americans are aware of how far their government has gone here.
I go to work by e-bike. I have a pair of rain pants that I pull over my regular pants, and a rainproof jacket. I wear glasses, but my helmet has a visor. Would a car keep me drier? Yes, absolutely, but I’d still need to walk from parking lot to office, and I’d be stuck with all the other folks in traffic.
I think it's a safer bet that Butler would assert that there is a unity between means and ends (which is to say, that the means you employ define the ends it is possible to reach, eg, an evil approach will only yield evil results) then it would be to bet that Butler was an "ends justify the means" type.
If it quacks like a duck, looks like a duck, swims like a duck, shits like a duck and confit like a duck (lipsmack) -- its pretty reasonable to assume it may be a duck and not ponder about how it could be a zebra.
Most outsourced labor is bad, all /manual/ labor is bad - it’s outsourced because the non-west are seen as grunt slaves.

Please don’t be disingenuous - I’m not talking about IT desk jobs and you know that.
Oh, here’s a prior discussion on HN that I missed…

https://news.ycombinator.com/item?id=33716429
Try getting hit by either a >400kg Ami or a 20kg bike each going 20km/h and let me know the results.
Many people don't believe that the truth or falsehood of a logical argument rests on the identity of the person making the argument.

If you want to convince them of something, it's best to point out flaws in the argument, not try to discredit the person making the argument by calling them names.
I've also been trying to improve my writing recently. What's helped me was to read through a couple of resources on how to write better [0,1,2], and then:

1. Apply the better writing advice to my everyday speech

2. Focus on writing down exactly what I wanted to say, and how I would have said it

School taught me to be super wordy and focus overly on the editing stage. Nowadays, I read everything I write out loud and if it sounds awkward (or not like me) then I just delete it and write it again from scratch. Oftentimes it helps to just close my eyes, say what I want to out loud, then write down what I just said.

It can turn out to be a little bit wordier, but it almost always ends up being easier to read :)

[0] https://www.orwellfoundation.com/the-orwell-foundation/orwel... [1] https://news.ycombinator.com/item?id=31060362 [2] https://www.amazon.com/Writing-Well-Classic-Guide-Nonfiction...
I doubt it but I share your concerns - you will always get the basic home appliances without proprietary firmware, or at least the ability to flash them with open source firmware. I can’t wait to see the first open source car for mass production.
After the Holy Mountain in 1973, it wasn't until 1989 he made another proper 'Jodorowsky' movie. Then until the 2010s when he was able to make two more films from crowdfunding. I don't think his films have made much money at all, compared to someone like Lynch who was able to get movies made for a long time.
Why ouch? If they are local-only the max mischief they might cause is relatively limited, right? Or do you suspect them of phoning home behind your back?
Midjourney is insane: simultaneously really inspiring and terrifying in the quality of "imaginative" images it's effortlessly spitting out.
It could easily contain a video consisting of a series of images in PNG or other formats. For example, Motion JPEG files are just a series of JPEG images, and used to be a standard capture and "intermediate master" video interchange format. https://en.wikipedia.org/wiki/Motion_JPEG
If you wanna have a conversation, please try at least to understand a few simple concepts.

A bullet weights 50 grams.

Would you prefer to be hit by a bike or a bullet?
Don't waste too much energy on the sock puppet. This person has less understanding of the U.S. system than my 5th grader, yet is commenting very confidently all over this thread. Account is 20 days old.