skysight-inc/HackerNews huggingface dataset:
It handles most cases, but maybe not arbitrary garbage that humans might be able to guess, but I don't think rfc4180 includes all those anyway. c2tsv is UTF8/binary agnostic. It just keys off ASCII commas, newlines, etc. Beats me how one ensures you handle anything the "same" way Excel does without actually running Excel's code somehow. { Maybe today, but next year or 10 years ago? } The little state machine could be extended, but it's hard to guess what the speed impact might be until you actually write said extensions.

From a performance perspective, strictly delimiter-separated values { again, ironically redundant ;-) } can be parsed with memchr. On Linux, memchr should be SIMD vectorized at least on x86_64 glibc via ELF 'i' symbols. So, while you give up SIMD on the "messy part" with a byte-at-a-time DFA, you regain it on the other side. (I have no idea if Apple gives you SIMD-vectorized memchr.)

Send to a file and segmentation (for parallel handling of segments) is also a simple application of memchr rather than needing an index of where rows start. You just split by bytes and find the next newline char. (Roughly). This can get you 16..128X speed-ups (today, anyway, on just one host) depending upon what you do.

Conversion to something properly byte-delimited basically restores whatever charm you might have thought ?SV had. I can only imagine a few corner cases where running directly off a complex format like quoted CSV makes sense ("tiny" data, "cannot/will not spend 2X space+must save input", "cannot/will not spend time to recompress", "running on a network fileysystem shared with those who refuse simplicity".) These cases are not common (for me). When they do happen, perf is usually limited by other things like network IO, start-up overheads, etc. Usually that little extra bit to write buffers out to a pipeline will either not matter or be outright immediately repaid in parallelism, parsing simplicity, or both.

Converting from any ASCII to even faster binary formats has a similar story, but usually with even more perf improvement (depending..) and more "choices" like how to represent strings [1]. Fully pre-parsed, the performance of conversion matters much less. (Whatever the ratio of processings per initial parse is.) Between both parallelism and ASCII->binary, however fast you make your serial zsv parser/ETL stuff, actual data analysis may still run 10,000 times slower than it could be on just 1 CPU (depending upon what throttles your workloads..you may only get 10000x for CPU local L1 resident nested loop stuff). { But we veer now toward trying to cram a databases course into an HN comment. :) And I'm probably repeating myself/others. Direct email from here may work better. }

[1] https://github.com/c-blake/nio
For sure. Living in a cave and hunting pigs is the only honest way of living.

That's what you're doing, right?
> It's hard to read a book and also watch tv and also talk to friends etc

Some of my favourite time with two of my friends is going to a bar or restaurant in the afternoon and reading together. The tradeoff is I watch less TV and have basically disengaged from social media. But that’s more than worth it to me.
Also seems to coincide with the "War on Poverty". https://en.wikipedia.org/wiki/War_on_poverty
You can also see for yourself how ad blockers register what can be blocked to Safari by looking at the open source WebKit code…
Perhaps you were visiting a nearby state our country when you shopped at that store.

Perhaps the person didn't realize it would be an issue. Perhaps they bought something ancillary and they're not that store's main target customer.
It's not in my stomach, it's food I'm thinking about buying.
ETA: I see now I was answering the wrong question: you were asking about the comparison between C and LuaJIT, not heavier FFIs and C/LuaJIT.

Honestly I think of the difference (as discussed in Wellons’s post among others) not as a performance optimization but as an anti-stupidity optimization: regardless of the performance impact, it’s stupid that the standard ELF ABI forces us to jump through these hoops for every foreign call, and even stupider that plain inter- and even intra-compilation-unit calls can also be affected unless you take additional measures. Things are also being fixed on the C side with things such as -fvisibility=, -fno-semantic-interposition, -fno-plt, and new relocation types.

Can this be relevant to performance? Probably—aside from just doing more stuff, there are trickier-to-predict parts of the impact such as buffer pressure on the indirect branch predictor. Does it? Not sure. The theoretical possibility of interposition preventing inlining of publicly-accessible functions is probably much more important, at the very least I have seen it make a difference. But this falls outside the scope of FFI, strictly speaking, even if the cause is related.

---

I don’t have a readily available example, but in the LuaJIT case there are two considerations that I can mention:

- FFI is not just cheap but gets into the realm of a native call (perhaps an indirect one), so a well-adapted inner loop is not ruined even if it makes several FFI calls per iteration (it will still be slower, but this is fractions not multiples unless the loop did not allocate at all before the change). What this influences is perhaps not even the final performance but the shape of the API boundary: similarly to the impact of promise pipelining for RPC[1], you’re no longer forced into the “construct job, submit job” mindset and coarse-grained calls (think NumPy). Even calling libm functions through the FFI, while probably not very smart, isn’t an instant death sentence, so not as many things are forced to be reimplemented in the language as you’re used to.

- The JIT is wonderfully speedy and simple, but draws much of that speed and simplicity from the fact that it really only understands two shapes of control flow: straight-line code; and straight-line code leading into a loop with straight-line code in the body. Other control transfers aren’t banned as such, but are built on top of these, can only be optimized across to a limited extent, and can confuse the machinery that decides what to trace. This has the unpleasant corollary that builtins, which are normally implemented as baked-in bytecode, can’t usefully have loops in them. The solution uses something LuaJIT 2.1 calls trace stitching: the problematic builtins are implemented in normal C and are free to have arbitrarily complex control flow inside, but instead of outright aborting the trace due to an unJITtable builtin the compiler puts what is effectively an FFI call into it.

[1] https://capnproto.org/rpc.html
Prusa is going to eat the entry level 3D printing world, unless some giant enters the consumer market. Makerbot is fading into the irrelevance: moved away from the entry level market but I'm not sure there is really space for them in the professional one.
I have used it quite a bit. What I hate about it is that it runs on my single machine and the underlying system updates feel a bit dangerous to do. Also at one point it would endlessly crash after adding another worker to a project and there is no way to debug it easily. I moved almost all the projects to DO Kubernetes now. I had written my own dockerfiles anyways since it means faster deploys. The fact that deployment goes through CI is more of a bonus. The Setup is more involved though
Since 1.18 was released it's now trivial to implement compile-time (safe) 'sum types' in Go. They're fully supported.

It's about 300loc to implement and then sum types can be defined declaratively just like any other type (and without any boilerplate).

There hasn't been any fanfare about this capability because it doesn't require any special syntax or new keywords. Just know that the suggestion that "Go 1.18+ doesn't support sum types and/or enums", is very wrong.
How do get the banks on board? Remember you only have the energy of a lightbulb between all of them and no way to pay them without incurring structural transaction fees of the sort the FA is claiming are solvable by this solution. Also remember the banks actively distrust each other and spend literally all day every day in every one of their businesses trying to beat each other in every possible legal/ethical way (and also sometimes some illegal/unethical ones). It seems somewhat implausible that out of the goodness of their collective hearts they will all decide to run your raspberry pi, play nice with one another and do the right thing.

Some problems are super easy to handwave away in theory but actually pretty difficult to solve in practise.
Well, its essentially a black hole railgun. Exept a railgun uses the magnetic force instead of gravity. and black holes are 'theoretically' really efficient at converting mass to energy.
>> I'm arguing that we shouldn't jump on something until it's understood.

Canada redid their food guide without the aid of lobbying. What didn't make the cut was meats and dairy [0]. The entire revamp of their national food guide was rooted in evidence based science. Humans don't need dairy milk, soy/oat/almond milks. Drink more water.

[0] https://www.bbc.com/news/world-us-canada-46964549
Citation sorely needed. What’s the name of that opportunity fund?
Sure, but the term “outer space” suggests an area beyond “space”

Where is “inner space” or “middle space”?
Ax56: URL Lengthener
set the registry key and the requirement goes away.

the tpm doesn't hide things from you, it hides things from attackers. if you don't want your disk encrypted, then decrypt it. you can do that. it's very easy.
Pirate Site Blocking Is Making Its Way into Free Trade Agreements
My own personal opinion on cryptos is that they are a tentative by some GAFAM to overtake banks at their own game, considering that as actual "fiat" money cryptos are "virtual values, substrate of anything" witch appear to be free but due to their mechanics are bound to network and computing power witch means to some IT-enabled subjects, so in practice as free as fiat currencies these days for their "end users", and "a bit more free" for "real owners".

However as any "money" concept rooted on "money is the value" instead of "money is just an unit of measure of some substrate" are no more scam than actual currencies, should face the same fate anyway.
And food. Stuff is almost double from a couple years ago.

Local restaurants that survived Covid are shutting down due to cost of food. Others are adding x% to food bill to cover cost. Things are rising so fast they don’t want to keep ordering new menus.
I think with moderns and dedicated VPsS this can work for a very long way.

Hetzner offers 48 dedicated vcores/192 GB RAM in a single machine for less than 500€/month. I can totally see many business working for years within these boundaries. Also, not every company need Google-grade high availability.
temp goes up with depth...

but maybe... bottom of the ocean? space/moon ?
The official solutions, node-ffi and node-ffi-napi, are extremely slow, with an overhead hundred of times higher than it should be. I don't know what they do to be so slow.

I'm making my own FFI module for Node.js, Koffi, as a much faster alternative. You can see some benchmark here, to compare with node-ffi-napi: https://www.npmjs.com/package/koffi#benchmarks
Hi and Ty for your comment. This is exactly the kinds of questions that we wanna see here because we learn new things with such.

1. GitLens is useful but it only gives you the author of a line, and the commit message. We can do way better than that as we keep indexing info from more sources + organize it in different ways

2. Similar as number 1. We will index info from more sources and organize it better.

3. Didn’t know about autoDocstring but it looks like a great analogous tool to JSDoc. We’ve used JS Doc and think it’s great for documenting functions. However, we believe there is an opportunity for documenting greater level stuff such as the architecture and the relations between modules.
At the time of writing, much of this thread is centered around (a) dismissing the study based on considerations that were ruled out within the article, and (b) dismissing the format and value of IQ tests. Let's set these aside and discuss the open question:

> What specific environmental factors cause changes in intelligence remains relatively unexplored.

What might these factors possibly be? Some candidates I am aware of, that are known to affect IQ: heavy metals in infant formula [1], increases in baseline CO2 levels [2], stress [3],
deficiencies caused by soil depletion [4]. Leaded gasoline seems to have been ruled out by timing.

It's interesting to me that this started in 1975 and is observed across Europe. Do we know of any major changes in habits or industrial practices that started around that year?

[1] https://www.legalexaminer.com/home-family/baby-food-lawsuits...

[2] https://medium.com/wedonthavetime/co2-affects-our-thinking-9...

[3] https://www.nytimes.com/1983/05/31/science/study-ties-iq-sco...

[4] https://www.scientificamerican.com/article/soil-depletion-an...
or "I agree with the current authorities."
You ever seen the front page? There is little to no "pro-American" content.
I mean, the Silk Road, like it or not, was a pretty wild innovation enabled by crypto.
Auch. I am attempting to earn money on topics that are of interest to me, which I think will be fun for others to read.
Your claim was:

> Some water intensive crops like alfalfa are simply exported to global markets and are not even used for the domestic food supply.

This is simply false and unsupported by USDA data.
You also mean they were victims of social media propaganda and gaming the system

/R/the_donald was consistently getting bullshit content to the front page using bots.

If you're pro free speech you'll need to answer towards the onslaught of bot based content generation and fake users
> "an enum" does not imply a complete absence of any sort of type safety.

Sum types are where you expect to find type safety. Some languages call sum types enums, which I expect is where the confusion lies. Neither Go nor C have sum types.

> literally every language which has constants has C-style enums

I think that ultimately that's a fair assertion, but one might argue that the definition does imply some kind of defined set. Both C and Go define syntax for characterizing enums in an established set which the machine can determine where the set boundaries lie. A language with only constants relies on human interpretation of what defines the set.

> For instance Java enums are not sum types, but are a type-safe, closed, set of values.

That's a sum type, also known as a tagged union. Neither Go nor C has those, as has been established multiple times now.
One way in which battery packs catch fire: initial weld looks good and passes inspection but turns out to be faulty after all. It disconnects, then the pack i s charged (this should not happen to cars intended for overseas transport), vibration causes the bad connection to temporarily make contact, then the current welds the contact more solidly and large amounts of current start to flow from the charged cells into the one uncharged cell. Depending on pack geometry this can be 20:1 without any kind of protection mechanism in between. The one cell then catches fire, which in turn can set off the cells around it.

This is why per-cell fusing is a thing in newer designs and why weld quality is super important during manufacture.
> In addition, two of these articles are identical, while supposedly having been written by 2 different people at 2 different news sources. Jasmine Andrade from Clear Publicist and Christopher Harpur of Daily Scanner somehow wrote identical articles about Jivteshwar on the same day.

Or a press release went out and was republished by 2 different places. This happens often. Sometimes they'll get reworded and sometimes not.

Edit: republished has 1 'l'
Inherited complex knowledge and human society did not form until a few thousand years ago

I think you are vastly underestimating millions of years to the contrary.

Tribal living had complex knowledge. Just how to make a bow, a spear, preserve food, build shelter, cloth themselves, hunt, harvest crops, treat many illnesses with local plants, coupled with the fact that it all had to be learned in great detail, first hand, for there was only oral history.

Even things such as "where are the animals" and "where are the apples" is complex, when drought, inclement weather, might cause local shortage, and traveling as the grandparent remembers "when I was young" for some alternate food means everything.

There are plants which taste like crap, but will keep you alive, but that sort of knowledge is lost unless you have Google (grandparents) around.

Have you looked at how corn meal is prepared in native cultures? I can't even imagine how many centuries, or thousands of years of trial and error that took, to make it edible.

https://en.m.wikipedia.org/wiki/Nixtamalization

What about our wormy Guinea friend?

https://www.britannica.com/science/guinea-worm-disease

If you yank this worm out, it typically rups in half. The remainder rots inside your flesh, usually killing you without modern medical care

Who retains that knowledge, for when an outbreak hits the tribe?

Who lives long enough, to notice over time (decades of adult life) what might cause the parasite.

Without paper, without Google, without written language, everything learned must be transferred to the next generation of grandparents. By having free time, by talking.

And grandparents can do many tasks which active hunters and gatherers cannot, for they have no time!

Repairing and maintaining weapons, fixing clothing, transport vessles, preparing food (which can take hours and hours), and so on.
Say we burn and sink ten of these barges per year out on the open ocean.

How much environmental damage could that possibly cause vs. acidification from dissolved CO2?

(It would be good to reduce the number of barges that sink and also address global warming, of course!)
That's stupid that a r/conspiracy post would end up here.
there is a pretty powerful CFFI package (library) to achieve this, however performance will be very implementation dependent. in case someone wants to try this, the defacto-standard, free open source, speedy implementation is SBCL
> It's theorized that there is a grapefruit-sized black hole orbiting our sun in the outer reaches of our solar system with a mass of 5 to 10 earths.

Source: https://arxiv.org/abs/2004.14192 (There was also a pretty good discussion about it here on HN.)

> would probably be too small to notice without some sort of detection equipment.

What makes you think that?
I agree, but stated another way, college is also a test of 'can this person adapt and meet demands to excel in a new system', a skill which I believe is underrated, under measured, and hugely valuable.
I may have missed something in the article, either that or the author doesn't see the obvious nuance of the situation.

It's not that "nazis are fine", but that a pro-West Country is being under attack by Russia, and both aggressor and defender happen to rely to some extent on neonazis and their sympathisers [1] [2] [3].

Thus this is not about "nazis vs. everyone else", not even close.

[1] https://en.m.wikipedia.org/wiki/Wagner_Group

[2] https://www.businessinsider.com/russia-fighter-neo-nazi-symb...

[3] https://en.m.wikipedia.org/wiki/Azov_Battalion
25 Gbit/s HTTP and HTTPS download speeds
Maybe this will do good things for https://thingiverse.com !
It’s suffered for a long time from reliability issues, a terrible search function, and a host of other usability/stability problems. In spite of these problems, it remains a massive repository of community-made 3D designs and deserves fixing if only as a piece of 3D printing hobbyist history.

Edit: removed markdown
I'm concerned the neoliberal notion of "efficiency" might be misleading anyways. Normal people may assume it means less waste but generally it feels like it's silently drifted a little bit into really meaning the amount of money flowing into their pockets.
This is frustrating to contend with because I’m not actually arguing for dairy.

I’m arguing against soy. And I’m not even arguing against soy, I’m arguing against taking soy at face value until we understand it better.
All creality are very low QC. Lot of bang for the buck, and that is one of the places all that bang for the buck comes from.
I admit I know next to nothing about this stuff, but something doesn't
add up. If everything has a Schwarzchild radius determined by its
mass, then should we conclude that particles like electrons and
protons also have a (very small) Schwarzchild radius? If the smaller
it is, the sooner it explodes, then shouldn't atomic particles have
all finished exploding a long time ago? When they explode, what do
they eject, if not more subatomic particles like themselves?
Alternatively, is the explanation that atomic particles are
extended bodies whose sizes exceed their Schwarzchild radii instead
being of point masses? If so, then what kind of stuff fills the
interior of an electron? I don't have any answers but I have a feeling
we're on shaky ground when we start trying to extrapolate general
relativity concepts to atomic scales.

edit: typo
but looking at it like that doesn't make people feel like they're some kind of freedom fighter (freedom to be bigoted trash)
2006 is calling, it wants its FUD back /s

"A Brief History of Microsoft FUD"
http://lxer.com/module/newswire/view/57261/index.html

"Ubuntu 20.04 For Windows Users"

https://www.youtube.com/watch?v=UBCE-ZH_xLA
Yep, or ask your girlfriend for permission to rape, or tell your parents you're sending them a washing machine, or posing for TikTok.
you have no idea what you're talking about.

set up the environment properly, so that the attestation can happen, and it will happen.
Yea .. no.

I have a hard time believing that you're actually trying to understand, which kind of trust the people who created Bitcoin meant and why they thought it's important.

Just claiming banks are in that sense trustworthy either neglects that banks exist in states and can be influenced or is plain naive.

We live in a world where states and central banks are constantly trying to achieve goals by changing money creation.

No matter if you see that as problematic or not, you'll hardly deny that currencies are subject to extreme pressures from economic actors (governments, banks, societies, businesses, ..).
Therefore claiming that banks can simply be "trusted" to withstand these pressures (by strictly enacting some agreed upon policy) is a bit like closing your eyes on the real world situation of currencies.
This is a great example of gas lighting right here.

Dear Octonian, users were banned left and right for suggesting Covid was a lab leak or for making their case for why vaccines were problematic. It isn’t just banning if extreme ideas and race, sex, and religion.

They banned the president of the United States. It’s about power and controlling the propaganda messaging apparatus.