skysight-inc/HackerNews huggingface dataset:
Somewhat surprised that there's a separate job category for what sounds like large-scale data cleaning and aggregation work (which IMO is 90%+ of the effort involved with data science).

Anyway, I'm going to go back to my 5K+ lines of code for an upcoming conference submission - almost all of which involve data cleaning and aggregation - and think about how I could be making a 2x more than I am now.

Thanks Hacker News.
> ZFC is consistent with itself, which is good enough for math.

That's what we believe, but we don't know it. Nor do we have any hope of proving it in some reasonable way (via Gödel's second incompleteness theorem).
Yes. I was being tongue in cheek.
Middle and high school is where a lot of students learn to stop being curious due to a lack of time. College demands far fewer hours per day, but it can be hard to forget what was taught previously.
Uniprocessor kernels even to today will do that. Linux without CONFIG_SMP and CONFIG_PREEMPT simply disables interrupts when the code asks for a lock. https://www.kernel.org/doc/htmldocs/kernel-locking/uniproces...
This completely made up series of conspiracy-laden comments is what HN is now ... well, that and people getting very confused about what free speech is.
There is also Voxel Transformer [0] for doing 3D object detection. It seems to score high but at a longer inference time penalty. I haven't heard if such models are being used in real world applications yet.

[0] https://paperswithcode.com/paper/voxel-transformer-for-3d-ob...
After a thorough session of Internet Research, I chose to start with stainless cinch rings rather than the copper crimp rings? Because copper crimp rings are seemingly preferred by professionals only due to being slightly cheaper in quantity plus looking nicer? Also the consumer-priced power tool (Ryobi) for doing the crimp rings has mixed reviews, while their cinch ring tool seems universally loved (likely due to manufacturing tolerances needed for a good crimp die).

Either way, my lack of confidence applies to all PEX-B and PEX-A connections. They're all essentially a straight friction fit with some hose barbs. I got some PEX-AL-PEX fittings/tube too (the 1" P-A-P has 35% larger cross section than plain PEX, and PEX larger than 1" seems rare and expensive), and the threaded compression style gives more confidence.

I'm not disputing that PEX is a whole lot easier, even knowing how to do copper and just watching PEX videos. As I said, "maybe I'll fall in love". I'm just starting with piping where a leak won't be a major hassle (hydronic, and eventually compressed air), and foresee myself continuing to do copper for any modifications to potable water in the immediate future. If I had to redo the whole house, I'd get over my reservations quick!
Is this what you're trying to cite?

If so.... the resurgence in populations is what caused the increase.

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3516305/
Yes I heard from a doctor that reading glasses only make the process faster because occasionally and inevitably you look at distant objects, i.e. much further than your screen, which your reading glasses are not meant for.
I never saw Pong in the wild, but played a lot of early games and home games.

A few years ago so guys at work were playing Mario Tennus on a Nintendo Switch. I tried it a few minutes and said "it's Pong" and was done. Fancy graphics and special moves (like Mortal Kombat) added to Pong did nothing for me. In fact special moves never appealed to me as I prefer skill to memorization, but that's just a preference. Anyway, Mario Tennis is just Pong but some people like it.
I've been pitched by many "data-driven" vendors offering predictions. They often have very impressive accuracy metrics (RMSE, R2, etc). When I dive into the details these metrics are often reported using in-sample predictions.

I see this pointing to any of the following:

a) DS teams overpromising the accuracy of their approaches
b) marketing driving the narrative and DS getting pulled along
c) incompetence from the DS team
My advice when coding for fun is to only take projects as far as you want to.

You don't have to do the final 20% if all you're trying to do is learn or prove to yourself that you can do something.

How much polish you apply to side projects is entirely up to you - you are the customer.

As others have suggested, embedded is a really nice area to get into, it is unbelievably easy to get started and it's different enough from day to day work.
I remember feeling the side of the case on an unresponsive machine to feel if the harddisk was seeking. It was often the difference between a reboot and a 'give it more time, it's just busy'
It was really funny to be driving in the dark from the Dubrovnik airport and hearing this cab driver in very limited English describe what he was seeing.
We’re you working whilst you were in college?
Subscribe to iCloud to unlock original quality images
> Cheaper doesn't seem feasible, at least not without essentially duplicating the meat production process

I'd say cheaper doesn't seem feasible without duplicating the subsidies received by the meat industry (including farming of animal feed). Give similar subsidies to the plant-based-meat industry, and I'd bet that meat replacements will be much cheaper than meat.

But there's a political risk at that: Meat industry has huge political influence. If their profits are hurt, they would probably demand even more subsidies for covering their "loss". Or you can expect farmers on the streets, and your political oposition taking advantage of the situation.
"One friend in a lifetime is much; two are many; three are hardly
possible." Henry Adams, The Education of Henry Adams, Ch XX, Failure (1871).

Yet curiously there is constant mention of friends in the preceding chapters and beyond: I looked up the quotation in the Gutenberg Project version, and the sentence following has the 105th of 149 occurrences of the string "friends". Was Adams just being sententious, or do we have inconsistent notions of what friends are, or both?
You're overthinking it. Executives and managers quite literally want to see data that confirms their existing convictions and beliefs so they can act on those beliefs under the guise of it being "data-driven".
The Fake Snow Leopard: Photomontage Spread Around the World
Everything on the web became a lot more dynamic. Stuff like web apps obviously but even relatively straight forward info pages end up with dynamic filtering and elements of app like functionality often.

Given that, the separation becomes more of a pointless burden than actually doing anything useful.
This. "Data Engineering" is pretty far from having a standard definition in the wild. If someone is describing a role as "data engineering" about the only thing you can count on being true is that it involves data.
The utility class shorthand is nice for simple things. But there’s definitely a “too much of a good thing” point, where the “shorthand” becomes so complex that you’re better off writing proper CSS instead, whether as inline styles or in a separate .css file.

I think that’s the main failing of the Tailwind crowd, they want to “Tailwind all the things”, use their shiny new hammer for everything, even for things where it’s clearly not the best tool, like crochet.
The easiest solution for 90% of unexpected rPi power-down cases is a small uninterruptible power supply.
> Game designers focus on stunning visuals but seem to neglect these nuances of the auditory realm.

Open world games are pretty good at this in my experience. Maybe I just got lucky with GTA and Zelda, they both had what to me feels like a rich soundscape. How else are you supposed to find all the random little things to interact with?
It is not exclusive to males. It work just as effective on females. Since females start out with significant lower (but not zero) levels of testosterone, changes in levels actually have larger impact on females.

I don't disagree that biological sex influences behavior. What is important however is that what people think it does is generally not what it actually do. To take estrogen as an example, too much or too little do have a link to mental instability. It is very hard however to defined exactly what estrogen do as a biological influencer. As with testosterone and aggression, estrogen does not cause women to go crazy. When people believe that hormones has that kind of effect the outcome tend to be bad, as well as being anti-science.

Testosterone levels in males rises after gaining social status. High testosterone levels in turn increase calorie usages that goes towards behavior which correlated to maintaining and defending existing levels of social status. In some cultures there is a correlation between both gaining social status and maintaining social status with aggression. How should one then describe the biological relation between testosterone and aggression?

One could simplify and say that testosterone has a bias in our culture towards aggression and estrogen has a bias towards mental illness, but even that would likely not be helpful in explaining difference in behavior between men and women.
How can you see the value in doing something if you don’t understand the underlying concepts?
Yes, typically weight is a concern for a lot of my purchases I carry around now. Moving from the m1 air to a 14 mbp pro was not something I really wanted to do, but I needed the extra ram.

Also downgraded my camera kits, and often dont bring them places anymore.
Thanks for the pointer. I read the video transcript and agree with their premise that indirect calls are slow.
The are several ways to proceed from there. One could simply inline FastMemcpy into a larger block of code, and basically hoist the dispatch up until its overhead is low enough.

Instead, what they end up doing is pessimizing memcpy so that it is not inlined, and even goes through another thunk call, and defers the cost of patching until your code is paged in (which could be in a performance or latency-sensitive area). Indeed their microbenchmark does not prove a real-world benefit, i.e. that the thunks and patching are actually less costly than the savings from dispatch. It falls into the usual trap of repeating something 100K times, which implies perfect prediction which would not be the case in normal runs.

Also, the detection logic is limited to rules known to the OS; certainly sufficient for detecting AVX-512, probably harder to do
something like "is it an AVX-512 where compressstoreu or vpconflict are super slow". And certainly impossible to do something reasonable like "just measure how my code performs for several codepaths and pick the best",
or "specialize my code for SVE-256 in Graviton3".

So, besides the portability issue, and actually pessimizing short functions (instead of just inlining them), this prevents you from doing several interesting kinds of dispatch.
Caveat emptor.
According to my parents (but missed by the article), it was an extremely popular drinking game.

There’s a reason the early units were mostly in bars.
> I am telling that you cannot just chase money. Chase your dreams of doing something that you want to do and money is always the side effect. OP seems to be focussed on the wrong thing.

You also cannot just chase your dreams. Many people have tried and failed miserably. You need money in order to be able to chase your dreams.

I see your point, but both sides are kind of extreme - both the "money is meaningless" and "money is everything" - neither are true. Money is a necessary means for chasing your dreams, but an insufficient end in itself.
I agree. I'd also add the fact that much of the world is experiencing a cost of living crisis, and luxury products are often the first to be cut in difficult times.
>This is identical to how employers share salary information.

For me, the difference is that using the same software to set the price based on the non-public information effectively makes it a form of collusion on setting rents, which seems analogous to the illegal practice of employees colluding to cap wages. It's not the same, I know, but has a similar negative effect in that the market is being subverted in some way.

The real question for me is what, if anything, comes out of the investigation. If some new legislation prohibiting the practice comes out, I could see the big landlords simply publicizing that data to avoid any legal issues.
<< I'm not fighting tooth-n-nail to avoid ads where I can just buy it out.

Agreed. As long as there is an option to avoid it, I am ok with paying for it ( Hulu adfree tier comes to mind ).

<< not so much as trying to avoid being tracked entirely.

Agreed. That might be overkill for the benefit it provides.

<< I want to revamp and setup a better infrastructure

I keep talking about it with my friends, but I can't find enough motivation ( and there is always an excuse not to ).
ime, most programs using readline parse ~/.inputrc.

set editing-mode vi
set keymap vi-command

That does the trick for me in python shell, psql, etc.

First thing I do on any fresh unix box is setting above, and echo "set -o vi" >> ~/.bash_profile.
No, but it reduces the % of your bandwidth that gets used for loading ads and other junk that clutters and/or slows down your internet experience.
I have heard older Soviet Russians use the word горко, but this was about ten years ago. They were trying to express that the food tasted bad and they really just called it bitter when they meant it had capsaicin.
> if I'm hiring someone to solve problems, I'd like to see how they solve a problem; and certainly your github is a record of you solving some problems.

Is this to do with your comfort level in understanding their approach?

> need to invest considerable time understanding the codebase you are working on and the problems your changes are solving before I can even begin to properly think about your changesets

Completely fair.

> during We Just Got New Budget So Let's Recruit All The People month.

Lol

> One might then go look at github repositories as well as scheduling longer meet-and-greets for the most interesting people to make the final selection.

I see, so using the activity and portfolio _after_ the fact as a means to gauge additional signal once the baseline has been met

> Moreover, many publishers don't accept direct applications, or only accept them during specific, brief, time periods - by requiring the author to get an agent to agree to represent them, they are effectively outsourcing that initial screening step)

Interesting, thanks for sharing!
Hi Bill nice to meet you im Ryan (@ryanspahn & @speakerblast_ap on Twitter) and great to hear of our mutual interests! Congrats on releasing your first app.

What's the best way to reach out to you? Email, Twitter or ?
Not everyone is wired that way. Personally, I have taken apart and reassembled most of the tech stuff I have at home simply because it interests me how things work (and broke and repaired a non-negligible amount of them in the process, to add), I've dabbled in repairing cars, gas boilers, do my own electricity work... but in my social circle, I'm pretty much the only one. And as I grew older, managed to land myself an s/o, I kind of get why - two other parts come into play:

The first issue is a lot of acquiring broad-spectrum knowledge involves risking quite an amount of money. A good DSLR cam can easily rack up a few thousand euros, a fully spec'd Mac Pro or larger drones cross the five digits without blinking. Messing around with gas and electricity can kill you, messing with water pipes can cause immense water damage. It takes a lot of ... let's say recklessness to even think about dealing with this if you're not a professional, and you have to have the resources in the first place.

But the real issue is time. Students, at least here in Europe, don't have the luxury of taking six or seven years for their basic diploma - "thanks" to the Bologna reforms, you're fucked if you can't make it in the designed timeframe as you won't be eligible for most kinds of financial aid. That means you simply cannot afford "wasting" a week to get that deep level of knowledge, you simply are happy enough if it runs well enough to get a passing grade. And once you've entered the workforce, it becomes even harder to have actual hobbies. It's one thing if you live alone, no one will bat an eye if you pull in an all-nighter on a weekend with just yourself, a crate of beer and a laptop and that's assuming you're not completely drained from your average 40 hours work week, 10 hours of getting to the workplace, and another 10 hours on domestic chores. When you live together with another person, the game completely changes: they also want time and attention from you - bonus points if your s/o has roughly the same interests that you have (which is why I suspect so many people meet their s/o at work). And with children... forget about hobbies of any kind if you don't have enough resources for either yourself or your s/o to be a stay-at-home parent.

This is why I so strongly advocate for a four-day and six-hour work week, a proper minimum wage and government-subsidized affordable housing for everyone. Just imagine what useful things people could run as side projects if they actually had the time to pull them off, not to mention the obvious physical and mental health benefits of not having to struggle with survival every single day. Add to that the elimination of "bullshit jobs" and an end of wasting the best minds of the world on financial bullshit (i.e. HFT, "quant investment funds") or advertising... or getting rid of racism and other discrimination. We as humanity could make so much more progress if we were not so hell-bent on exploiting each other.
San Francisco considers allowing law enforcement robots to use lethal force
Yes, you can tell even in the smallest chats. The tone convey desire / curiosity or the lack thereof.
This is one of the things I enjoy most about learning things in different domains. Most of the time it looks so foreign because of.. language. But often the concepts and ideas are not as intimidating or complex as they seem once you get past the language barrier and are able to distill things down to a simpler understanding.
The first messenger platform that’s 100% private by design
SimpleX has no access to your connection graph!

Other apps have user IDs, SimpleX doesn’t, not even random numbers. This radically improves privacy.
Did you stuff the dynamite into the fish? That is what Borin told me these guys did. Then, you throw the fish into the water? At that point, their fishy friends come up and say "Jeez Svetlana, you looked bloated!" And, then BOOM, the fish all fly out of the water given the large blast zone.
Or, let the tiger eat you, and never have to worry about food again.
I’ll vouch for chi here as well: if I’m building a Go web service and I really need to go one step above http.ServeMux, it’s the only library I consistently reach for.
The intuitive leap which is hard and important is how "not knowing" works.

Presumably you are choosing to invest in an asset because over the long term you believe it will go up. But you know nothing about what it will do in any defined timeframe.

Choosing to DCA with a fixed strategy is choosing x prices at which to enter, of which (x-1) are unknown. But they are fixed, and based on your above assumptions you know nothing about them except that they're generally trending upwards (and thus your entry price is averaging up by DCAing). Knowing nothing means knowing nothing, it's as likely to vary upwards as down.

You can express the above as a summation with a positive (but unknown) dv/dt and a canceling-out e if you think better in notation, but I can't figure out how to make that legible in a HN comment.

If you have any reason to believe that there is more downside risk than upside risk over the DCA period, then you should delay investing until that is no longer true, and go 100% at that time.

DCA is essentially the same intuitive leap as the Monty Hall problem, but backwards.
You'd end up with much larger source.

Imagine you have a React component you render once for each element of a JSON array:

products.map((product) => (
<li style={{color: "rgb(180 83 9)"}}>{product.name}</li>
))

which would be the equivalent in tailwind of doing

products.map((product) => (
<li className="text-amber-700">{product.name}</li>
))

In this case, the `class="text-amber-700` attribute isn't going to be much different in size than `style="color: rgb(180 83 9)"`, but tailwind has other utility classes such as ".grid-cols-3" which would be equivalent to an inline style of "grid-template-columns: repeat(3, minmax(0, 1fr));"

It also lets you set up a minification pipeline which turn the "text-amber-700" example above into something like

.xJ2Xa9 {
color: rgb(180 83 9);
}
...
<li class="xJ2Xa9">Awesome product #1</li>
...

I'm sure you could minify inline CSS similarly, but I suspect the tooling there isn't as polished.
May want to add Do Kwon (Stanford) and 3AC (Columbia) to further solidify your case.
Checks my CV:

50k+ lines of R, 10k+ lines of Julia, 5k+ in Python, C, and who knows what else. Most of it for what is, essentially, data engineering work.

Where do researchers with social science degrees fall on this scale? Less money, less clout. The projects are certainly interesting though (which is why I do what I do).
> There is already a well-defined way to write CSS inline, no need to obscure it with 'helpful' utility classes... right?

Inline CSS doesn't support lots of CSS that is critically important, like media queries, pseudo selectors, etc. That's the big reason why inline CSS should generally be avoided. There's nothing intrinsically wrong with it otherwise.

You're almost certainly using a templating language to generate your markup anyway, so if you're worried about the need to repeat common styles then factor out the common style declarations into shared variables in your template language. Yes, it's a way to avoid writing CSS, but look what it gets you: you've reduced the number of languages and files you have to manage and context switch between when developing. Typically this is programming language + template markup language + HTML + CSS + JS.

Eliminating 20% of your cognitive overhead is nothing to sneeze at. You can add something like htmx and remove most of the JS too for a 40% reduction. Front-end development actually starts approaching something close to pleasant.
Phone number is enough to find who is behind it in most cases.
So true. This article accurately describes DS at many companies.

The preceding sentence is a hilariously cynical zinger:

“Those who have seen my Twitter posts know that I believe the role of the data scientist in a scenario of insane management is not to provide real, honest consultation, but to launder these insane ideas as having some sort of basis in objective reality even if they don’t.”
> The easiest way is to start by putting everything into one file. You can start simple, defer some decisions, and evolve your project with time.

This is something that most even senior developers don’t grok. Default so called project starter scripts of the node world don’t help either.

The more structure you build before you know wth you’re doing, the more difficult you’ll make life for yourself down the line when you inevitably have to refactor code.
I'm surprised that no file system has made it into mainstream which has error-correction capabilities (without RAID) such as Reed-Solomon or Fountain Codes.

Also, I'd like to see file systems with cryptographic hashes for protection instead of checksums.

Surely these would be extremely useful for long-tem storage formats?
And there's no fsck for it on Linux, last I checked.