skysight-inc/HackerNews huggingface dataset:
Thank you for your comments! They are very insightful. To piggyback a bit:

Assuming you are a competent data "analyst" who wants to become a data engineer, how would you go about it? Is "go back to school and get a CS degree" the answer? I suppose this question is very broad, but I am curious if a practitioner like you has an opinion.

---

To give some context:

I recently graduated with a STEM PhD, and looking to move into data science. Reading the comments, I feel like I fall into the "pointless data scientist" cohort derided in this thread. Eg: I am very comfortable doing typical analytical work & occasionally training models inside a notebook, but I am neither a cutting-edge theoretical statistician nor a data engineer.

I've been trying to improve on the engineering side. For example, I did a project recently where I set up a rudimentary pipeline that continuously pings an API, uploads the data to a cloud database, then serves up the analysis via a Flask app. For me this was a big step up from just doing notebooks on a csv file :)

But moving beyond the basics, I am not sure what to study next. Hence my question. If you have any suggestions, I would greatly appreciate it!
Learn Rakudo Perl6 in one video: https://www.youtube.com/watch?v=l0zPwhgWTgM

This guy is so amazing. Mad props to him.
LOL maybe they'll see this and hire you, simp

Also, the juxtaposition was meant to highlight the various competitors in the space, not necessarily to say that those don't also acquire companies to gain share.
Does Twitter automatically ban everyone using the hashtag #CanHasPDF? That's how scientific papers were spread before SciHub; what Elbakyan did was to move the copyright infringement off Twitter and to a dedicated service.
Which makes it sounds like AWS wasn't competing very well in the space, if it couldn't do so affordably.
Huh, chocolate chip cookies are the main thing I DO make with aquafaba. I wonder what we are doing differently on that dish? They don't come out as perfect cookies for me (they definitely don't brown as much), but consistency wise is pretty much spot on.

I loosely base my recipe on the one Babish came up with on his channel.
Jumanji?
Those folks have reasonably counted on having fruits of their labor to be available under Apache 2.0

Not really; the essence of permissive licenses is that proprietary extensions/versions are allowed. If you want to contribute code that will always remain open you need a copyleft license like GPL.
Native Americans say U.S. does not own land it is about to give to Rio Tinto
Simple explanation: americans get less sleep today than they did 20 years ago.

https://www.cbsnews.com/news/americans-get-less-sleep-than-2...
Why not https://www.adsbexchange.com ? FR24 filters out military planes.
I found myself asking the same question a few weeks ago. The StackExchange link is probably more comprehensive, but I wrote a bit about it as well, here:
https://blog.mcquade.dev/why-is-the-sspl-not-an-open-source-...
* Certain things were not as rigid as I’d like

* Really dry skin

* Night sweats like you would not believe

* Urinating a lot

* Depression and fatigue
Good question!

Bitcoin has limited scripting language (Bitcoin script) for security reasons. Having a general smart contract language could open up a larger attack surface area for Bitcoin.

The transaction costs will be low initially as they're a function of network traffic. The main thing here is to decouple scaling of transaction (as miroblocks on Stacks chain) from the scalability of Bitcoin (and Bitcoin is hard/impossible to change).
I wonder if this could be the causal link between the two that has always been missing, lead -> higher testosterone -> more violence.
The best technology is the one that your team is most familiar with.

Native apps will always have the best feel and performance. Frameworks like Electron and Flutter can come close, but they're not magic bullets.
Like, putting water on the gas tank is obviously wrong, as it's called a gas tank, and gas cars don't tend to run on water.

Clicking a button that was enabled for me and does many things in the background is not so obvious.

Also, cars have been accessible to everyone way longer that PCs and smartphones. Most people alive today (in developed countries/areas) saw their dads driving when they were kids. A person in their 60s didn't have a PC when growing up
California Democrats see backlash after recall ‘coup’ claims
> I've heard Perl described as a sort of linguist / grammatical type of language, where you can solve the same problem using multiple approaches and syntax. Is this something Raku is drifting from or embracing?

Very much embracing – "turning up to 11" might be a better way to put it. I recently wrote a three-part blog series[0] about what Raku's primary values, and the more-than-one-way-to-do-it idea features prominently in that list.

[0]: https://www.codesections.com/blog/raku-manifesto/
Hmm this is super tempting. I’ve been wanting to make a digital wall clock + purple/air now AQI near my patio door. How does crowd supply work? Is it similar to Kickstarter or do they charge only on delivery?
> and shoot mortars

Mortars? Are you sure about that? What kind?

Edit: Oh "fireworks mortars". Ffs. Just say fireworks.
I wish I could read ancient aramaic because I'm pretty sure they don't literally mean its fine to lie about anything that doesn't involve someone living nearby.
I'd personally attribute far more of that to the cultural zeitgeist of (a) name brand power and (b) a variety of streamers using 5e for streams of real games, than to any inherent property of the actual rules.
It's widely recommended in vegan circles to discard bean soaking water. Here's an example:

> So after the beans have soaked for a while, the soaking water now contains these elements that you are trying to eliminate by soaking the beans in the first place. And this is why the bean water is discarded. So it is best to drain the water and rinse the beans thoroughly before cooking. -- https://www.vegancoach.com/why-discard-bean-soaking-water.ht...

Anyone know whether that's right or wrong? Does it depend on the bean? Maybe the soaking water is a problem but not the cooking water?
Does anyone know if that liquid is jam packed full of Bisphenol A, since it's stewing in direct contact with the edges of the can? I'm always suspicious of that.
Wolfram Gap Year Research Programs
Typically when I see that said, its impossible to tell if someone genuinely has no idea or if they have a comprehensive view but move the goal post of “use case” for arbitrary reasons

Do you want to be inspired and be part of that ecosystem, or do you want to drone on about how you could do any example use case some other irrelevant way that nobody can interact with
Let's not make this a generational divide thing, shall we? There's people of all ages who seem to think AI research is like a silly ball game, where one cheers their home team's plays and boos their er, whatsitcalled, the other team's plays, no matter the plays.

And who can blame them? AI (read: machine learning) (read: deep learning) research has turned into a huge feeding frenzy. People see all the billions thrown about by Google, Facebook et al. and they go crazy. Maybe they think that if they cheer hard enough and boo hard enough they'll look knowledgeable and "passionate about machine learning" and maybe someone will hire them. Maybe they just want to be on the right side of history, with the winners, not the losers. And when there's so much money to win, there sure are plenty of losers!

A while ago someone posted here an article that advised that to become expert in machine learning one should (among other things) "flashcard X papers in major sub-fields" or something along those lines. Pretty revealing of what people are thinking of: Google is hiring machine learning specialists. Shut up Garry Marcus, you'll scare the fish off.
I was in Germany for some time, I thought I would lose weight walking everywhere and eating differently; but I actually didn't lose a single pound. I don't know if muscle replaced fat, but I felt I looked the same and weighed the same. I was truly baffled.

During the early pandemic, I stopped drinking for 3-4 months...and still didn't lose any weight. I honestly don't understand the human body.
BMI is only so good of a measure. A bodybuilder would be labelled as morbidly obese.
They can't be about IRL things because those things cannot be verified in a decentralized manner.
"You can read all the dating books you want, but getting in shape is the only thing that works."

I don't know my guy. I'm 39, weigh 280lbs at 5'9 but am married to a smart and beautiful women a decade younger than me and 150lbs lighter than me. It's not a sugar daddy thing either, she makes more than I do. Not everyone is shallow and a great sense of humor / shared interests / good personality is more than enough for plenty of people. That said, being fit certainly ups the odds in your favor.
I think you're going about this the wrong way. Your target audience gets tons of unsolicited email, most of which is trying to sell them something. You also are selling... not asking for their money (yet), but asking for their time.

You need to get warm introductions by other means. Use your professional network if you have it. Find out where some of these people hang out (industry events) and start chatting casually; this includes virtual events during COVID. Is there a support group or message board where these individuals go for support regarding the problem you're solving? Try helping them directly since they're actively seeking help. If the VP of data has a problem that your product solves, who does that person task with solving the problem? Target that person instead of the VP.

People with power at the top of an organization are difficult to reach, by design. The front door is locked: you need to find the side door.

Imagine you had a skin-care product that helps any person instantly look 10 years younger, and you want to offer this product to your favorite movie star. How would you reach this person? Not by sending email.
I used to live with a Mexican family and one of the first non-milk foods they fed the babies was the water drained from cooked beans. I'm not sure if it could be used to cook or make cocktails but it was somewhat thick.
* decentralized DNS (ENS) which supports IPFS

* privacy technology (tornado cash, AZTEC)

* DeFi (MakerDAO, Uniswap, Compound, Augur, etc)
Yes, but Glenn and Snowden are deities on HN. Your comment won't stand for long.
The Proud boys do have members from all races, but not very many of them; and the vision of masculinity they present is extremely narrow rather than inclusive. There's significant internal tension within the group between the 'optical' approach espoused by its nominal president Enrique Tarrio and a more explicitly racist/neo-nazi one proposed by his informal rival, Kyle Chapman.

I think the white identity thing is more widespread on the far right than you appreciate; even neo-nazis have examples of ethnic diversity that they like to bring out (eg photographs of black soldiers in wehrmacht uniform socializing with caucasians) but these are employed mainly as an aid to entryism in breaking down reflexive hostility to national socialism, rather than because neo-Nazis are actually trying to build an ethnically diverse movement.
I believe this fix only applies if you have an old version of their service workers. I remember reading some esoteric nonsense about why it's the case. I agree with the user you replied to, it's absolutely absurd that doing this is the "fix."
Had to read everything to realize this isn't some new open source software.
> I can instruct or employ someone (or something) to do this, but then ultimately they will make the decision for me. It's only plausible to do this at scale, unless I'm wealthy enough to employ my own personal food-taster, so it makes sense to band together with other users with similar requirements.

And here we run into the issue that economists and political scientists call "the Principal-Agent problem"[0].

Whether we're talking about the management of a firm acting in the interests of owners, elected officials acting in the interests of voters, or moderators of communication platforms acting in the interest of users, this isn't a solved problem.

And in fact, that last has extra wrinkles since there is not agreement on just whose interests the moderator is supposed to prioritize (there can be similar disagreement regarding company management, but at least the disagreement itself is far better defined).

This is deeply messy, and as hard as it is now, it is only going to get worse with every additional human that is able to access and participate in these systems.

[0] https://en.m.wikipedia.org/wiki/Principal%E2%80%93agent_prob...
I'd be curious to know more, I'll try to take a look at that book when I get a chance. Are you saying, though, that Nazi Germany was very poor relative to its neighbors (e.g. France, Poland, Italy) or relative to the world at the time (e.g. Mexico) or in an absolute sense (widespread extreme poverty, lack of basic necessities of life)?
That's not wrong. We invited david-given to repost https://news.ycombinator.com/item?id=14165741. But it's only at #1 because the community upvoted it.

You can see a list of invited reposts at https://news.ycombinator.com/invited.

If anyone sees a great, forgotten submission in the HN archives, please let us know at hn@ycombinator.com so we can consider inviting a repost. There are tons of these, like amber in rock.
Building Clusters with Serf.io (and Fly.io)
None obviously, but I think the key here is that butter contains protiens and milk fats that are tough to replicate using non dairy ingredients, unless you are of course making margarine.

I'd imagine aquafaba's unique properties allow you to build "butter" around its structure to simulate the dairy ingredient we are familiar with.

It's not just a 1-1 egg substitute.
Chrome will let you select multiple tabs; click on the one on the right, shift-click on the leftmost you want to close, Ctrl-W. Not quite the same thing, I know.
but not sleep
Avalanche to unveil novel blockchain features with Apricot network upgrade
I think it'd be the opposite reaction if the US adopted the NZ strategy. People would be outraged that the money is going to companies, especially large corporations where most people work. Someone would come up with the statistic that 80% of the money went to the richest 100 companies in the US or something.
Show HN: Djelly AI that predicts cloud usage and analyzes costs
A conflict large enough to be classified as a civil war would require a great deal more organization than has occurred so far. At best it was a halfhearted coup attempt by a small group of nothing to lose hysterics under cover of a protest. Not much of a plan other than to cause trouble and maybe kill a target of opportunity.

Now if, for instance, a group of state legislatures and governors decided to meet and elect Trump as president of their own collective splinter nation I would say we'll have ourselves a "Civil War." Though how long it would last is hard to say.
If Twitter were just a few million users or something, I'd subscribe to the "they're a private entity, let them do what they want", but they monopolize a huge portion of our national (indeed, international) dialogue to the effect that they can unilaterally influence election outcomes for the world's most powerful democracies (at least that's the implication if you subscribe to the 'Russia manipulated Twitter algos in 2016' theory). Unless Twitter's monopoly is broken, content on Twitter (and other monopolistic social media networks) should be regulated as "free speech".
Yep. We got a call once regarding a device we had sold 10 years ago that had fried due to a new defect. Our response as a company known in our industry for excellent customer service was "We're very sorry to hear that, would you like to be forwarded to sales?" Some stuff isn't made to last forever, and at a certain point we have to weigh "We want everyone to like us and recommend us to their friends" vs "No one in the office has seen one of these in the past 5 years".
A knowledge managment software, much better than Jira, Notion and alike. As being a knowledge base will be the only goal!

Let me know if you want to be notified when released
RISC-V based beagleboard coming to market
I mean, he left because as a founder of the intercept, he had a contract item that editors couldn't deny him the ability to publish in the intercept on the grounds of content. When they told him that he couldn't publish anything that could be construed as against Biden, he left as they had broken their contract with him.
Well, now that you've talked it up like that, I'm head-writing some ideas for a library that could fit this magical food product's name.
Show HN: A new way to better manage and complete your PRs
is this the same Drummond of David Drummond, ex GOOGLE VP?
https://en.wikipedia.org/wiki/David_Drummond_(businessman)
Celebrating my sixth year with Elixir! The adoption rates here is still quite low (Malaysia) but I'm glad to say that onboarding new Elixir developers has always been a breeze.
Why the downvotes? There's been a skyrocketing increase in consumption of junk food in low-wage worker class who often can't find the time to cook and cannot afford more expensive healthy food.
I'm not sure if this is what it's referring to, but I've never used raw beans for aquafaba. It's precooked beans that are soaking in water that make the aquafaba. By that point hopefully you've already cooked the nasties out of the bean
Not the poster, but I did post the same topic (but "only" at Wikipedia) four months ago [1]. That submission totally tanked, though.

I felt it was interesting enough to post then not only because it's rather unexpected, and useful if you want to avoid eggs in your food, but also because it's new.

I had just realized that day that the entire concept of using aquafaba as egg white replacement has not been around for very long. I mean the Wiki page says that the first recipe for meringues using aquafaba was published in 2015.

I think it's really cool that such things are being discovered still. I mean the recipe for egg-based meringues is probably a few hundred years old [2] although sources are obscure. To have a vegan replacement using basically two ingredients appear six years ago is just cool! :)

[1] https://news.ycombinator.com/item?id=24210986

[2] https://en.wikipedia.org/wiki/Meringue
I think the general discourse around high profile account banning raises some interesting questions. I've seen a lot of people in my (generally liberal) social bubble carry the line that Twitter, as a private corporation, has the right to ban accounts for whatever reason they see fit. While technically this is true, should it be? Is there a threshold where a service becomes more of a public good than a private enterprise? I think a lot of us would argue that making ISPs into publicly owned utilities would be beneficial for users.

I think perhaps a legislative approach to monopoly should be nationalizing rather than breaking up. Monopolies can be valuable for consumers if their claws are trimmed.
Yes. IIRC they were going to let him publish the story, he just had to remove everything about Joe Biden, lol.
The letter only mentions Greenwald to appropriately credit his reporting along with hers for the founding basis of The Intercept. Otherwise the mention of his departure from The Intercept is notably absent.
So...what?
Muneeb answered this here: https://forum.stacks.org/t/what-is-the-difference-between-bl...
Not surprising at all. The less rich you are the more you have bigger problems.
> https://github.com/valeriansaliou/sonic

This is actually very interesting project. Do we have some benchmark that sonic works on huge scale with lot of data?
I was in HS from 04-08. I can recall maybe one fight that teachers would break up a year. The people who got in them were not praised as tough guys, but idiots to be mocked.
I'd be interested in better understanding the threat model here - the scenario where it's actually useful.

Call it a failure of imagination, but to me it seems exceedingly unwise for a law abiding civilian to be entering a situation where body armor would be helpful (and I say this as a firearm owner).
I've seen the data being 1:10,000 to 1:20,000 eggs in the US or Europe have salmonella present. The whites are theoretically the safest part.

Immunocompromised individuals may still find these risks unacceptable, and then aquafaba or pasteurization is a great option.
What’s your alternative method to reach a mass audience?
Hand-Picked Kubernetes Jobs
> section off a chunk of desert

Amusing. Why not a section of marsh? Or river delta?

#LizardLivesMatter
"signalling?" It reduces the spread of disease in crowded areas.
Lack of mention of the manner and specific reason for his departure are highly suspicious in and of themselves.
Some observations:

(1) It's interesting how much of the reasoning/argumentation for these restrictive licenses ultimately comes down to a more articulate form of "but that's not fair!". I also wonder how much the implicit beliefs that "unrestrained capitalism is a bad thing", "markets naturally lead towards monopolies", "antitrust law is legitimately necessary", etc are impacting peoples' reasoning here.

(2) If they can't actually compete and provide superior value to whatever managed offering Amazon can scrounge together, that's actually their fault. AWS' managed elasticsearch offering is absolutely terrible, speaking from experience. They block access to important APIs like `reroute`, any minor cluster change results in a whole blue-green deployment which very frequently hits a race condition that prevents the newer cluster from ever coming up healthy, requiring a ticket to be filed that takes multiple days to respond to if you don't have premium support, etc.

So functionally the idea that AWS is going to fleece them because they'll offer a just-as-good service for cheaper has not been the case. Elastic co's managed offering is simply far superior.

---

Ultimately, Elastic has shown that they don't actually want to release FOSS. They want to release proprietary software, and that's why the (in hindsight very easy to foresee) usecase of a cloud provider offering a managed service angers them so much. They don't really breathe the FOSS mindset, because a true non-restrictive license (BSD, Apache 2.0 etc) means that a company can absolutely use your software to make money and that's okay.

Anyway, Elasticsearch is incredible software and the Elastic team has made something truly incredible. I just wish they had a vision for monetization that aligned with their open-source beginnings. It's clear that they don't, and the sooner they stop pretending they're offering a free or open-source solution here, the better.
> Molycorp finally got the process clean enough that even the Sierra Club approved.

Being praised by a big NGO is in no way a marker of being "clean enough". Sierra Club (like Greenpeace) is well-known in ecologist circles to be eco-hostile and business-friendly.
We have been using aquafaba exclusively due to egg issues for myself and our kids. We have found that mileage varies. Try for organic salt free chickpeas... the taste is not as strong and works amazing for pavlova (Australian desert) and merengue. We have also made chocolate mouse with salt free and I would suggest it’s better than egg based mouse. Salted aquafaba we use in cakes. The most interesting thing about aquafaba is how it responds to heat, we think it’s a lot more forgiving than egg. Both have a protein that responds to friction, but heat works differently so you have to realise that cakes and biscuits have a different texture to “normal”, but we have found over time it’s our new normal and we love it. Lastly, my scientist wife just said that egg has many properties that are useful in cooking and aquafaba is certainly exceptional for a few of them, but not all.
How to Train a Scaled-YOLOv4 Object Detection Model