skysight-inc/HackerNews huggingface dataset:
They aren't synonyms but they sometimes overlap.

- data engineering involves more work on data transformation and developing different pipelines

- data engineering requires more knowledge of databases, cloud environments or different streaming tools (it gets close to being a backend developer in some places)

- data engineering doesn't involve any statistical modeling, data science does

- data science is a broader term - depending on the company a data scientist might be doing all the data engineering work (if it isn't too much) + the model work and statistics. Or they might be focused entirely on research, statistics and ML models
They were incubated by YC, presumably that's how the connections were made.
Common sense is usually wrong WRT statistics.
Please don't fret. I can't be specific, but I have worked with a wildly successful engineer that wrote "bad code" and knew it, but came up with some useful paradigm-shifting ideas in their space. I would be glad to chat more if you are interested. Don't give up.
Don’t put your words in my mouth, please.

I said substantial. As in “weighty, solid, meaningful”.
I think one of the comments said vulgar and predatory. I second this. You don't need a bootcamp to break into Data Science, or Data Engineering, or Data anything.
They also bought Pentaho, an ETL tool, in 2015: https://www.hitachivantara.com/en-us/newsroom-hvtv/in-the-pr...
India's largest ecommerce store, Flipkart, started accepting Bitcoin
How sophisticated are investors in general with niche or arcane technology segments that might not be widely understood? Do they know enough to tell if your product solves specific problems, or are they trusting your market validation?

If it was an 'intense 2 weeks' what compromised the back and forth intensity? Negotiation, waiting/anxiety? Were there any big surprises during raising or do they 'like it or not'?
The stregth of TF is the community and quality of docs. I use providers to manage an infra that is a mix of AWS + Heroku + external services like Rollbar and that just comes easy with TF. The point of it being paid (although I don't use any of their paid services), is that it is their core business and they are forced to continuously improve on it. TF 5 years ago sucked, but TF in 2021 is super smooth.
NASA Is the Latest to Offend China by Calling Taiwan a Country
and there's also a general election coming in 2022, with lots of news about funds sent to different states for hospitals and ventilators "disappearing".
Not much, really. Yet somehow those little things add up to something... faster :) Basically "just":

- not having to append `| head -n $ROWS` or something similar on every command (yet having the view as-if-you-typed-it, but at the same time being able to scroll down further through the results; and having them visible as you continue tweaking, unlike `less` which you have to quit to tweak the pipeline),

- not having to press up-arrow-key, then alt-b / alt-f to a position in the pipeline you want to tweak after every Enter (e.g. just before the `| head...`, but sometimes a bit more back),

- sometimes also not having to dump the initial input from a command into a file, and to wait until it's finished, but being able to immediately start filtering even while the input is still being generated.

Once I just had those ideas, I felt pain every time I repeated the dance, enough that it made me push on up even when I was super tired of working on it. The pain of not having it when I know it could exist was even bigger.
> Mathematics is a part of physics.

It's probably treading close to the don't be dismissive rule, but I confess it's really hard to keep reading when the piece opens with something so obviously wrong.
Show HN: Windroses of Historic Wind Data
> Only if you have the newer Cloud Key

that would explain it then.
There are great apps for current winds and short-term wind predictions. But I didn't find anything to show historic wind data (e.g. when planning a sailing holiday). So I made this app.
most of the time I need to read it, I use the PDF generation. It turns all the ascii into math symbols. way easier to read
The contrast between the product name and the product content is just excellent.
Good to know, thanks. I had bunch of Ruckus Zoneflex APs that I could not upgrade w/o contract.
Did you miss this on the main page?

> We are missing Rust support in our GN toolchain so we currently build the Rust libraries as a staticlib and link in C++.
The music industry is much worse in my opinion. If you spend half your life learning to program so you can make games, you can always give up at 38 and start working on boring enterprise software.

If You're a 38-year-old self-taught musician you can't exactly walk into a company and get a job.

I still make music as one of my main hobbies, but I've accepted that no one will ever know who I am, and I'll never make a single cent. There's nothing in the world like making a song for your friends though.
It was a static site. That's what Vercel and Next.js does by default. If you don't use `getServerSideProps`, Next.js will generate static pages at build time and Vercel will serve them from their CDN.
Yeah, I've honestly gotten to the point where I'm not surprised by anything anymore and can't tell truth from fiction.

Another fun one is the use of Ethylene Oxide to sterilize the swabs. It is a carcinogen but it seems like it's is used in many places.

It was just funny that I stumbled on the ethylene and worm thing _after_ I got my test today.
As a bad engineer who switched to PM 20 years ago, here are some thoughts:
- do you have a high tolerance for bullshit and stress? you will get more BS and stress in a PM role
- are you good at persuasion or want to develop that? As a PM or a leader, persuading people is going to be your primary skill
- do like understanding systems and ecosystems? You still need to be able to understand systems and how to change them (either technical systems or organizations and how they make decisions)
- can you explain complex topics concisely and accurately?
- can you explain abstract (desired future state) concepts to other engineers in a way that they can understand?

Hopefully these questions will help you decide if PMing is in your future.
The mind finishes maturing at the age of 25. The medical evidence for that is pretty much established, and is why a lot of researchers want to (at minimum) abolish the death sentence for anyone younger. It is quite questionable if one should hold people responsible for behavior before their mind has finished developing.

A similar argument could be made about driving. At the age of 16, the impulse control is severely underdeveloped, likely by evolutionary benefits. New experiences invoke a much stronger endocrine response than for fully matured individuals, and with faster depletion rate. A driving license should really be around age 20+ if one would follow mental maturity. Sweden have set it to 18.

We have so many different age lines. Driving, drinking, military service, voting, consent, crime, legal responsibility. 25 would be a great line for it all based on medical data. In Sweden we expect young people to have the mind around 15 to start having sex with each other, but we don't trust that they have the mental capacity to drive before 18. Is the numbers that the US use better? Worse? Is the answer political? I would say yes.
I admire the reach of "Two Minute Papers", but that guy has got to stop calling everything an AI for the sake of YouTube views.
Thanks! I completely glossed over the IPv6 thing... At home I don't get native IPv6 from my ISP, so I just tend to forget about that. Although it would be neat.

For me I bought my AP on eBay and just plopped the standalone Unleashed firmware on it and that's all seemed fine. In what I see there's nothing changing? But it sounds like you're running a /much/ larger install.
I'm getting tired of these lynchmobs. An opinion screamed out on Twitter is not important and should be dismissed. Neither Twitter or HN is the place to decide for or against or dig around someone's life. The FSF's board is where this belongs. It disgusts me that HN is as bad as Reddit and Facebook and I'm extremely disappointed.

How would you feel if this where about you? HN is usually better than this.
You are Going on a Quest: Four engineering leadership paths
> TOR is explicitly not private, only anonymous

It depends on how you use Tor. For example, visiting your own personal homepage and then using the same relay to visit a NSFW site would be bad OPSEC. Also, Tor comes pre-installed with HTTPS Everywhere, and you can toggle a setting that disables all http traffic if you're worried about sketchy exit nodes analyzing your plaintext traffic.

Remember: Tor can't read your mind. If you want true anonymity you have to go through extraordinary lengths to achieve it, and even then, you could make mistakes.
Using Arc to decode Venter's DNA watermark (2010)
I really liked the definition of AI (back in 2015) by Seth Godin - a marketer!

>One common insightful definition of AI: Artificial Intelligence is everything a computer can't do yet. As soon as it can, we call it obvious.

If the term is used like that it does make sense to me.

https://seths.blog/2015/04/the-noise-in-our-head-and-artific...
I guess when we understand how the brain works, we'll be able to answer this.
For me, the most illustrative aspect of the Dao was the hard fork that happened afterwards. For all the talk of smart contracts, the mess was eventually fixed by a small cadre of miners and Ethereum developers who agreed to a hard fork.
On iOS. Initially used reader mode, but switched because it seemed cut off.

But also without reader mode I can’t see more than the NHS anecdote.
First off: thanks a lot for the extra info/context, as it gives me (and others) things to also consider that I hadn't - I appreciate it, as I'm sure others do.

As I eluded to earlier, I'm not considering doing anything 'high risk' for myself; this has been more of a thought exercise for me of scenarios to consider - like some random benign post of mine somewhere being totally misinterpreted and leading to a small hoard of trolls trying to be a nuisance.

Essentially, exploring the best ways and solutions to try to mitigate any chances of being doxxed (which I realized I should have also stated in my original post).

Thanks again.
Maybe so, but “someone will come up with a good application for them” sure makes them sound like a solution in search of a problem.
When I listen to marketers and journalists I always assume AI means "Algorithm" and Blockchain means "Decentralised"
>Why try all these convoluted schemes, instead of giving a straightforward way for people to tip?

>They had 50 million views. If 0.01% of these visitors left a dollar, the author would've still come up way ahead over all the crazy schemes, even post-tax.

Currently ads are the easiest way to monetize a not-well-known web property in the short-term. Long-term you can build a brand/trust/community/etc and leverage that into patreon/donations.
The Curious Case of Qualcomm’s Rumoured Nintendo Switch Clone
I think it’s producing plenty, but it will never live up to the hype of singularity-enabling Asimov-style superior super-intelligences that are being promised regularly to be just around the corner.
I work at a medical practice. I’ve seen more than one kid run up to a hand sanitizer and do something that blasts it in their eyes.

It’s instant chaos with screaming and yelling from the kid and a frantic search for a bathroom from the parents.

So maybe a taste that ain’t completely awful would be an improvement.
So, a couple months ago, I started using a site for a game I play that provides maps, info on items in the game, current prices for the global market that players can trade on, etc. You can link it to your Patreon account, and if you're a patron for $5/mo, the site gives you historical data on the market, and a few other useful features for the game. There's also a Discord for updates, features requests, general dev stuff, etc, and that's gated (or some channels are at least) behind Patreon as well because Patreon integrates well with Discord, so support and feature requests (through Discord) come from subscribers that are paying.

I mention this because at the current moment, he has 4,757 patrons, and that $5/mo is the only official tier offered. That's $19k/mo, minus Patreon fees. This is the first time I've used a Patreon subscription to power a site account, which I wasn't aware could be done (I subscribe to a few web authors though, so I'm not new to Patreon). I think this is a really interesting way to provide gated site access, and it's fairly low fiction for a lot of people, because they either already use Patreon, or have at least heard of it so it's not some random site charging you or that you are paying. There's lots of benefits I see to this model, and I think if I have a project that fits it in the near future I'll try it myself. Maybe it's something that would work for you (you'd have to set the monthly price at something you think appropriate). $1 from 100 people would get you that $1000 in less than a year, and you might also get better targeted info on what features the people that are willing to pay think are more important.

I agree asking for donations doesn't work. I don't like donating like that. I am willing to allocate a bit of monthly money to people if I feel like I'm getting something worthwhile in return though (it's a limited amount, I try to keep total Patreon expenditure at or below ~$50/mo).
WebSockets are actually already supported! See the "Can Durable Objects serve WebSockets?" section from the closed beta announcement last fall: https://blog.cloudflare.com/introducing-workers-durable-obje...
How can there be scarcity when anyone can copy the digital files infinitely without permission?

The whole point of artificial scarcity is that something can control and prevent the replication, otherwise it's not scarce.
I have no opinion on this, but a data point:

I had been sticking with an old USB wireless headset for a long time because it Just Worked (tm), but even with a new battery the life wasn't really up to the modern work from home. So I chanced it with a bluetooth noise cancelling headset.

My first experience using bluetooth under Linux in probably a decade. It has been super reliable. I used the CLI tools "bluetooth_ctl", I didn't have a button to click in my i3 setup.

Not saying this rewrite isn't needed, to be clear. But I've been surprised how reliable it's been.
Do you have better data sources that you're not sharing or are you just making things up and asserting it as fact?
Cells Form into ‘Xenobots’ on Their Own
This is a great question. What is the cost/benefit to the mission of the FSF of keeping RMS in a leadership position? I guess this depends on the stated mission of the FSF. If its evangelizing for software freedom then RMS himself is too much of the story to do that effectively anymore I think. If its to promote RMS and give him a platform then he must stay. If its to do practical organizational work to support free software projects then RMS is easily replacable. If its to write free software the last I checked RMS really hasn't contributed much in the way of code in years.
Show HN: Hacker News Daily
A data project without code is extremely difficult to evaluate.

I haven't hired data scientists but I've worked with them, and the best I've seen by far are the ones who can write well engineered code and who know how to use source control and unit tests.

My personal opinion is that I want software engineers with good data skills, not expert data people who are terrible at the engineering part.

After all, ever experienced data scientist will tell you that 90% of the work is building pipelines and cleaning data.
I tried convincing the business developers and marketing for years that what we did was machine learning, applied statistics or gulp “data-driven” functionality - but no, only thing that worked was “<Company> AI Engine”... hurray for throwing my PhD at the wind...
Agreed. I’ve worked with and hired boot camp, masters program, and traditionally educated data scientists. Insight is the only non-traditional program that’s positively correlated with performance. It seems to (a) screen tolerably well, and (b) do a good job of helping the demographic of “quantitative and technical PhD but no industry exposure” translate the skills and background well enough to speak the same language we do.
True, I bought it because of the 10gb ethernet and youtubers recommending it. I didn't realize it was also a router with a 45 dollar license key.
https://mikrotik.com/software
Except... it all was a marketing issue.

Development continues, and having a stable API for plugins can be considered a feature.

Let's see what will they do in the future. Both ST developers and plugin developers.
Psst, hey, XMPP isn't quite dead yet! Some of us never stopped working on it. Come help bring it back into the hype!
Intel 960 graphic card here. XWayland. KDE. BTW, I meant encrypted swap->LUKS->LVM->md3->hds1
Thanks, that clarified it.

Do you know how people typically get into that role?
Ask HN: How have you cured your RSI?
Currently suffering from RSI, more specifically numbness and tinging on the ulnar side of both hands and wrists. After countless doctor's visits and imaging (x-ray, MRI) along with occupational hand therapy, nothing seems to work. It's gotten a bit better over the course of 18 months, but I'm still unable to comfortably type, use a smartphone, or perform many other daily chores. If anyone else has been in the same boat, any help? Thank you!
"When reading a text about AI, replace AI with matrix multiplication, it will make much more sense"
Java still rocks the finance industry. Here’s why Java 16 makes it even better
I think you're right, they're pretty wishy-washy, but I'd define data engineer as someone who builds systems that make quilty, useable data available (i.e. anything from building ETL pipelines to productionizing models), vs a "data scientist" which I'd probably describe as doing more one-off in-house research type work.

I suspect a lot of "data scientists" end up being "people who write tableau reports for other people" and/or "people who manage an ugly pile of python data processing scripts to make the data-spice flow"

In my experience the plumbing is a lot more work [requires more man-hours] than the interesting visualizations, and I think some organizations do a good job of supporting a few scientists with a robust engineering staff, while others hire the scientists because they want the fruit, but forgot to plant the fruit tree.
Even if you filter out the merge commits, then you're hiding some of the changes made when you look at the history of the branch. The other problem is that if you run git blame on a file and the line is referenced by one of those merge commits, then the commit message is next to useless. Those looking at the history want to know why that line is there (changed from a previous version or added). A commit message that explains the reason and allows you to see that line in a context of a logical change makes it much easier to determine whether the change you're planning to make will introduce a regression or lead to some other issue. A merge commit message with a mixture of changes that may pertain to any number of commits in the branch doesn't help and makes it harder to figure out what the change was.
The ontological argument is a priori reasoning while most intelligence explosion arguments use a posteriori reasoning. An a priori intelligence explosion argument would be limited to something like "the universe is likely infinite and varied, so somewhere within its history is a superintelligent machine". The trends suggest increasing machine intelligence and barring worldwide catastrophe I expect this to keep happening until the threshold of superhuman intelligence is crossed. Any argument against superintelligence is an argument against the current economic, political, and technological status quo since there are no strong arguments for why human intelligence is a universal limit.

The IQ or intelligence boosting argument ignores the ability of machines to directly manipulate either its own or other machine's intelligence. Einstein and Newton couldn't directly alter their own or other's neural structures in any beneficial way (even as simple as adding more neurons), and it wasn't even their area of expertise. An artificial intelligence that is as smart as a human expert in artificial intelligence is far more likely to be able to create a more intelligent machine directly.

The last argument that society or technology as a whole is where improvements occur is right in a sense. The system as a whole is what matters for the growth of intelligence and superintelligence, but within the system we care a lot about the place of humans. The trend is for humans to remain at roughly the same intelligence and for machine intelligence to surpass us (soon). The transition is worth getting right.
> If someone asked you to pick your favourite three...?

HyperRogue, Hollow Knight, and LOGistICAL.
> harder to fake

Also harder to take.
Reminds me when X-rays first were discovered, everyone claimed their product contained them, including X-ray headache tablets, golf balls, stove polish, razor blades. https://pubs.rsna.org/doi/full/10.1148/rg.242035157 for some fun pictures.

I won't be surprised when AI toothbrushes come out.
The motivations seem so confusing. It says this doctor sacrificed his reputation by providing fake fentanyl prescriptions for $33k/yr. Most physicians make 10x that. Really strange.
Agreed, I don’t think one should try to prove the supernatural starting from the Bible.

One first has to define supernatural :)

My general thought is that at the deepest possible metaphysical level, everyone has a foundational framework that realize on untestable axioms. (Eg. we have free will)

Identifying those is an interesting exercise, but then at some point I realize that at all levels of natural depth, the universe has extreme order and intelligibility. Eg. The simulation argument is a reframing of the creation arguments.

From that point, one can surmise that some creator would be intelligible, and would likely communicate with beings that have free will. Eg. humans are a cloud of hydrocarbon atoms that contemplate their own existence.

The rest then follows, and so on
Start making money off of that and Disney will come knocking.
The power plant operators do not agree, currently. the energy storage margin is thin and li-ion lifetime too short already... if you refer to grid scale. Look at the APS battery 'event' and the hazard to emergency response personnel batteries pose as a grid asset. Some form of home hybrid using recycled batteries may work, but the safety expertise and market payback don't work except at the DIY scale... Maybe it's a biz opportunity.
If the US China tech war would escalate further. And China prevents American chip companies such as Qualcomm and Apple from selling into the Chinese market, there would be a huge opportunity for fabs not using American "stuff".
Ok, yeah, thank you. At this point I can't tell sarcasm from satire from honesty.

Edit: I now again have no idea if they are or not. Looking at their comment history it doesn't appear they are.