skysight-inc/HackerNews huggingface dataset:
You can only run superficial tests like is not null, is unique, to prevent row duplication in sql join for example, but not much else. You simply don't have enough information about what to test at the stage of the initial ETL/ELT that data engineering is responsible for.

You maintain pipes that can route water, oil or gasoline. You don't want to test for water purity, because next day you are asked to route sewage or oil through your system. You can at best test volume, pressure or velocity in the pipeline because these actually have an impact on your system.

The actual test that business is asking you to put at the "raw data" stage has to come at the application level later on. Eg. when you extract a metric out of the data you can do all kinds of time series tests on it, which will test the pipeline thoroughly.

Testing is what makes data engineering different from software engineering. You don't control the input data and don't want to. You have to make your organization work in such a way that downstream users communicate data issues back to you. You only test the data thoroughly by using it.

If you are a data vendor and your downstream user is a paying customer that you don't want to embarass yourself in front of, you need to invent a use for the data, that you sell, within your org.
So how exactly was it not a problem at Fukushima?
Even surprisingly big names are surprisingly bad at this. Don't know recently, but Hotmail/Outlook used to have a rule of only using letters, numbers, and a handful of symbols, also limiting you to at most 16 characters or something. You couldn't even type a space!
Build Hacker News Clone
A heater that mines Bitcoin
Care to share a few examples? Visiting Japan has been on my list for many years. Still hasn't materialised.
10,000 X

Thank you Richard Heart! You are a legend and a gift to humanity!
Wikipedia doesn’t allow for The Grayzone to be used as citations because it’s pro-authoritarian propaganda that launders the worst takes from dictators around the world. You’ve got Syrian regime apologism, Uyghur genocode denialism, and rampant conspiracism.
You can package that up as “anti-war” if you want, but I think pro-authoritarian is more accurate.
2021-10-08 Nerd Roundup [video]
So many sites require "at least one uppercase letter" and a "special character" and people use the same password for everything.

I wonder how many passwords have the first letter uppercase because that's easy to remember.

And then a trailing "!" because it's the first one you see.

Not that I would ever do that.
Moved from the UK to France after the Brexit vote (the last chance to easily move my family to another country and have my kids grow up as Europeans with the ability to work and live in the EU country of their choice, access low cost or free university education etc.)

I'm a contractor and felt reasonably sure I could find work as an android developer in most large cities - Paris is also close enough that if things really went sideways I could commute to London for work. That turned out to be true, although the rate for developers is a little lower in Paris (and now I work remotely from Paris for a UK company anyway).

Finding an apartment was one of the hardest things, in the end I had to pay someone to find us one. Dealing with all the admin was pretty tough, but visa wise it was straight forward (because it was still within the EU). I hired an accountant to set me up a small business and do the tax work (exactly the same as I had done in London). I also pay another accountant to handle the personal tax (it got complicated for a while because some of my income was UK based and the UK and French financial year is different)

I think I underestimated how much french language skills would help, but also underestimated how much my french would come back to me (I studied french at school as a kid) so it worked out.

It was tough at times but I don't regret it one bit, life is better here in so many ways.

Sitting by the Seine on a summer's evening with friends and a bottle of wine is amazing. Try to do the same in London, you'll be moved on a by a security guard because the Thames river side is all privately owned despite its appearances. That sums up the difference for me, France truly is a republic, and it feels like it.
> they stored all hashes a few hamming distance from the password

This doesn't scale well with password length.
Swiss living in Colombia for a bit over 5 years.

There is not that much of a path or sophisticated plan to it. I was tired of Switzerland/Europe and wanted to try different things for at least a while.

I have travelled Latin America extensively before and had a short list of potential countries/cities. After that it was basically a couple of months for finding a job I'm exited about and winding down obligations and contracts in Switzerland.

So far, and now that I have a residency visa, I don't have any plans leaving, I really like it here. But also not sure whether I will stay forever, some things are quite exhausting. Maybe eventually I will get back to Europe, maybe go somewhere else.

The way I have always seen it is as Terry Pratchett wrote: “Coming back to where you started is not the same as never leaving.”
It may eventually go that way - but I believe the Linux version was the first electron version.

1Password started out as a (well regarded) native Mac app, that they then developed a native Windows app for. By the time they came around to Linux, they decided on Electron (with a rust backend) - they're now moving the Mac and Windows versions to the Electron versions unfortunately.
Pretty sure I've heard "crypto" used a few thousand times as shorthand for "cryptography". And now also for "cryptocurrency".
Related work from over a decade ago: https://graphics.stanford.edu/papers/dual_photography/ ; https://graphics.stanford.edu/papers/dual_photography/DualPh... ; https://www.youtube.com/watch?v=p5_tpq5ejFQ
> I had a comfortable life in India. I was earning enough, I had no struggles and I had my family and a few friends. I don't know what the fuck got into me but here I am

I think you should just go back. I did the same move to NL from a different place. Here's the thing; some things there's no getting used to

1) The weather is absolutely horrendous. If you're used to Indian sun forget it, you will be miserable for big parts of the year.

2) The language: It's just better to be born in NL. English is too comfortable to get by there so you don't invest enough in learning Dutch. I heard stories of people living 20 years there without knowing proper Dutch. Sure you can work on it and it's up to you but it's a struggle that many people lose.

3) The mentality: there will always be some annoying barrier making it extremely difficult to befriends actual locals. The ones who are open to meet you are sadly often times super weird. The "normal" ones don't really need a "weird" immigrant friend it seems. And on top of that they would prefer to speak Dutch after long day's work which makes sense.

4) The taxes: Are simply brutal. The country is amazing so some of the taxes is used wisely, but still. Why do kindergartens cost so much? In Berlin they are free! As a tech worker you are real middle class since it's not a luxurious job in NL (most accountants, lawyers and even school teachers make more or the same as you in NL), you will feel the squeeze a bit.

5) Most tech companies don't offer any shares/options. For such a socialist country this is a head scratcher to me.

6) But mostly dude the weather ...made it unlivable to me and we decided to move back after 3.5 years. Those freaking winds and endless gray skies, I'd cry every time I'd look at the weather forecast.
I suggest you look at it as an adventure, try have some fun and if you discover life in India was actually working out good - just go back. Immigrant life is way way overrated.
I've contributed some lines of code to this project, and thought it might be interesting to some that the library powering the UI is also written by the OP. It's a clever experiment that uses JSX but instead of VDOM diffing it embeds observables directly into the DOM.

Harmaja (https://github.com/raimohanska/harmaja)
Clarify the problem that Fukushima faced with regards to nuclear waste. Because as far as I know, the main issue was that the backup generators running the cooling pumps for some of the cores were inundated as a result of the tsunami that the outdated facility was not designed to handle.. it had nothing to do with waste storage.
That's the point. What you're saying is like complaining that your toaster made your bread crispier.
Left Australia in 2012, moved to Indiana for a job at IU. I had been stuck in yearly contracts at my Australian employer, and they were allergic to full time offers.

I really didn't think things through very much. Turns out starting life again with nothing but a bag of clothes is pretty hard. Met my now wife, who helped me buy things for my apartment (cutlery, dishes, furniture lol). Not having a car, drivers license, or social security number were pretty rough impediments to start with.

I got a great job in Boston, lived there for a few years, then moved back to Indiana when we were ready to buy a house and start a family (much more affordable). Been working remotely since before the pandemic.

I love living here. I do miss my friends back in Aus, but I could never afford this quality of life. My kids will be dual citizens, so if they manage to hit it out of the park salary wise they could always head back if they wanted.
For me, material design evokes feelings of being in kindergarten making crafts with colored construction paper.

Material UIs are not perfectly flat; there is usually a shadow, so I can tell an element is distinct from the layer below it. The problem for me is that it often feels about as organized as the mind of a kindergartener.

Consistency of look-and-feel is important, but consistency of organization is even more important. How confusing would GUIs in the 90s have been without the File and Edit menus?
I think it's unacceptable that I immediately get shunted to a login page. You're assuming people want to join before they've had a chance to look around. You don't even have an about page, do you?
This has been my observation as well. Such companies pat themselves on the back for hiring a diverse group who actually think the same _despite_ coming from different backgrounds or have different skin color.
Lol. Rotten teeth was him referring to russian neo nazis. Do you even know Russian?
That’s still quite expensive, you start off with a useful fuel and then spend more money turning that into hydrogen while losing energy.

In theory hitting ~60% energy efficiency on solar power could be cheaper than fossil fuels. But hydrogen is a long way from that benchmark.
You missed a couple of steps.

> Then you die

> The bank takes your shares to pay your debt

> The IRS taxes this against your estate as income

> The entire value of your estate is taxed for any capital gains at the “fair market value” of all your assets at the time of your death

> and then that's it.
I was convinced that this already existed in the form of masked inputs, but after trying I realised those are broken in mobile Chromium and utterly unusable in mobile Firefox. As far as native components go, I think most platforms actually have a prebuilt control for this that works pretty well in my experience.

You'll probably need to do more than just strip dashes, though. You also need to strip spaces and parenthesis but keep other characters such as + and ~. Many prebuilt phone number input boxes have trouble with even normal American phone numbers, let alone foreign phone number systems. Even if you're only targeting American customers, you'll probably need to support the phone number format for a visiting foreigner as well.

With something as complex as phone numbers I'd just stick to using standard form validation code (like in the HTML standard) to warn users of explicitly invalid input like letters or most special characters and storing phone numbers as a 20 character random text strings for all other purposes. Phone numbers are like time zones, you'd think they're easy to deal with but they're surprisingly finicky to get right.
Terminating the local loop pairs takes up a huge amount of space, and there's still a lot of copper out there alongside the fibre
In order to replace natural gas with 100% hydrogen the entire transmission and distribution network would need to be replaced as it needs to run at different pressures. In the UK we are starting to trial blended gas. I do not think we can afford the cost to go full hydrogen yet.
Long term storage represents less than 1% of total waste, the rest is reprocessed. I can’t remember the exact figure, but the “dangerous” waste for the whole of France is something like 10 tons a year - not a big logistical issue
Is Java really faster than Electron? I wouldn’t have guessed that, but if it’s true: Hey, cool!
What’s jarring is that a field for phone numbers can’t parse dashes and spaces.
Chances are it’s because people would panic and start drama because for instance their video conference app used the camera.
I moved from Argentina to the Netherlands in 2017. I wanted to experience living in a safe, stable and low-burocracy country. Turns out The Netherlands is much more and I've been here for more than 4 years already.
As a big fan of bikes, learning about bike centric cities... I don't know where else I could go now. Living surrounded by cars is terrible.
> It's forked language that already has some substantial differences and will keep diverging.

This is really about opinion and individual assessment. It depends on how much emphasis one assigns to surface syntax vs deep language features.

Yes, the surface syntax of Rescript has been cleaned up a bit. There are some new language features but the language is still "close" to OCaml/ReasonML as of end 2021 according to me. If you're able to understand OCaml/ReasonML today you won't have much problem reading Rescript.

But, yes, it is diverging and it could look very different in the coming years.
I'll provide my own anecdote - I was a part of a team that ended up choosing a document-store for a small service that services ~500 users (total, concurrent figure is far lower), where writes are uncommon, and where we ended up building ourselves all the tooling that common SQL tools offer for free. Why? Because people think RDBMS are dead. No matter how much I tried explaining it was the wrong choice - we still went for it.
Fukushima was hardly an accident, it was a tsunami that killed a thousand times more people than the ensuing nuclear power plant leak ever did
Not a fan of nuclear power, but changed my opinion because climate change is a bigger and harder to handle problem.

"Solved Problem" however isn't a thing I like to hear in this context. Solvable problem, sure, managable risk, yes. But solved problem is strong wording for waste, which you have to keep safe for roughly 4 times the age of the oldest democratic country.

Nuclear powers biggest problem is the price in the one hand, and bombs on the other hand. Nuclear bombs are bad halo product for a technology, nobody associates good stuff with doomsday machines.
It's not small, it's zero or even negative. If you already have everything you want, buying more is just extra crap you have to deal with.
i appreciate your feedback. i will answer your questions, but is short on time right now. thank you.
Moved twice - once to the USA, 30 years ago, from Eastern Europe. US is a perfect place to make [more than enough] money (and enjoy some, when not at/with/connected to work), while strong / well fit educationally, psychologically and physically, in a country where jungle capitalism shrunk social safety to nothingness. So make sure you don't need it.

After 30 yrs moved out of the USA, to France, to enjoy the financial fruits of my labor in probably one of the best-to-enjoy-life-at-its-fullest places on earth. Planning to stay here until the end.
I think that's just the good old ambiguity of the English language, I read it as: western civilization being oddly similar to Japanese civilisation (I'm a British native, but I don't claim to be any kind of arbiter of the English language!)
I moved recently to netherlands and a lot of your experience mirrors with mine, but thankfully i have been able to make some connections by joining different activities like gym, kick boxing, soccer etc.

I think if your are earning well enough in India, it's always going to be more comfortable than here but that doesn't mean one shouldn't get out of one's comfort zone and travel.

It's okay to go and work outside, gain some experience and then later on return if you don't end up liking it.
I don’t think it’s due to conservatism or liberalism really, more that the roots of the Green movement (at least in Europe) are in the anti-nuclear weapon movements of the 70s. They were never able to shake off the general aversion to anything nuclear
Sweden -> Denmark

Denmark -> Sweden

Sweden -> Malta (2 kids, stayed only 4 months in Malta)

Malta -> Bolivia (stayed 2 years)

Bolivia -> Sweden (bought a house and finally we will settle)

Sweden -> Spain (with 3 kids, got an offer I could not refuse)

Spain -> Sweden (in year 2023, hope this will be the final)

Some pain points: changing schools for the kids, learning new languages, residency and citizenship, paperwork, selling and buying house, transporting 98 boxes of stuff, having friends and relatives spread around the globe etc

My wife is from Bolivia and there I learned spanish. I like to live in all 3 countries (spain, sweden, bolivia) - they all have their pros and cons. We have kept our house in Bolivia and we will also keep our house in Spain when we move back to Sweden.

Important question: has this been a net positive for our 3 kids? I think yes. They speak 3 languages and have seen the world and lived in different cultures more than most other kids.
Funny, I live in Austria and I wish to emigrate to the US. I consider Europe, and Austria in particular a living nightmare.
I immigrated to the Netherlands for 3.5 years and came back. I really recommend immigration as an experience as it's real character building and gives you so much perspective on life and on your home country.
I realized my close family and culture were more important than I thought and I moved back. Also there are some genuine annoying things about being an immigrant - like the fact you will be seen as an immigrant :) I just didn't like it too much. My homecountry still has water running down the pipes and the supermarkets have food - I found out it's not such a terrible place and every place has problems, even the Netherlands.
> was that some of the documents were altered from the originals and so they were “mostly real” but did have fake things in them.

Source?

> historically irresponsible with how they have released information and it likely got innocent people killed or put in jail.

Wasn’t that the media essentially leaking the keys?
Hashing takes a lot of CPU time. And btw you don't even need to change the database schema. You could encode the version in the password field itself. Django does this and it works great
Many countries have reprocessed waste, but only France has really closed the fuel cycle.

Doing that requires fabricating new fuel elements and with oxide fuels that means making ‘mixed oxide’ of plutonium and uranium oxides.

The established process for that involves grinding the two oxides in a ‘high energy ball mill’ which makes nano particles. The HEBM can turn a harmless material like silica into deadly (wreck your lungs) dust and just imagine what it can do with plutonium.

I think in France they have the workers wear respirators 100% of the time at the fuel fab, but in most countries that is not acceptable —- the dust is easy to detect so whatever real danger there is or isn’t people are going to worry about it. The factory that Karen Silkwood worked at had that problem, the U.S. recently failed to build a MOX plant, the U.K. built one that failed because the fuel was not homogenous enough to be usable.

There are other ways you can make fuel, so as coprecipitation, metal fuel, molten salt fuel, but for most of the world it is not a solved problem.
Why? It could be it just doesn't suit your personality. If you a 'rise and grind' type of person, I can see it being hell.
I did not see it either

Even though I put HN at 120% font size

At least the github page heading has a large enough font size to see it
Not true in the US where asset values are ‘stepped-up’ when passing to heirs avoiding all tax on gains.
The waste was stored in the reactor room and greatly complicated cleanup as far as I know.
I'm from Canada and have been a full time expat since I'm 19 (32 now). I've lived in Hong Kong, China, USA, Dominican Republic and now Turkey. I never really planned anything, I just visited places and eventually decided to stay longer than expected. I'm lucky that I can work from home and made some lucky investments. For me, the most difficult is dealing with bureaucracy like getting visas and bank accounts. Another difficult part is not having many close friends nor many people I can relate to. I also sometimes envy people who identify to a culture and have their important life choices made for them. I have a lot of analysis paralysis / paradox of choice regarding that. But overall, I'm very happy with my trajectory.
Similar or arguably higher levels of development, very different culture though.
While I'm personally pro-nuclear, I think grouping them up with anti-vaxxers is kind of absurd. There are proven historical risks to commercialized nuclear power that aren't just fantasies made up by Wakefield.
GiveCampus (YC S15) Is Hiring Software Engineers who care about education
Toaster won't do anything without your initiation
That's nice; the last time I had to export I had to write mouse movement macros to get my passwords out of the keychain. (10.14 maybe?)
I've been using Hibernate for 17 years and never had any performance issue with it.

Want to know my secret? It's very simple. I just read the manual in 2004.

After using it successfully for so long, I wrote a best-seller about how to get the most out of it:

https://www.amazon.com/High-Performance-Java-Persistence-Vla...

And, just because afterward I even worked on Hibernate to add all sorts of performance improvements to it, it doesn't mean I don't love SQL. In fact, I happen to run a High-Performance SQL training too:

https://vladmihalcea.com/trainings/high-performance-sql/

Your comment is based on a very common misconception that Hibernate aims to replace SQL. If that were true, then why do you think Hibernate has been offering the createSQLQuery (a.k.a. createNativeQuery) since 2002?
This doesn’t seem particularly alarming. Googles account security is above and beyond the rest of the web right now. I doubt a single attack has been made realistic by this feature.
At least it can be stored, unlike the gasses that escape into the atmosphere.
Is there a demo showing Ć code and output generated for other languages?
This is like when on a cli application -h displays a hint that you probably meant --help (or the other way around). If you already know someone wants to display the help, why not just display it?
I built a modern website in 2021 – Kent C. Dodds
If I Google “Poland lgbt law repeal eu money” the first link is https://www.npr.org/2021/09/28/1041112133/poland-anti-lgbt-r...
Large amounts of whitespace became vogue around the same time as skinny scrollbars. I don't mind the whitespace -- it makes it easier to see how things are grouped on the screen. But give me back usable scrollbars on non-touch devices, please! As I age I find it harder and harder to see and click on small things, so these newfangled design languages that make UI elements smaller feel very unaccessible.
I've seen some NoSQL object/schemaless database turn into intractable balls of mud over time. Things that would be trivial in a relational DB with joins can turn into major engineering efforts and data corruption can be very hard to clean up.
A THOUSAND years is a solved problem? Fuck off.