skysight-inc/HackerNews huggingface dataset:
I really agree with Shift 2 (“We unblock analysts” to “We enable everyone”). The problem is that Airflow (and most other OSS orchestrators) are overkill for the majority of data practitioners. They lock workflow development into Python, forcing you to mix platform logic with executional business logic. The complexity to get started building workflows is too high, infrastructure challenges always crop up, and the system itself is a black box for anyone non-technical.

> The tool data engineers need to be effective in this new world does not run scripts, it organizes systems.
100%. You'll still need to run independent scripts, but today's data challenges focus on "how do I connect the stages of data operations together". Teams need to figure out how to connect data ingestion -> data transformation -> data visualization -> alerting and reporting -> ML model deployment -> metadata + catalogs -> data augmentation -> API actions.

The larger goal of orchestration is to prevent downstream processes from running if the data being processed upstream fails. Each stage could be performed with a series of scripts, a SaaS tool, or a mix. Each team is responsible for their own stages, but they need to know how their work connects to the larger picture so when something goes wrong, there's ownership and clarity that drives a quick resolution. Unfortunately, this still doesn't exist in most organizations because the current tooling isn't solving the orchestration and visualization of connected systems super effectively. It's instead enabling one-off, disconnected data processes.

Disclaimer: I built Shipyard (www.shipyardapp.com) to address many of these concerns of simplifying the ability to connect data tools and quickly automate and action on data.
Shortwave radio can be transmitted around the curve of Earth by ionospheric reflection and refraction so fewer repeaters are needed. This allows crossing vast oceans where microwave infrastructure might not be possible.

As you say the downside is available bandwidth and throughput.
Digital exploitation is real and often forgotten about.

I have a friend in Ghana who was offered - by a UK company who are a Google Cloud partner - £1/hour to do work for them as a junior DevOps engineer.

Yes, £1/hour. Before he had to pay taxes.
"But underneath that is profound loneliness – the kind only a genius in a world full of idiots could possibly understand."
Are you mind-reading loneliness into Scott(he has never said he's lonely)?
Btw the edgy cartoons are the funny ones. Are we not allowed to talk about the new vectors people take advantage of in the new system? That in and of itself seems like a vector(create a problem people aren't allowed to talk about).
Statements like this are common on the websites of British companies. There are regulatory and reporting requirements related to the Modern Slavery Act 2015 [0] although I'm not sure of the precise details; something to do with auditing your supply chains maybe? As you've pointed out, it can be a bit farcical for companies in certain industries to make these kind of statements, but the law is what it is.

[0] https://en.wikipedia.org/wiki/Modern_Slavery_Act_2015
As tech workers it's not always obvious that there's a wide range of people that any sufficiently large business will have contractual dealings with, be it cleaners, construction workers, painters and decorators, or retail staff. In low skilled labour jobs especially there is a risk of exploiting trafficked or enslaved workers unless due diligence is undertaken.
they didnt until 2 weeks ago. turns out dems really dont want to say the R word before the november election
It's a requirement under UK law. They have retail operations (as stated in the disclosure) and a large number of suppliers in a wide variety of countries. I agree that they are fairly low risk on average but some of those vendors will be in high risk sectors.
> being from Turkey [...] and being on the free tier

I mean, I don't want to put words in your mouth, I assume this wasn't the tone you were aiming for, but this sounds a little like you think that's okay. Which, to be clear, it absolutely isn't.
I am getting my information from experience from people who are hiring in the bottom 3 income deciles or so.

Certainly not academic, but I also do not think national statistics captures the entire picture. The nominal wage is also not the entire wage, as quality of life at work can be going up which is also a type of wage.

People can be earning $40k per year, but having to do less work in prior years, for example. Or no longer having to work weekends or evenings or nights.

Either way, the desirable changes for labor sellers would be a reflection of the change in labor supply v labor demand.
Ford is surely aware of all the speeding accidents, yet keeps profiting from high horsepower car/truck sales.
54. Understand that your target market may change. Think legacy. My father at 72 was contacted about a system he was an intern on in 1967 because he was the only one left alive from when the system was built.

Plenty of legacy stuff from the 4gl craze of the 90s and 00s is aging out rapidly. Power Builder, Cold Fusion, Dbase/Clipper, Delphi, Java apps and many more will need to be updated or migrated to newer tech stacks in the coming decades.
I think all UK companies of a certain size need to publish something like this. E.g. "Dyson" was the first UK-based company that popped into my head, and I found this: https://www.dyson.com/inside-dyson/terms/modern-slavery-stat...

Is there something particular about this one of note?
You may not know very precisely the time constants you are dealing with in your problem until you give it a shot.
I mean, assuming that Adams doesn't do his own coloring, I bet it's just that whoever colors the comics forgot the character was Black. As the article notes, it's literally the first Black character in the strip, and they had been absent for a bit, so it's likely an easy thing to forget.
There are combinations of ATX motherboards and CPUs that idle at around 30 W.

However, the easiest way to have low idle power is to use a NUC-like computer.

Many models consume between 5 W and 10 W during light load at the wall plug, while those with the highest power consumption use between 10 W and 15 W at the wall plug, during light load.

The fastest SBCs with ARM cores that can be found at a reasonable price are comparable in speed with Intel Jasper Lake, but Raspberry Pi uses obsolete Cortex-A72 cores, which are 2 to 3 times slower.

Even a 7-year old NUC-like computer from Intel/Gigabyte/Zotac etc., with a "Core" CPU, e.g. a Skylake U, is much faster than anything with Jasper Lake or with Cortex-A76 or older ARM cores.

While a new NUC-like computer is more expensive, an old one might be as cheap as a Raspberry Pi, while being much faster.

During the last 20 years, I had a permanently active 24x7 server, which hosts a large number of services, e.g. firewall, router, NTP server, DNS server, DNS proxy and cache, e-mail server, Web server, Web proxy and cache, file server, etc.

The first server which did all that used the fastest Pentium 4 and it had an average power consumption of over 200 W. The current hardware of the server is the 5th version since the beginning. At each upgrade, the average power consumption has been cut into half. The current server consumes around 10 W and it uses an Intel NUC with a Coffee Lake U CPU, together with 4 USB to Ethernet adapters, to provide 5 Ethernet ports.

I have experimented with various ARM-based SBCs, but when old NUCs are available, repurposing them is a higher-performance solution.
I think dBase II can do that.
Their free tier is 10 TB of outbound traffic. Hard to reach.
A few months ago, I was looking to buy a new ford vehicle. Not saying the name - I am still too annoyed to advertise for them.

A lot of people wanted this, so dealers in my local area were marking up and adding dealer fees WAAAAAAAY in excess of MSRP. We aren't talking 2-3k we are talking 10-20k. When I pushed back, the dealer was happy for me to walk as there was a line of people wanting it after me.

My wife and I have only owned ford vehicles. Bought my first Toyota. I won't be back.
I still work on some old sites / code that uses tables.

I LOATH tables. Flexbox is so much easier.
Polygon’s Computer Lab week: Looking back on the best edutainment games
At this point, if you trust companies with terrible, terrible track record and you get bitten, what do you expect us to say?

People keep repeating "vote with your wallet", and almost nobody does. It's already hard to make peace with that, but we learned to.

However if most of the IT community place billboards saying "don't go into the bear cage" for years, and you still do, what can we do?
How is being worried about society objectively changing for the worst - like excluding you for your gender or the color of your skin - conservatism?

Wanting to be truly equal is progressive.
It feels like that started happening around 2014-2015. I genuinely wonder if he is afflicted with some mental issue. I stopped following him and the comics when he started blogging about how great trump was.
In the Instagram age, you can judge a book by its cover (2021)
> I see no prospect of it happening in the next 10 years

It's happening right now: the field is being flooded by data-kids who reason in different terms. They are statisticians first and programmers later. Their models can do stuff that bit-pushers like me will always struggle with. 10-15 years from now they'll run everything, and you won't be able to code a helloworld without specifying a ML model.
At this point it's just an argument of what constitutes a recession. The NBER definition requires a "significant decline in economic activity that is spread across the economy and lasts more than a few months."

There is lots of leeway in there for defining a recession to be whatever you want to be. However, I think a GDP contraction of 1% (and decreasing) combined with robust job growth and increased spending would not classically qualify as a recession.

It's clear that the Fed is attempting to slow down the labor market and kill demand. Combine that with ongoing supply chain issues and it's not clear to me whether we are entering a recession or that there is transitory pain from war in Europe and sudden bumps in borrowing rates.
The wild part is that you just pulled a Dilbert with this comment...
Lol wow! This feels like one of those situations that Germans have a very long and special word for: When someone tries to spare you a minor embarrassment but in doing so creates a major one for themselves.

While you might not think several orders of magnitude have meaning, fortunately here in reality the fact that it requires far less overall mining to create and supply a uranium power station that it does to create and supply an equivalent (in power output) solar field with batteries has huge meaning.

While I do thank you for looking out for me, I urge you to in the future take time to introspect on yourself and views, so as to save yourself these issues. I know no one tries to be a hypocrite intentionally, so I know these are resolvable problems for the average HN'er. Good luck!
It is an economic principle that very low unemployment leads to competition for wworkers via increased wages, which help drive inflation up (as the increased labor costs lead to a more expensive output). The inverse is also true. So, central banks prefer inflation to not be zero, but not be high either (often, central banks have inflation as one of their target numbers that drives their policy).
I always forget step 4 and 5 - the most important steps as its the only thing that helps the user.
Please don't cast unsupported GPT-3 aspersions on articles, particularly when the article pre-dates the invention of GPT-3.
For the exact same reason being from Russia would. Hostile, unpredictable, militaristic country, ran by a wanna-be dictator, committed to an active invasion of another country's sovereign territory.

(My point is those two tend to go hand and hand: higher percentage of unwanted traffic originates from authoritarian lands still engaging in 19th century style barbarism.)
In an era of unlimited scaling infrastructure, it's a shame they're struggling to capitalize on an exclusive superbowl scale marketing event. It was predictable days in advance.
Under which definition does the belief that you should be able to criticize and push back against changes you believe will be detrimental but still believe that other changes will improve human societies over time belong?
complaining about something that makes little or no difference compared to real problems makes one look petty and weak-minded even after we steel-man your less-wrong opinions
"stock prices are a prediction of future profits."

No better prediction of future profits, than current profits.
I also wondered what’s the connection between the online gambling industry and slavery so I Googled.

Here’s one article I found: https://asia.nikkei.com/Spotlight/The-Big-Story/Cyber-slaver...
The United States used to have a strong union culture in various industries, which has been worn down tremendously over the past century. Throughout that time many people in various places on the left end of the political spectrum have expressed their concern about that change. Is that conservatism?
HiMama | Toronto or Remote | https://himama.com

Want to work at a high-growth tech startup that is focused on making a real difference in the early childhood education space? We want to work with you too!

Full-stack roles we're hiring for:

* Intermediate Software Engineer: https://jobs.lever.co/himama/502cee89-2d5c-45be-87a2-63e44e5...

* Senior Software Engineer: https://jobs.lever.co/himama/c9769520-0478-49da-beeb-9722819...

Some of our tech Stack: Ruby on Rails , React, React Native, Typescript, Apollo GraphQL, PostgreSQL, Memcached, Redis, AWS
I'm 60 (no beard). I did have to adjust to the way that I'm perceived. I don't like it, but it's just the way things are, and I need to accept it, and work around it.

I seem to get done what needs doing. I'm no slouch, in the areas I work at.

Basically, folks are free to ignore me. I won't ignore them.

I will step up (politely), when I'm being downright insulted, and will usually remove myself, if possible, from situations where that happens.

A lot of times, when I see some of the Jurassic-scale clusterf**ks that happen, I wonder "Did anyone over 40 review this plan?"
https://www.mealime.com/ is fantastic. I've been using it for years. It has saved us money and eat better, with plenty of variety in what we choose to eat each week. 10/10
I don't think it's super valuable to spend time thinking about the computational class protein folding (or structure prediction) is in. It's clear now that approaches that approximate the expensive physics and extended sampling using every bit of additional information available are going to be much more successful in providing data that people need from structures.
Email hn@ycombinator.com, they usually respond really quickly.
Making Games for a Console That Doesn't Exist – Pico-8 and “Fantasy Consoles”
You can do anything if you control the definitions:

Ethno-nationalists want to progress into a world where conflict is avoided by clear borders between naturally antagonistic groups, while globalists want to revert to a time before clear nations and borders, to plunge the world into perpetual ethnic conflict, such as what happened in India and Africa after colonialists drew borders without regard for which groups lived where.

Anti-immigrationists want to progress to strict enforcement of the US border, while pro-immigrationists want to maintain the status quo of loose enforcement and origin-agnostic immigration policy that has been in place since 1965.

Ukraine wants to maintain the nationalist, separatist status quo of an independent country, while Russia wants to progress towards a larger, unified, multicultural whole.

See? Easy.
If the labor market is so strong why is there still an eviction moratorium in place in places?

When was the last time the rule of thumb was overlooked?
> But the fact remains that women and minorities are at a significant disadvantage when it comes to just about all aspects of life

Yes, but overcorrecting but trying to implement equality of outcome instead of equality of opportunity is bad as well.

Both can be true.
Property Meld | Full Stack Engineer | Rapid City, SD | REMOTE US

Welcome to the future of property maintenance. Property Meld’s vision is to radically improve how the property management industry handles property maintenance. If you’ve ever had a maintenance issue at your housing rental, you know how much of a pain it can be to get it fixed quickly and reliably. It doesn't have to be this way. We're rethinking the entire property maintenance experience from the ground up with two things in mind - first, driving the cost of doing maintenance to the absolute minimum, and second, providing an experience to residents and property owners that makes them want to stay with their property manager. If you are excited about turning something that has historically been a negative experience (maintenance) into a positive experience, we'd love to talk with you.

https://property-meld.breezy.hr/p/f80425c77d79-full-stack-so...

If you are interested or have any questions email us at tech.jobs@propertymeld.com or apply via the above links
Oracle offers worse products than open source and gives you that privilege you pay for and can never use fully.

I'm bitter about their KB documentation being paywalled. Their community ecosystem is nightmare fuel. Burleson Consulting is right until they are deprecated or were wrong to begin with -- but at least it is accessible. AskTom is retired.

And for the past several years their attempts at "us too!" cloud offerings look like the slow recognition that its best days are far behind it.

Hard pass with all the invective thoughts I can muster.
You make me feel bad therefore you are bad. That sort of thinking?
I was learning on an Amiga 500 in the late 80s. I dropped out of high-school to take my first programming job (it was the 90s and I went back to finish). Before I had an email address we used Fidonet. When I had my first email address the Internet wasn't commercially available. I've been there since and watched it grow.

What I find weird about it all is seeing how the same things get discovered, forgotten, and rediscovered: and how all that froth forms some of the weirdest trends and opinions.

I've done the management thing for a couple of years and while I was good at it I wasn't enjoying it. I intend to stay on as a developer for the rest of my career. I like programming.
oh no the portentious "other problem" everyone is too scared to address
> I cannot see their motivation to offer anything for free.

Oracle is not alone. AWS/Google Cloud also have free tiers. They want you to get to know the system and might grow out of the free tier. But Oracle's offer is significantly more generous than Amazon's or Google's.
If you look at it like that then surveying is just "asking questions". Of course, everyone who knows a thing or two about surveying will tell you it is not, because it's systematized and has set procedures that allow you to gather that data with much more accuracy and validity.
Do they really want lots of traffic? It's a very specialized website, it's not like the traffic will stick. The people who want to pay for their services are already customers. I doubt they care about random Joe
Being forced into the cash economy means being victimized by crime.

The flower, vegetable, and mushroom farms near me don't have to deal with that. The farm that grows baby Marijuana plants has to hold a bunch of cash and gets robbed. This is California, so it's all theoretically legal, but it's not equal.
> And it's on the whole asphyxiating the industry.

My understanding was that asphyxiating the industry was always the plan.

For those who worked in industry pre-2008, one of the major drivers that allowed new startups to be so disruptive was that startups could very often compete with the then major tech companies on compensation. If there was a difference in pay, it was usually minor and could easily be made up for by better quality of life and a nice promotion in title.

Once Google and Facebook started growing it's clear they realized that every talented engineer on the market is a potential threat. As time has moved on the gap in pay between startup and FAANG and now startup and any company offering RSUs is just too large for startups to compete for talent.

I generally prefer startups to large companies, but can't find a single startup offering comp even remotely close to what I have in my current role. Unless I started to absolutely hate my current position, and found a startup that had essentially my dream role, there's no way I would seriously consider a switch.

My suspicion is that as funding for startups starts to dry up as money becomes more expensive, we'll see large, high paying tech companies start to let go of more staff and start driving comp down. When the market cools Google and similar companies asphyxiation strategy will have been completed. Startups starved of talent and finally starved of dollars will be no threat, that means they can safely reduce labor costs while maintaining market dominance.
Gross Domestic Product is not divided by population.

GDP per capita is what you're referring to?
Ahhh very cool. Thanks
The Insane Cost of Cars
Days is not enough advance notice, if for example they don't have a way to monetize the traffic. Unlimited scale = unlimited cost. Potentially the site crashing was the financially appropriate outcome.
> Well. I guess that's how Oracle works. After trial period ends they shut down random accounts that are using their 'Always Free (not for long)' services.

End of the discussion, Oracle suspended your free tier and while it sucks, it's a free tier and Oracle can suspend it as they wish, it's in their TOS (edit: in case of suspected fraud).

Do not rely on free tier for anything important, free tiers are here to test the service sure, not to build an app that is important to you.

They will probably never tell you the real reason for legal reasons.
Pretty much everything you said doesn't make any sense. Folding@Home started at Stanford, not WashU. WashU was also not "the home of the human genome project", that was a distributed effort. AlphaFold doesn't contribute to Folding@Home, it's an entirely different problem.
I'd say that Shreve and Musiela lack rigour and are too focused on trivia, name-dropping and anecdotes. Jiao's "Infinite-dimensional methods in amassing vast bags of gold" is unsurpassed. For its coverage of Black-Scholes, I'd also recommend Schulz's "Good Grief, Charlie Brown". Sorry, everyone seemed to be doing this so I felt I should contribute too.