skysight-inc/HackerNews huggingface dataset:
Location: Berlin, Germany

Remote: Yes, strongly preferred

Willing to relocate: No

Technologies: data engineering, engineering leadership.

I have experience in

- starting engineering department and delivering MVP in startups, making pragmatic technical choices there,
- working as a tech lead / architect within a single team or across a few teams, balancing business and technical needs.

Technical focus:

- data pipelines, distributed systems, backends, automation of data processing,
- Scala, Python data stacks, Spark, Kafka, Sql/NoSql databases, AWS, CI/CD,
- I like coding, but recently it was not my main responsibility at work.

I am looking for a remote position with the following components

- Strong engineering: areas related to distributed systems, computations, data processing,

- Leadership: I would prefer a role like architect, principal engineer. I have experience in managing teams, but I am not a JIRA / Scrum guy, I focus on engineering, heping engineers to do their best work and be productive, communications, and product.

Linkedin: https://www.linkedin.com/in/dvorobiov/

Email: 2belikespring #at# g mail.com

Contract or full-time.
Maybe tungsten ? If it works for tanks, it should also work for ducks. ;-)
> It comes from grades being used to evaluate people outside the particular schools they attend.

Are they really, or is just this elaborate illusion supported by most decision makers to give some rationalization to their own selection processes? When you have Harvard being sued for discriminating against Asians, how can we keep a straight face and tell the kids that they need to study hard because the grades matter?

I think this is part of what PG wants to defend in the essay: why do we actually care about grades at all?
The WikiLeaks Conspiracy
So there are two distinct aspects to APL that make it mysterious - the semantic philosophy of array manipulation, and the syntactic philosophy of terse characters and very simple grammar. These are no longer unique to APL, though the combination is unique: the semantics have been copied very closely in the form of Numpy (which even adopts some of its terms, like 'roll' and 'reshape'), and terse character syntax is found in many DSLs like regex and basic math syntax (a DSL so ubiquitous that it's easy to forget that it is one).

APL makes perfect sense if you think of it as 'regex for numpy'. I'm actually quite surprised no one's made an APL->numpy syntax shim.
Thanks for the enthusiastic pitch :) There was once an internal IBM editor called E3, with many Rexx extensions. It was amazing.
I changed the link in https://news.ycombinator.com/item?id=21730007 and detached this subthread and marked it off topic.

Seriously off topic. There have been two huge threads about AMP in the last week and something like 9 of them in the last year: https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...
I went to a small liberal arts school, and tests were rare. Papers were common, presentations as well. Projects, and experiments in the science courses. But not tests.

Most of the time, our grades were based on the work we produced, and our participation in discussions. Even in Art History, when the job was to study and memorize slides and identify them, the test was not to just say what they were, but to write a paragraph about how they fit into the cultural context from which they came.
The point is not that I make a lot of calls. But I need to be reachable for my parents and some other elderly relatives. And sometimes (although rarely) I need to spontaneously call some local shop or office to get a quick information. I have looked for VoIP providers many years ago and there was nothing reasonable. And my unscientific feeling is that the situation has rather become worse than better. Nobody is using them here.
Thank you for your reference to Perl 6. Please note that Perl 6 has been renamed to "Raku" (https://raku.org) using #rakulang as a tag for social media.

Please also not that all string handling in Raku (the `Str` class) is based on graphemes, not just some added functions. This e.g. means that a newline is always 1 grapheme (regardless of whether it was a CR or LF or CRLF). And that for é there is no difference between é (LATIN SMALL LETTER E WITH ACUTE aka 0x00E9) and (LATIN SMALL LETTER E, COMBINING ACUTE ACCENT aka 0x0065, 0x0301).

Please note that for any combination between characters and combiners for which there does not exist a composed version in Unicode, Raku will create synthetic codepoints on the fly. This ensures that you can consider your texts as graphemes, but still be able to roundtrip strange combinations.
> The book was also wildly controversial for its assessments of the capacity of Germany to pay the reparations demanded by the victorious Allied powers.

I don't think it's helpful for a review to make these kind of oblique references. It would be more helpful to tell the reader what that assessment was. I won't attribute intent to the author, but it comes across as though the review is only intended to be read by people who have already read the book.
Choosing not to buy products from a company you don't like seems pretty reasonable to me. It doesn't have to be a cunning plot to destroy the company.
That sounds like something Lore would say.
Hold up. X in the above is a symbol. Symbols may be bound to a function or they may not. But x here is always a symbol.

When you write (x) in the Lisp REPL, Lisp will assume you intend to call a function bound to x because x appears first in the list. If you instead wrote (y x), Lisp would never assume x was a function. If the first thing in a list is not bound to a function, Lisp will throw an error.

When you write '(x) [note leading quotation mark], Lisp will simply construct a list that contains the symbol x as its only element.

In my explanation above, I didn't make the distinction about the quotation mark because I assumed the questioner was asking about data structures. Lisp will print "the list containing x" without the quotation mark. But if that's what you mean when you type it, you have to explicitly type the quotation mark.
Wow! That's a GREAT article. Thanks for sharing!
Definitely a completely different support contract than a consumer console. That sounds more like an amortization of how many consoles they’d need to support that large of a system for the life of the contract.
I think testing algorithmic questions is certainly evil, but it's a necessary evil because all other methods are either too time-consuming or unrealistic. You wouldn't believe in a big company how many clearly unqualified applicants there are, and there has to be some quick and dirty rule to run a filter through them. Perhaps it's the aura of FANG companies that make unqualified applicants try because they have nothing to lose. My experience is that just about 1% of interviewees can actually confidently write a depth first search and explain its time complexity. If they can't even do that (which is basically among the first things schools teach in a CS curriculum), how do you trust they that they have the skills to design and implement even more complicated systems?
Thanks for pointing out that I'm wrong. I googled more and realized the numbers I cited were completely wrong.
Your comment jumped out at me, my wife and I are homeschooling/unschooling and some of people we've met focus on "purity" and all I can think when I talk with them is, "The point isn't to completely avoid anything that looks like schoolwork, the point is to guide the children to learn more than they would have otherwise."
Cheating? Even with phone screens, some candidates still cheat at these interviews (have some engineer with them answering questions, or looking up similar questions online).

I agree a full blown project over 24 hours would be better, but it's more costly to create questions and score them (if you want to do it in a way where cheating is hard/impossible).
I've seen startups do this, and it works well for them, but might not be scalable for companies that hire thousands of employees each year.
This article is misleading (full disclosure, I am French and did protest against this last Thursday)

This article talk mainly about "special pensions" from the public with privilege... For sure they will be the biggest losers and they are very vocal, but the law and the protest is about much more than that...

This reform will impact everybody, people will have to work longer, possibly to get a lower pension. Women are particularly exposed here.

Points system allows to more easily lower the value of the point... This has been done in Sweden, and former French Minister Filon told that is one main reason he likes the point system...

With this new reform, life expectancy are not taken into consideration : a manager will live longer than an industrial worker on average ; with the same share of contribution he will benefits from the system longer than "poor people" in general

People working longer means... a little bit more unemployment and more health expense for the workers (and more absenteeism for companies) as older worker have more health problem. So you save some money for retirement at the expense of other public spending...

Some economists, like Thomas Piketty are very vocal against this "law"...

It is a pity the NYT did such a poor job...
Unfortunately hotels are succumbing to the same sorts of fees and restrictions that much of the rest of the travel industry has. As you say, the premium for cancellable rooms usually isn't that much. (Where I work we're supposed to book cancellable as standard practice.) But whereas cancellable used to mean by 6pm the evening of your arrival. Now it often means a day or two in advance. Which is usually fine for changes of plans but doesn't necessarily help when travel goes sideways.
Freelancember has listed most of the mistakes indeed, along with the solutions on how to solve or avoid them.

Example: https://freelancember.com/excuses-for-not-raising-your-rates... - how to deal with raising the rates and not ending up stuck at the bottom level.
This isn't a problem that companies will ever desire to fix. Rather consumers need to realize how misleading the marketing is, and learn to form their own judgment of expected outcomes.

Every business loves the idea of "the cloud" because it provides the opportunity to perform a post-facto bait and switch. Start off focusing purely on making something people want, then change whatever it takes to make it profitable. Servers shutting down for financial reasons is just another stop on this arc of renting services instead of actually selling products.
the speed difference is frightening. Almost seems unfair. No wonder sharks steer clear. If they're spotted, they're doomed.
See also: https://twitter.com/farlkriston

Well, these ideas are very likely accurate, but so general that they are disconnected from solving practical problems. Fine, the brain is a prediction machine and it optimizes over some program space by annealing doing homeostasis/regulation, and maybe tends to occupy certain kinds of states now and then. This, however, tells us very little what the learning rules for the synaptic weights should be and how we should wire things up. In fact, I believe human-relevant problems are best solved by such a special subregion of program space that one needs pretty specific architectural priors as otherwise search will take too long. These are unlikely to be derived from general concepts, but are more likely evolved, either literally by evolutionary algorithms or by people doing the trial and error. The issue being that general concepts about prediction errors and program spaces know nothing about our specific world. E.g. none of these general concepts predict the usefulness of CNNs. CNNs exploit fairly specialized priors about object translation invariance and locality in image statistics, which are specific computations occurring in our universe when parts of it are perceived by geometric projections of EM rays onto an image plane with sensors. Hinton's capsules go into the right direction exploiting some more priors about spatial reference point invariance, but we need to go deeper. The brain disassembles the world into stable episodic chunks and operates on them, and it manages to backpropagate values through such episodic memories. Currently, no neural architecture does something like this.
Not suprised. Discounting humans, wild pigs dominate in large parts of Texas. Pigs are smart and ruthless, like or as.
I agree that changes need to be made, but a lot of the “wealth tax” discussion that has been going on lately would directly impact most people’s retirement plans (in the US), which are based on 401ks and other investments. Since we don’t have pensions anymore, and Social Security isn’t sufficient for a lot of people, building wealth is one of the only remaining options.
That’s true about GCP. I don’t care how good GCP is technically, I wouldn’t bet my career on it as either a person spending time developing on top of it or as a potential decision maker.

While I haven’t worked with Azure specifically besides what is now called “Azure Devops”, MS’s enterprise support is legendary.

I work for a company now that has AWS business support. I use the live chat all of the time as an “easy button”. Not when something is wrong, just when I don’t want to spend too much time trying to figure something out. They are excellent and batting close to 100.
Super smart, organized and no love for other mammals.

Depends on the population: The 'resident' (in contrast to 'transient') orcas in the Pacific Northwest do not eat mammals, even though it would be to their benefit as salmon is getting sparse...
And why would that be? Are they a particular problem customer for google?
Here's a bit offtopic diverging from the original topic into climate change.

This situation seems to be very relevant to various arguments for tackling climate change and other environmental issues by "stopping growth". Thing is, a very large share of capital assets that "require" (i.e. expect) growth is the various types of pension funds.

Any politician that would actually implement policies that intentionally cut economic growth in order to save the planet (or any other purpose) will ensure that the math for their local retirement system can't work out any more, that some pension reform will be neccessary, admitting that the expected benefits can't be paid out because the expected growth didn't happen. And as this example shows, there will be literal riots on the streets if that's threatened.

Also, compare this to earlier gilets jaunes riots initially sparkled by a fuel tax increase, or the Chile riots sparkled by an increase in cost of public transportation.

Climate change isn't bringing large quantities of violent protesters on the streets, but requirement to make economic sacrifices definitely is. So it's naive to expect success in cutting growth and aggressively taxing fossil fuels to help climate change - the general population will not only vote against it, they will violently fight to ensure that this is not done. Any politician who's actually serious about implementing the economic changes needed to stop climate change should expect be forcibly removed from power by a large part of their population which won't (and in many cases, can't, they're the poorer part of their society) tolerate short-term economic sacrifices. It's kind of sad, I don't know what can be done about this, but at least we should be aware about this issue when discussing any proposals that are supposed to be realistic.
Is this the same intent that a 'variation autoencoder' would perform?

Also, is it possible in non-variational implementations (like this one) that some of the dimensions represent multiple groups? For example, not just 0.5 and -0.5 groups, but also a 0.0 group in the middle. Then your rotation wouldn't be sufficient, you would need to increase the dimensionality to cleanly separate the groups.
I've been curious for a while about the inflection point between the more informal startup programming interview style and the bigco interviewing style, and while there's obviously variability between orgs, whether it comes with headcount, customer profile, fund raising milestones, etc
Any study about "criticality" needs to be taken with a huge grain of salt. The standard methodology is that criticality is synonymous with power laws. And power laws are straight lines on log-log plots, with slope equal to the critical exponent.

So when anybody says "we showed X was critical", they actually mean "we plotted a fuzzy cloud of data points on a log-log plot and fitted a line through it", nothing more. But you can fit a line through anything. Even a normal distribution shows up as a line on a log-log plot if your data has a small enough range.

Criticality studies trade on the reputation of physics, where the idea came from, and there it works fantastically. For instance, we can measure critical exponents for liquid/gas phase transitions to three or four significant figures, and even predict those numbers from pure theory. Applications outside of physics usually have barely one significant figure, if they're even measuring power laws at all, and no predictive theory.
While this has been true in the past, because of this advice, huge amounts of wealth are now in index tracking etfs or similar passive index tracking funds. This essentially means that a larger and larger amount of the market is just “betting in the market”. If you want to spot where the next financial crisis will come from a generally good idea is not to ask “what looks crazy right now” (ie VC funding) but “what does essentially nobody question that is also a major change in mainstream investing”.

Because everyone is doubling down on investing on the status quo, don’t be surprised if a disruption to the status quo has far more dramatic impact than it would have 20 years ago.
It is interesting to think of the opposite: space fabric is shrinking, so light needs to travel "slower" so as not to break causality.
I know I know, it's not really slower because the fabric is shrinking.
That's why it's quite important when you do get that high paying job to bank a large percentage of your salary into income generating assets. It's basic diversification of income streams.
There might be, but unfortunately I don't know it. I learnt Java initially from the first edition of Just Java, read from various other sources about the 1.5 and 1.6 additions it didn't cover, and then learned new features from OpenJDK proposals from 1.7 onwards as they were released.

The biggest impact of the 5 years for working developers has probably been:

* Streaming API and lambdas allowing usual `map`/`filter`/`reduce` transformation pipelines line many other languages (lazy, unlike JS's `Array` methods, parallelism considered via "spliterators" unlike Python).

* Default methods in interfaces, _not_ making them traits, but arguably more "trait-like". It allowed them to add many useful methods onto existing types without needing bifurcate the common APIs.

* A REPL. Probably not a big deal for a professional developer, who likely uses IntelliJ's "Evaluate Expression" feature already for a similar feature, but pretty useful for education I guess.

* Better at being stuffed inside Docker containers with resource limits. Also, max permgen space no longer a problem really (it's where you had to set an upper memory limit when invoking Java programs, which was annoying). Just generally less annoying at being deployed in modern infrasructures.

* APIs like `File.lines` that mean you don't need to recite War and Peace just to do a buffered operation across lines in a file. Generally more ergonomic APIs that finally make basic operations sane.

* Type inference with `var`. Basically the same as C#'s `var` or Go's `:=`.

* More native executable-producing tooling. jlink, jpackager, etc. The dream of ubiquitous, shared Java runtimes installed everywhere didn't really work out, and they seem to have realised that.

* Ecosystem moving away from XML. Still there, just less common. Runtime annotations are used more heavily, which I'm honestly not sure is a massive improvement. Hopefully more lambda-heavy APIs will reduce use of runtime annotations; see Spring WebFlux's functional handlers for annotation-based controllers for a comparison.

There's a lot more, but I'd argue it won't be as immediately visible for the working developer more than those points. Modules were important for the ecosystem, but most devs probably aren't worrying about that day-to-day. Gradle and Maven still dominate the building/packaging side.
http://archive.is/zBtGp
Eye-Tracking Test for Parkinson’s Given FDA Breakthrough Device Status
ah yes but of course, probably did not have enough coffee yet when I read it :) thank you

But then perhaps it is worth storing it sorted ( or as well if original value is important) and making it even faster?
<>

[Removed reply since the comment I was replying to was removed.]
Malthus, Stock Market and Hotel California
Hi, we define the interpolation threshold in Section 2 of the full paper (https://arxiv.org/abs/1912.02292)
as the point when the "Effective Model Complexity" = # of train samples.

Where the "Effective Model Complexity (EMC)" of a model + training procedure (w.r.t an input distribution) is the maximum number of samples from the distribution that the model+training can fit to ~0 train error.

Our experiments are consistent with the hypothesis that the double-descent peak occurs when EMC = n; that is, when the model+training is just barely able to fit the train set.
The other day I was browsing a list of all my country's domains and noticed a bunch starting with xn-- and you just made me understand what these are.

None of them seem worth phishing for. In some cases when you google the site name, google will show results from sitename.tld and when you visit the site with the show_punycode true, it will actually load pages from the xn-- equivalent. So it looks like the "original" domain isn't even indexed or online at all.

In another case both the xn-- and "normal" domain sit side by side on the same server. I guess there's no harm in posting these:

cadzandie.be and xn--cadzandi-01a.be. Note there's no ë in the first domain

Another strange one is

xn--rembours-i1a.be

When you type in remboursé.be it actually redirects (?) to the xn-- equivalent.

I'm fascinated but having a hard time seeing sense in this.
If you're concerned about suffering, don't you have access to free-range chicken in the US?
Why have a JSON number?

Why not "just stick with" decimal strings?
Please Wait
Ask HN: Who Do You Chat With?
Since going solo, I am finding the quietness somewhat overwhelming. I'm not sure how to fill the void left by Slack at previous jobs. I miss being able to casually chat or bounce ideas around with like-minded professionals. Who do you chat with throughout the day? Any recommended communities?

I idle on a few public Slack channels for frameworks/languages I work with but I'm finding it difficult to make a connection. I have plenty of friends but they're usually occupied by work when I'm working.

Does anyone else struggle with this?
No, it's not that. It's that often, to make a new product you have to have multiple parts of the business work together. Then you will find yourself working with the other department and they'll frustrate you.

Some places attempt to solve this by saying that you can use whatever vendors you need to solve the problem but often the best place to solve it is the other department since the solution is infeasible without them.

The problem is that often the solution is infeasible with them because the guys who made them good have left and now you only have the lameos.

As to why they can't operate as independent business unit? Well, there's the Theory of the Firm to tell you why that doesn't work often.