skysight-inc/HackerNews huggingface dataset:
I agree with you 100%. I just want to add that this over complication of things is not just an IT thing. Try taking up a new hobby whether it is cycling or surfing. In no time you will have the "experts" telling you that a $200 bike is useless and is a waste of time. You need to spend at least $5000 to be part of the club. Now if you are a "professional" cyclist then spending a lot of money on a bike makes sense. For the rest of us, just getting on a bike for exercise is enough. I think some people just need to show they are better and know more. This is where some of these complications come from. Sometimes, of course, it is just plain incompetence.
Strategy Letter II: Chicken and Egg Problems (2000)
Ask HN: Need centralized logs with a search interface. ELK or EFK or what else?
Hi

I run a SLURM(batch workload scheduler) cluster for research and need to aggregate logs from several compute nodes, a controller server and a few infrastructure servers(SSH server, web server, Git server etc).

What I'm looking to achieve is to have all logs sent to one place, and have a search interface on top of it.

Hard requirements:

Self-hosted/on-prem only.

Affordable for a small research group if not free and open source.

Choosing guidelines:

No clustering of any kind necessary. Single point of failure is okay. Our logs are not mission critical.

Low volume. Our entire clusters logs are probably less than 1 GB/day.

Prefer one fast server to deploy this solution in rather than the complexity of a distributed solution.

So, should I buckle up and work on Elasticsearch +[logstash or Fluentd] + Kibana?

Or

Are there better alternatives I can look at?

Appreciate your recommendations.

Cheers!
My VLC says these files (the ones I got, anyway) are in the wrong format to be played and it throws an error.
Cooking is so straightforward that it would be astonishing if it weren't discovered. There is a fire in the jungle; hungry humans discover a cooked chicken near the perimeter and realize it was the hot fire that caused it to smell and taste so good. Next time, they go to a fire, capture it and control it to cook some meat. From here, it's monkey see monkey do and the rest is history.
Neuromorphic Computing startup
It's ridiculous in many cases. For example, they rate my next door neighbors place (townhouse, identical floorplan) as $400K more than mine. Their record of my purchase price is half what it actually was.
The peer review process is certainly a very large component to creating trust, but it's not just the process that's in place at the moment, it's the past track record and reliability. An untrustworthy source cannot instantly turn into a trustworthy one by adding quality peer review, it needs to develop a track record, which takes time.

Wikipedia is a perfect example. It has only relatively recently become seen to be trustworthy, after many of years of tweaking and improving their edit process. When Wikipedia first started, few took it seriously. Likewise, when an open journal starts adding more stringent publication requirements, it too will not be immediately trusted.

The point is that quality itself is not sufficient. You need a reliable level of quality over a relatively longer period of time.
The brain runs almost entirely on beta-hydroxybuterate, and human mitochondria have a very efficient process to use BHB (instead of glucose) for power.

The most efficient diet for humans is one high in fat, moderate in protein, and low in carbs; which explains the absolutely curable disorder known as Diabetes II (aka chronic insulin resistance).

And before anyone jumps on the "keto is a fad diet" bandwagon: if it is, indeed, a fad, it is a fad that modern humans have eaten for 200,000 years, and our ancestors have eaten for another 2 million before that. If our taste for fat did not make us human, it certainly defines a particular trait of ours that all humans depend on.
That sounds right, as far as it goes. (I likewise assume a sister doesn't ruin 'only son' status, and that we don't know someone is male).

Another line of thought, possibly just a line of confusion:

Assume "someone", S, is the OS of an OS of an OS. Look at the siblings of S's grandfather - he could have had any number of sisters, but had no brothers. The probability of that situation occurring goes down with each increase in the number of sisters. So maybe an exact answer can be given, a formula including terms for the number of sisters each of the 3 OSs have? (not forgetting the probability that S is also female)
Most of the plastic gets into the oceans from a couple of rivers in Asia.
I wonder whether it'd be possible to build such cleanup facilities close to those river mouths (still in the rivers, not in the ocean). It'd be easier to maintain and clean the filter systems - to me that seems easier and more effective. It could be an addition to filter systems in the ocean.
If you're an employee, you actually own nothing. To own it, you need to put some skin in the game, feel the burn when things fail and share in the bounty when it succeeds. A "feeling" of responsibility, is one thing. But having your bottom line decrease when you mess up "feels" quite different.
You know you're living in a bubble if you think all 25,000 employees will make $250,000 per year. That is not anywhere close to average.

For one thing, they won’t all be engineers. Cost of living is also lower than SV.
You prove my point, it requires specific knowledge full of gotchas.
Working from home as a contractor on a team of two making a conditional access system from scratch. No bullshit, no politics. Just code and happy customers. I wrote complex software all by myself which worked nearly perfect and continues to serve hundreds of thousands (probably more now) of digital cable subscribers. My friend/co-worker/architect did a great job with his stuff and mediated the boss's crazy whims.

I'm still owed $14k for my work, which I'll probably never see, but I'm proud of the work I did. It gave me something to talk about in interviews and probably made me more money than I'm owed.
There are features of 4chan that I don't often see discussed that I think contribute to the communities ease of conversation.

Firstly that all conversations are flat and always chronological. This might not sound very interesting but it reduces the cognitive load of moving through a thread, everyting is very predictable.

Second is that any post, from any thread, on any board, can be referenced by any other post. The ease at which narrative can be strung together by reference is probably one of 4chan (and other image boards) best features. The fact that you can just hover over a link like >>45646435645 and it shows you what the post said negates the need for nested conversations and produces a narrative of conversation that is both simpler than nested forums because of the 0 nesting, but also more complex because of the expressiveness of referencing anything.

I'm not sure if the second feature requires the first to work as a mental model, or it would get very messy.
The problem this solves is to shine a light on the inverse price wars going on in drug pricing. List prices increase dramatically while rebates are offers to lower the net price. Pharmacy benefits managers who do the negotiation like this because they earn money on the rebates(which are also shared with insurance companies) and insurance likes this because copay is a fixed rate on list price and not net price. And both of these actors who cooperate to increase list prices get to blame the increases on drug producers who year after year earn less per sold product because of the rebates.

This will however not solve anything only make it visible. Copay should be changed to work on net price after rebates, and some serius investigation of the middlemen needs to be instigated.
Maybe Tencent and Alibaba dont need to focus more outside of China. China in itself is a huge market. Also the reason we dont hear about these services is that HN is largely representative of the English speaking part of the world - a big part indeed but not the whole.
Your focus on the Tex source is pretty amusing. Imagine working for a year on a project, building countless experiments that your write code for, edit, annotate in random files or on a notepad, build huge datasets, spin up and down servers or various equipment. Then, when you finally get a result, you put write a nicely formatted document in Tex or Microsoft Word or whatever. That final document represents a tiny fraction of the work and thought you put into it. The ability to mess with that final product without the underlying 99% of thinking and effort that went into it gets you nowhere.
Art Has Been Created by AI. Will Collectors Want It?
In addition, I wouldn't be surprised if HN is blocked in China.
> Open hardware is never going to be the free lunch that open source software is..

Unless we can automate the chip making process. Think of it as the chip version of PCB micromanufacture or 3D printing. At some point someone will make a business out of making boards and placing all the components for you. The trick is to do it without any retooling and no humans involved.

What is the manufacturing cost of a wafer full of, say, CPUs? If we can all get our designs in there, we can share the manufacturing cost.
A number of the large ad networks I work with requested Google Analytics data for review when going through my application.

If you ever want to sell your site, having a decade of Google Analytics is valuable.

Yes, you could use a different analytics software or logs for the above. However, since Google Analytics is the standard, it's familiar, trustworthy, and performs equally across all sites. For example, Google Analytics shows I have about 1,000,000 page views a day. I have Apache blocking at least 30 user agents from common types of bots and scripts. Even so, my database logs show about 10,000,000 page views a day getting through to my site. That's a pretty large difference in reporting. This is why if someone is buying or analyzing a site, they want to compare the same source, such as Google Analytics, across all properties they're considering.
How to Win People Over with Babies, Lovers, Earth, and Dogs
I agree. As I said probably the tools and technology should be tailor for the specific use case of scientific papers. It would be nice however that these papers evolve online, instead of the written in stone papers that are publish today in scientific journals. A small note instructing the reader that a certain theory has been disproved or changed in the original paper would already help.
There is a patchset that enables deterministic behaviour on Linux (https://www.linux.com/news/event/elce/2017/2/inside-real-tim... has a few pointers). Much of it has been mainlined, and it does have trustworthy enough commercial backing that it's worth considering at least.

That being said, the more typical approach for this, as employed by e.g. RTLinux ( http://www.rtlinux.org/ -- I'm not endorsing it, it's just the one I'm more familiar with), is to run a hard RTOS along with Linux, running real-time tasks on the RTOS and everything else on Linux. It's a more complex solution, and it's a little unsettling that we've even had to come up with it, but it works surprisingly well.
Writing fancy UIs and multimedia applications on top of things like QNX is difficult (not necessarily in terms of learning/development effort, but also in terms of licensing, cost, hardware support etc.), while writing real-time control applications on a patched Linux kernel requires some trips down the kernel rabbit holes, and is hard to get through some certification processes. Companies optimize for whatever they need :).
> Sometimes, there's a "correct" way of deriving the article I guess, but it sounds weird.

No. If something sounds right to a native speaker, it's correct.
They are all faster than Go in case you haven't been paying attention.
Wealth is not a zero sum game, but more importantly, valuations are not actual money -- they're just what the company would cost if you bought the whole thing at the same price as the last investment. If a company has a down round, billions may be wiped off the valuation, but actual losses suffered by previous investors are a small fraction of that.
I'll listen to music everyday for a week then not at all again for the next 8 months. I would happily pay for it on demand, but monthly it'd end up costing me something like $10 per minute of music listened to per year.
Misleading headline. Google is censoring their results IN RUSSIA according to whatever local law is in action there. They do the same in European countries and, be strong now, in the US.
Wasn't it that they could feed in certain known possible letters to cut down on the number of options? Something like, "this encrypted segment is usually the weather so the s is probably the word 'sunny'".
I agree, but I do not think that we can write an acceptable, realistic, and unambiguous definition of 'solved' before we start, because fighting with a bear always involves some learn-by-doing. It will take a long time for people to accept that a new healthcare system is anywhere close to good enough, and we cannot confidently anticipate now what will be politically acceptable as 'good enough' after people get accustomed to living and dying under the new system. This could certainly be a project that could organically generate some shared values as a by-product, if it is done with political wisdom and skill, but that is just another aspect of a very rich strengths/weakness/opportunities/threats environment that must be navigated.
jobs like "scrum master", that literally seek to destroy developer time.

We can’t really ever hope to make progress with improving productivity or work environments if people contribute to be this reductive.

A “scrum master” role does obviously not “literally seek to destroy developer time” - it’s a patently ludicrous assumption. But if you are in a situation where this is happening - rather, where a “scrum master” role is getting in the way of work - then it does point to something else going wrong in your organisation.
Shout out to Offtopic. Plenty of original memes came out of that community.
If then uses his prosthetics to create better prosthetics, does qualify as singularity?
Diabetes II can also be “cured” by a high carb low fat diet. Not all carbs are equal; the problem is refined carbs.
Somebody at work ordered 50 rubber duckies on ali express, apparently that was cheaper than buying a few or something, so everybody who wanted one got a debug duck.

Turns out you also have to use them for it to have any benefit, and most people don't.
As team lead I consider having the interest to master the tooling part of the job requirements and respective evaluation, not specific knowledge full of gothas.
> It really isn’t as diverse as you seem to think. As suggested in another comment, these German speakers you talked to simply didn’t know the correct forms: The German language is generally quite prescriptive, there’s little room for variation outside dialects (which are not “correct/standard German”).

Nonsense. If a native speaker uses a form and thinks it's correct, it by definition is.
Bare walls, little furniture and big dreams: A year inside D.C.’s esports house
Google "Tim Ferris fear setting". I've gone through the fear setting technique several times and have gotten through pretty rough patches in my personal development with it.
I rather see reproduction platform where someone can use a paper and create a new paper or fork some parts of it with credit. The original paper should be immutable.
> Sure, probably this was more about him being a good manager than the "process" behind it.

Of course also that, but you're completely right that that is the exact job of the Scrum Master. To "remove impediments". No matter if the impediment is some process or a manager, it's the Scrum Master's job to remove it.

This actually aligns pretty well with the ideas in Agile Manifesto. And that's why I'm so sad when "scrum master" nowadays mostly seems to mean someone who counts the minutes devs spend on each Jira ticket, and haunt the team when velocity seems to be dropping 10% for the second day in a row.
I'm still figuring things out. Last job was at a big 4 consultancy doing CMS work, current job is at ~1500 employee software company doing a mix mobile and web dev.

Agile definitely feels better than waterfall, but it's also made me appreciate why it goes wrong so easily. You have to be willing to experiment with your process often, and retros have to have the ability to get brutal if things aren't working.

Regular releases (every two weeks or so) are important. They help to reduce scope creep and get you faster feedback. The trick is tweaking what a 'release' is. Having the ability to do targeted, beta or pilot releases helps you get things out more quickly without scaring the rest of your users or screwing up of there are bugs.

Pairing is useful, but there is a tendency in our team to say 'oh, there's not many cards left in the current release, let me pair with you'. That's just wasting time. Pairing should only be for knowledge sharing or speeding up difficult code.

Slicing tasks is very hard. I think it's better if they're sliced vertically (implementing a feature end to end) as opposed to horizontally (you write the react, I'll write the API, and we'll meet in the middle). Horizontal slicing leads to knowledge slios, implementation mix-ups and can also lead to very small cards which means you're constantly context switching.
About 1995 I remember speaking to a guy who had programmed using a hand drill...

He worked for a company that did industrial control systems and one plant (a steel mill I think) had a very old system controlling it that booted from tape. However, as it was very old the paper tape had long since worn out and had been replaced with a sturdy length of leather. He needed to make an alteration to the boot process so had to resort to the hand-drill.
https://veritas.icu/blackpaper
My problem with this analysis is that it ignores the fact that the China economic phenom was due to rise of manufacturing. Something that happened in the US 50 years ago or so. Computing is essentially the tertiary sector and develops after the secondary sector. So China has only begun approaching that end of the curve. The companies listed here were founded because at that time US was focussed on computing and kowledge had already been acquired. It would be interesting to see what happens as China's tech sector approaches maturity.
Purl
> But no matter the process, if a manager is destroying productive time from the developers the fault is in the individual, not the environment or process adopted.

Why can't it be both? Bad managers can be empowered by a process, just as good managers could be hampered – no?

Agile provides so many tools for bad managers to micro manage, so that even if the process itself is well intended it still could lead to hell – no?
Do you have any suggestions for how to improve my written thinking? Word can (mostly) fix my grammatical errors, but I am no longer in university so I don't have the ability to have a teacher look at them.
The Pentagon’s cloud strategy to catch up to the commercial tech industry
Of course. "We quoted Mein Kampf and were praised for it" is a nice piece of rhetorical engineering.

Monstrous arguments are often assembled from tiny units which may be unobjectionable individually.

The implication that the journal editors failed to notice the evil taint of Nazism from short extracts is nonsense.

But the whole hoax is entirely political. The authors disapprove of what they call "Grievance Studies" and they wanted to call that out.

Which is fine as far as it goes, but as others have pointed out, it's not as if the SNR in other disciplines is perfect.

There's a huge amount of bullshit everywhere in academia - from theoretical physics to medicine to economics to computer science. [1]

Going Sokal proves nothing at all this point. We already know peer review doesn't work very well, because academia is now driven by financial and economic pressures more than it's driven by a noble quest for knowledge and wisdom.

Ironically the "grievance studies" people have done a better - albeit still slanted and ineffectual - job of pointing this out than the entire peer review system has.

[1] http://news.mit.edu/2015/how-three-mit-students-fooled-scien...
> I tend to use the same lancet 10 or more times (I know, probably not recommended)

I'm not a diabetic or anything else that needs to use needles regularly, so I can only vaguely imagine the economic downsides of only using a needle once. Especially when your insurance doesn't cover them.

But this picture kind of freaked me out and would me make think twice: https://i.imgur.com/Sh8lteI.jpg

It shows microscope pictures of a needle after 0, 1, 2 and 6 reuses.
Kenya Government mandates DNA-linked national ID, without data protection law
India is leading digital revolution with speed and scale
what sort of wearable? a watch? google glass like? fitbit like? what do you envision it doing?

perhaps look at some of the open source wearables for inspiration [1] [2] etc.

[1] https://openhomeautomation.net/open-source-wearable-platform...

[2] https://www.hexiwear.com/
Were you working for Crossover or similar?
This has been debunked. 10 rivers in China account for 90% of plastic carried to the ocean by rivers.

"...all rivers contribute between 5 and 34.4% of the total annual land-based input of plastics into the ocean, and 88-95% of this comes from 10 rivers. That means that the overall percentage of land-based plastics coming from these 10 rivers is somewhere between 4.5 and 31%. Possibly a substantial amount, but nowhere near the claimed 90%."

https://www.reddit.com/r/badscience/comments/aj0idr/debunkin...
"I'm a software developer, and I barely know nothing about electronics."

That sounds like a familiar recipe for disaster. Most hardware based Kickstarters fail. Even successful ones deliver very late and over budget. I work in electronics and wouldn't do it.

You really need to find someone with experience in bringing products to market. Hardware mass production is extremely difficult and expensive (from prototyping to final layout to component sourcing to quality control) and that's before you get to stocking and delivery. That all requires a lot of investment, time and understanding of the underlying systems.
Wells Fargo? Well fscked at the moment: Data center up in smoke
What's so bad about Turing Completeness? I haven't a decent look at Dhall, but I'm betting I could probably write an exponential Dhall program that won't terminate in the lifetime of the universe.

The real reason for giving up Turing equivalence was probably to get dependent types. This gives very powerful static guarantees, including the presence/absence of fields under non-trivial record operations such as merge. In using dependent types, they have also had to give up significantly on type inference, which is really going to annoy the average JavaScript/Ruby programmer.
ActiveRecord Mistakes
You can certainly post thoughtful comments, but they will invariably be shouted down by shitposts and outright abuse. It's not worth it, because the 4chan hivemind doesn't want it. The boards are too hectic and posting moves too fast.
At this point you could easily go your entire life without knowing what PIN stands for. It has become colloquial. It doesn't matter any more what is stands for. Just like Laser, radar, Tardis, or ATM. The original acronym doesn't matter. That's ok, beause Acronyms Seriously Suck. They are new words, with a mildly interesting derivation.
The Wikipedia page on Malvertising has several examples listed.

https://en.wikipedia.org/wiki/Malvertising
Extracting text from images using Ruby
Why would it smell and taste unusually good before cooking was invented? Isn't it more likely that appreciation for the taste of cooked food evolved because cooked food is safer and more nutritious? If there's no cooked food there's no reason for this preference to evolve.