skysight-inc/HackerNews huggingface dataset:
I think a lot of engineers would agree with you that the evidence for TDD, Agile and $fad_framework is weak. Those sorts of debates are a HN staple, so I wouldn't want to criticize the whole field of software engineering because of the popularity of these concepts. Indeed Agile is often criticized for being insisted on by non-developers.

Social sciences aren't criticized for being crackpot anyway, that's a strawman, it's more for the standard reasons that they produce a lot of claims but the evidential basis is weak. If social science was riven with internal debate in which these weak claims were constantly and publicly attacked, then we could compare it to the software world, but in practice we don't see that and dubious claims that come from one or two people often persist for decades before anyone decides to take a second look.
>Are they going to enforce it for products/services sold overseas?

Like, are you a troll or you just don't know how laws work?

>I'm not so sure, not until I see watermarks in Tiktok's content.

Tiktok literally exports all videos with watermarks, its the people that remove them to post on reddit lmao how clueless are you
Hi, maybe I can try to answer your question.

First, to makes ure we are on the same page, distribution in Erlang happens across nodes and concurrency happens within a single operating system process. Erlang calls its concurrency primitive processes (because they are also isolated and preemptive) but that can cause some confusion (hence this comment).

From now on, when I mention process, I mean the Erlang VM processes, and they are very lightweight and you can create millions of them.

I can think of a few different ways where concurrency can help interactive data analysis:

1. Livebook supports rich outputs where each output is a process. This means your notebook can communicate with outputs as it executes. For example, it is very easy for you train a neural network and push data to the graph as it comes. Or to process data and plot it as you go.

2. You can use concurrency to run several experiments at once within the same notebook. We support this in Livebook via "Branched sections". You can prepare the data and then start several branches/processes to digest the data in different ways without a need to start several notebooks.

3. It is also very easy to build applications where multiple users can collaborate and interact with it, which we showed yesterday: https://news.livebook.dev/build-and-deploy-a-whisper-chat-ap...

When it comes to distribution, it is quite similar to above, because the concurrency and distribution primitives in the Erlang VM are the same. Here is an example of how easy it is to take a ML model from concurrent to distributed: https://news.livebook.dev/distributed2-machine-learning-note...

Generally speaking, I think we should start from the opposite side: we should try to make everything concurrent by default and fallback to serial only when we cannot. Specially for data analysis, where moving data is expensive, we may end-up incurring a lot of overhead if the only form of concurrency is via the network or inter-process communication.

One last note, perhaps the most important bit of the Erlang VM machine for data analysis is that it favors a functional style. Livebook notebooks are strongly reproducible. I expand on this in this video: https://www.youtube.com/watch?v=EhSNXWkji6o

I hope this helps (and feel free to tell me if I missed the mark!).

PS: I know many of the videos above are machine learning related and that's because we have started our data journey only now. Although the principles should generally apply. Hopefully more data videos will come soon! :)
> They're the ones who insist on copyright so they can maintain the artificial scarcity delusion well into 2023 where AI is literally on its way to automating intellectual work.

AI won't be able to automate anything if we use the legal system to forcefully reduce the size of its training set by 99.999%
Wouldn't it be great if everyone, or at least most people knew and cared about what was going on behind the scenes in making in iPhone?
> What mystifies me about ransomware attacks is how many targets don't notice that vast quantities of data are being systematically exfiltrated.

What is your understanding of ransomware? The point isn't to exfiltrate every byte of data, it's to encrypt it in-place (sabotage, not theft).

Is some data exfiltrated in some cases? Sure. I'd argue those are espionage cases masquerading as ransomware, and your question holds. But by design ransomware is supposed to fly under the radar.
If I routinely had strangers coming up to me picking arguments about something argument I made decades before (always the same thing), I'd pretty quickly come up with the minimum necessary reply to end the interaction as well.
> So it doubles the training time and FLOPS. Then the graph X axis should be wall time or FLOPS when comparing the methods, instead of steps.

Thanks for pointing this out.

Inflating your results by tricky measurement methods has been around forever, but it can be hard to spot if you're not close enough to the field.

Also, unfortunately, the blog post does not contain anything about the key idea used. (Well, I couldn't find it.)

Trust regions have been around forever; that's not the new idea.

It would be nice if somewhere there was a piece about "this is what we do better". Decoding a scientific article to figure out how much fluff it is seems like it has an uncertain return.
There's a ton of competitors in this space. Try something else!
Did you read the article? Kerr has published several papers with data supporting his hypothesis. Your single anecdote doesn't invalidate a statistical pattern.
>> Guessing the right theory of physics is equivalent to minimizing predictive loss.

A model can reduce predictive loss to almost zero while still not being "the right theory" of physics, or anything else. That is a major problem in science, and machine learning approaches don't have any answer to it. Machine learning approaches can be used to build more powerful predictive models, with lower error, but nothing tells us that one such model is, or even isn't, "the right theory".

As a very famous example, or at least the one I hold as a classic, consider the theory of epicyclical motion of the planets [1]. This was the commonly accepted model of the motion of the observable planets for thousands of years. It persisted because it had great predictive accuracy. I believe alternative models were proposed over the years, but all were shot down because they did not approach the accuracy of the theory of epicycles. Even Copernicus' model, that is considered a great advance because it put the Sun in the center of the universe, continued to use epicycles and so did not essentially change the "standard" model. Eventually, Kepler came along, and then Newton, and now we know why the planets seem to "double back" on themselves. And not only that, but we can now make much better predictions than we ever could do with the epicyclical model, because now we have an explanatory model, a realist model, not just an instrumentalist model, and it's a model not just of the observable motion of the planets but a model of how the entire world works.

As a side point, my concern with neural nets is that we get "stuck in a rut" with them, because of their predictive power, like we got stuck with the epicyclical model, and that we spend the next thousand years or so in a rut. That would be a disaster, at this point in our history. Right now we need models that can do much more than predict; we need models that are theories, that explain the world in terms of other theories. We need more science, not more modelling.

_________

[1] https://en.wikipedia.org/wiki/Deferent_and_epicycle
Rule of law in a non-democratic polity inherently benefits its rulers more than other citizens. That is legally-enforced corruption.
There is a lot of evidence that the rainforest is largely man made.

https://www.smithsonianmag.com/science-nature/pristine-untou...
This isn't quite correct. Yes, it can output C code; however the result is not very readable at all, and fails the DFSG on generated code. It _is_ useful for compiling Zig code to targets which aren't supported by LLVM, however.
Come over to Pandora - the water is warm and your favorite songs are a flowing.
The video overview says the journey in data is "just starting". That's exciting! Any ideas or vision for where it's going in the future?

Also, I noticed in the demo that installing polars was very fast! Was the video trimmed, or was it cached or something? I remember when I last tried out polars in Elixir a while ago, it had to build the rust library and everything and took like 10 minutes.
We just went through layoffs and the remaining employees were told to become more productive by utilizing GPT. So in my employer’s case the reduction is already happening - though it’s probably caused more by GPT hype rather than the GPT-4 itself.
So your argument is he was a brainwashed peasant?
So you're telling me now for my best benefit I should fake the condition of my parts to be worse then they actually are?
I don't think so - seems more likely that something like OpenSIL would need to talk to the PSP. The difference here [hopefully] is that those interfaces are documented.

edit: ie. from the blog post, on the xSIM part:

> "Provides a set of API services that initialize the platform host silicon. Most of the silicon initialization on AMD-based platforms is performed by embedded µControllers prior to x86 reset de-assertion."
Good for them. It’s a fun website design and a breath of fresh air.

People who complain about offbeat-but-still-readable web design are killjoys who indirectly contribute to the sterility of the modern internet.
Funny how the same exact statement with different context (from my perspective) leads to different interpretations.

I fully agree with your statement now. :-)
I have no problem with that. I'd like to warn you that this is essentially security through obscurity. Only one copy ever needs to make it out of that closed space. The more people in there, the higher the odds of that happening. Once it does, all bets are off.
I don't understand. I seriously doubt they paid for the company and only then learned it was worthless.

Why buy something and then shut it down because it needed to be rebuilt from the ground up? Why not just build from the ground up and launch the new thing without paying someone for the dead business?

Do they think the brand name will be worth something when the new thing is built?
I'd love to see plv8 added to this.

Jerry S. has done an amazing job of wrangling the insane v8 build process into something that mostly works across platforms, but installation is still not particularly simple.

Unfortunately, due to the problems with that build process, Ubuntu and other flavors dropped the prebuilt apt packages.

Making plv8 a simple install would be a huge boost to the community.
I'm in the same boat as you, but for very different reasons.

I have close to zero trust in the abilities or goodwill of Federal entities.
The statement I replied to spoke of the point of copyright being to encourage artists to create more art; not simply "to create more art".

But neither of those is really what's written down, with the (U.S. law) point of copyright being "to promote the Progress of Science and useful Arts".

We might could interpret this as, training AI is progress of science, and thus the point of copyright includes training AI. Although I'm not sure that we really need copyright to do that, and accordingly, I doubt that is the intent of the law.

Really, the issue here is may be that copyright law was not formed with AI systems in mind at all, neither as creators nor as consumers, and trying to apply it to AI systems, or to reason about copyright law as it pertains to what AI systems do, doesn't necessarily work very well.

Maybe we need to go back and amend all of our written laws with a phrase like "for humans", just like so many science headlines need to include the phrase "in mice"!
AI has always meant so many things to so many different audiences. I think attempting to argue that X is AI but Y isn't is generally going to be a subjective endeavour of pedantry.
Don't let "already exists in my local market" stop you. Look at how many pizza places exist in your local market! In almost any market, there's room for competition, especially with an eye toward lifestyle business (as opposed to dominating a market).
Nice, this is great!
An Interview with Protesilaos Stavrou, Philosopher
I cannot believe this is a record. Throughout history there have been countless religiously-motivated persons who have lived isolated existences, many in caves. Surely some monk somewhere lived below ground for more than two years at a go.
Your website is also really pretty, what did you use to make it?
This is great. Curious, have you scaled the "making" operation, as in have you hired people to make products, or does your gf still make all the products?
It's definitely not the neglect and underfunding of course

Do you have experience working with them?
> "Log in with your Google account to unlock all job postings"

Absolutely not. Immediate Ctrl+W.
I wish this was prominently documented. Most people new to Sidekiq have no idea that the job will be lost forever if you simply hard kill the worker. I have seen a couple of instances where the team had Sidekiq Pro, but they had not enabled reliable fetch because they were unaware of this problem
I had seen Dogme ages ago, thanks for reminding me. Agree we may see more like it, but probably with about the same cultural relevance : mostly a footnote.
I’m partial to Plausible Regurgitation
> Yes, they do. They all do. You need a rule of law, to tame corruption and no non-democracy has that.

Contrary to common belief, corruption does not have much to do with democracy. There are many non-democratic countries without corruption, and many democratic countries with corruption (and the inverse too for both).

The relation is that, currently, a high standard of living leads both to less corruption and to more democracy.
I'd go quite willingly. I'd probably enjoy it.
It's funny how common jailing-breaking iPhones used to be, I did mine immediately when it would come out and everyone else I knew did too. Now I don't know a single person that does.
Probably doesn't matter much for this one as it is the last Ariane 5 launch (afaik). Maybe they can get cameras on the 6.
I mean you don't have to write it, most of these are just defederated Mastodons with the serial numbers filed off. The problem is that once you've got your private Twitter, it's still expensive and tedious to run for very little benefit other than stoking your own ego.
You are calling the public relations arm of intelligence services that publishes “accidentally found public information” leaks like a shower an entity independent from government.
SavePop: AI Powered Link Sharing
> I'm already an introvert, but having kids, a wife and bills to pay sometimes just gets overwhelming.

It took me years to become self-aware enough to understand who and what I am.

I love my daughters to death, now grown up, but I wish I could have been older and wiser when we had them so I could have done a much better job raising them.

Living in a small house with 3 other people, two of them noise-making children, on top of working from home (I was self-employed for 15 years) was very difficult for all of us and nearly killed me (literally). Had I understood why noise bothered me so much, why I needed time and space to myself, and why my anger issues were likely autistic meltdowns I think we could have made things work so much better and found a way to give our daughters a much happier and less stressful childhood.

This is one of the great things about the Internet. I was able to discover what introversion is, what high-functioning autism/aspergers is (no, I've never been diagnosed but even my mother tells me that it would explain my entire childhood), that other people go through this too and how to have these types of conversations with the people closest to you.

I'm very lucky to have a wife as patient and understanding as I do. We were high-school sweethearts and she went through the learning and discovery process with me.

I can't help you with how to make the time for self improvement and learning, but do know that it's not just you.
Robin Hanson's Grabby Aliens model explained
> Parler sold to firm that says conservative Twitter clone isn't a "viable business."

I mean, Twitter itself is apparently not a viable business, so...
I Stopped Using Sorbet in All My Ruby Projects
You actually can, but only for things the model memorized: https://arxiv.org/pdf/2301.13188.pdf
We use the excellent Rustler Precompiled [1] library now so prebuilt binaries ship with the Elixir package. No Rust toolchain needed. :)

[1] https://github.com/philss/rustler_precompiled
I wonder if the public shaming of one person by the machine will encourage the others to be more reserved. And I wonder if that would be a good or bad thing.
Well... then what did they buy it for? I wonder if "using data gained from Parler for advertising" is a viable business...?
What interval is the remaining third?
That joke about his preferred Linux installation method is chef's kiss.
> we made libraries so people could learn for free without being beholden to their capitalist masters.

Naturally. If you copy the "free" content from those libraries and resell it you are committing plagiarism.

Just because something can mimick humans it doesn't meant they are humans. ML is just that, software. There's too much pareidolia out there in AI. Sad, because it's a great concept gradually getting bastardised.
Good questions. Journalists often rely on the previous reporting of their peers. If newspaper reporters, who work on tight deadlines, needed to fact check every single word in a story, they'd never publish anything. Instead, they check an old NYT story, confirm the details as previously reported, and move on.

This reasonable instinct can also give way to a broader laziness in reporting, though. Existing narratives are repeated verbatim, and we forget to go back to the bare facts and ask "what really happened, here?"

In this case, I saw the official narrative that the press had reported for 40 years. And then I saw scattered breadcrumbs that told a very different story about Richard Walter. I followed that trail, and here we are.
This seems like an extremely dangerous thing for Altman to do.

What about Roko's basilisk?
That’s what I thought too, many monks and nuns did way more as religious devotion.
RubyOnRails.jobs – Curated, hand-sifted Ruby On Rails jobs from across the web
maybe they paid so little they were really only interested in the customer data?
Whatsapp rolling out e-2-e to its 1b+ users was the most significant move in digital privacy ever, without most users knowing that it even happened.
Wow, great recommendation on the doc. Will check that out.
Dunno. They'll probably get another job and use that to sustain their real interests. Or maybe AI will automate everything and we'll finally enter the age of post scarcity. I'm an optimist. What'll probably happen is we'll descend even further into cyberpunk hell.
How did she get food?
the subhead is a misquote (as headlines often are), they actually said "No reasonable person believes that a Twitter clone just for conservatives is a viable business any more"

and goes on to say "While the Parler app as it is currently constituted will be pulled down from operation to undergo a strategic assessment, we at Starboard see tremendous opportunities across multiple sectors to continue to serve marginalized or even outright censored communities—even extending beyond domestic politics,"
This looks quite similar like the "Lagrange models" defined by Joris van der Hoeven in https://hal.science/hal-01188378/document, a version of Taylor models where the constant error term is replaced by an interval multiple of x^n.

Representing functions locally is a very interesting problem: there are lots of possible approaches using intervals, Taylor series, Chebyshev series, etc. Big open design space if you ask me.
But there weren’t Guinness judges around for that.
Again, the problem is not the code but the running service. If you are involved in processing a transaction, you are required to follow applicable laws and risk consequences if you don’t. The technical details might explain how you got involved but they don’t remove the legal requirement.
wow, thanks for the compliment! it hasn't always been easy, believe me.
This is offtopic.

To read the article I had to wait for the Play Store install an "instant app" that looks exactly like the website.

But when I tried to watch the video embedded, it told me that I needed to install the "full" app.

Why go through all of this when a good ol' website would've been more than enough?
It's an intriguing question. We still don't know.
I know there's companies that pay their employees the same amount independently of location (ie, an employee with skill level N in San Francisco earns the same amount as another employee with skill level N in Atlanta, Mexico City, Vancouver, Bogota, etc).

I'd be very interested in a site that compiles those companies.
Tailscale issue

https://github.com/tailscale/tailscale/issues/1543
Say what you will about Facebook, but its acquisition strategy has generally been strong.

Instagram has to be an all-time steal for what they paid for it. They also own What's App, a juggernaut in its own right.

Facebook's acquisition of Oculus was reasonable. It does remain to be seen if they can truly harness it or not.
Iirc the scoping is also very strange.
Certainly not as bad as mathematica, but bad nonetheless.
TLEs = trusted language extensions?
Do they require an interactive oauth2 flow too?
it's the side of the ship with the steering; the other side, port, was pulled up to the dock to keep "the steerboard" out of the way.
Unless I'm misunderstanding, the remaining third would be between the advent of agriculture and the industrial revolution.
I've thought about doing this from time to time. We have a horse farm and a "tiny home" type building out in the back, with a port-a-potty and views of horses and the sunrise could probably make a few thousand a month on AirBnB and pay for itself pretty quickly.

But then we'd have to deal with people :-(
Oh, I see, you mean the length of the flight displayed when booking it, rather than the length experienced when sitting on board it!
Hangfire and Oban are two other background job systems which have a commercial aspect. AFAIK Hangfire has been around almost as long as Sidekiq and is still actively supported.

I'm closer to $10m than $1m in annual revenue now.

My take on Sidekiq's secret sauce: a job system is a distributed system. Most of Sidekiq's commercial features are available as OSS gems but the complexity sneaks up on you as you integrate 3-6 of those features together. Building your own almost always leads to a worse system than the mature, well-debugged system which I have curated.
I agree. A great deal of "art that might sell" is already borderline repetitive, uncreative garbage. Maybe pleasant garbage, but still. Nothing anybody would be really interested in, except to add a bit of color to empty space. The more creativity you inject, the less likely it is to sell.
followed your map link, changed the filter and hit `apply`. can reproduce it now too