skysight-inc/HackerNews huggingface dataset:
Yeah, because we fill out the whole count rather than returning just the first page, a search that returns tons of messages will be slower than gmail. You can limit the set of returned messages with time ranges.

One of our slack messages is something that's become a bit of a cliche! "JMAP will fix it" - in this case, a lot of the cost is generating the message counts by iterating every match, and that's not going to be cheaper in JMAP. We don't have data structures that allow sorted partial search responses, so we can't generate the first page until we've resolved the search for every message :(
It's a shame it's not clear from the article why university students were testing emissions from a Jetta in the first place. Can anyone shed any light on this?
Because occasionally you use wrong length with wrong pointer and read or overwrite something you didn't want to.

It's more convenient and safer to have these two variables packed together as a "string object" and have string functions operate on that - then they always know where the string starts and ends in memory.
Yeah, Outlook is happier speaking its native protocol than IMAP unfortunately, and we haven't had much luck getting Microsoft to engage on JMAP, so I expect we'll still have two ecosystems even if JMAP takes off - just the open ecosystem will be more competitive.
They're elegant only if the sentence 'consider a model with a billion features' doesn't make you feel disgusted, I'm afraid.
Yeah, as a British person I never thought I'd have to be indignant about my national cuisine being so misunderstood.
running zimbra is a massive massive faff.

custom bundled ldap server with lots of java custom goop. Not fun to support at scale
When you say non-fiction, do you mean pop science books? I'd be very surprised if you grokked a math, hard science or programming book after just reading the first third introducing the subject.
This worry is why we try to keep in-house expertise for our key tools. That's what got me hacking on Cyrus about 8 years ago to fix some problems we had - and look at us now!
>I wonder how they did it.

From the article:

"The FBI has been criticized for what it called a “court-approved network investigative technique” used to unearth information about the suspects. It emerged that the agency, with court approval, seized and ran the pedophile website for 13 days in February 2015.

The FBI’s command of the Playpen site enabled the agency to infect over 8,000 users’ computers with malware and hack them. Notably, the site was said to be more efficient and even experienced a boost in audience numbers with the FBI in charge of its content."

This has been covered before on HN. See:

https://arstechnica.com/tech-policy/2016/11/fbi-operated-23-...

HN comments:

https://news.ycombinator.com/item?id=12930735
Let's be clear, CARB and the EPA would have completely missed this. It was specifically the work by the students. I do wonder if it was pot luck they got hold of a VW Jetta.

In the EU you have a similar cover up going on around diesel in general. For over 20 years people have known how bad diesel is, but the EU pushed it's low carbon emissions agenda promoting diesel cars and has not stepped back from it. Even now governments have successfully lobbied to relax the EU emissions limits.

The realistic option is to ban the sale of diesel cars and require all other vehicles to be retrofitted with NOx filters.
because squirrel mail is horrid. seriously, download it and install.

it makes you pine for oldschool outlook.
I wonder if random contributors are in a stronger position to resist patent trolls than Google: If you don't have any money, nobody will want to sue you.

Does the CLA actually help them with patents, though? If you use something patented without paying the license fee, it shouldn't matter who gave it to you.
Many countries already have VAT. And in the US, state and local governments levy taxes on a percentage of sales, which are paid by the buyer. If this were going to massacre gigantic numbers of businesses, or cause the number of people willing to go into business to drop to zero, it would have already and we'd have noticed.

So if a tax on money made from selling products is what's desired, this -- rather than an avoidable tax on profit -- is a way to do it.
FWIW, I finally signed up for instagram a few months back - mostly to post artwork. I had hesitated: I don't have facebook on my phone, after all, and figured facebook was enough.

Much to my surprise, It seems to be a much better platform for artwork and photography (most of my followers are posting the same, so generally interesting to go through as well). It will also post to facebook from the instagram app.
> but found the DSL to be too awkward to use in practice

I'm not a packager, but I can't read either.
Counselling Manchester
https://blog.fastmail.com/2016/12/13/fastmails-values/ we're really unashamed about charging money.

It means we don't have to spend time working out how to trick you out of money, or convince somebody else to give us money in order to hire our staff. I did an all-staff presentation last week at our quarterly meeting - by far the majority of the money coming from our customers goes directly to paying our staff. Hiring good people costs money, and running a good system requires good people!
That seems neat. I'll have to try and see if I can model my problem with that.
The optimization isn't in "move the cursor 1 character to the left", it's in "move the cursor 1 character to the left without moving your arm".
Well, if they can compromise the host website, they can change the published SHA hash.

Similar thing happened to TransmissionBT. For a while, their legit website was serving a hacked binary.

Pinned long-term public keys are the only way to verify this stuff. Even that isn't fool-proof if the rogues get commit access.
French Elections- What-If Scenarios
> To put it bluntly, your grandchild is likely to have a robot spouse.

I'll take the other side of that bet.
Ask HN: Would Uber be profitable if all cars (or a significant %) were robotic?
maintaining multiple legacy UIs is not trivial unfortunately

(hence the other comment further down this tree about having good protocols... I think that's the real way to solve people wanting unchanging UIs. Protocols change much more slowly than individual products)
ویژگی های کف کاذب آنتی استاتیک
> You're very welcome to comment on the IETF mailing list if you think you can make a compelling argument for having getMailboxes also take a filter allowing you to build a tree with "parentId": [null] and then use the IDs from each of those responses to create a "parentIds": [x, y, z] query.

I'm not invested enough to sign up to a mailing list and try to convince people to change a protocol. I'm only invested enough to fire off a comment on a forum I am already signed up to. I explained my use case above. Whether or not it is compelling is up to the reader to decide. Maybe I'm the only person in the World who has dealt with large hierarchies of mailboxes.

> Of course nothing stops you storing thousands of mailboxes in a non-heirarchical layout and making IMAP have large LIST fetches too.

Yes. I would issue the LIST command, and as the IMAP server started streaming the results to the client, I would immediately process each mailbox as soon as it was down, rather than waiting for them all to be retrieved. I fear that with a JSON based protocol, most server and client implementations wouldn't deal with streaming (although they technically could), and would just deal with completed blobs.

Does the Cyrus implementation construct the entire blob of JSON before beginning sending it to the client, or does it start constructing and streaming the JSON as soon as possible, before it has even fetched the entire list of mailboxes from whatever the backend data store is? The JMAP streaming solution seems like a more complicated solution for developers to implement than the IMAP streaming solution.

> (I do wonder - did your solution via IMAP still fetch everything each time, because in that case all you're doing is spreading that megabyte out over multiple round trips)

People were accessing this mailbox with many different clients. How each of those clients worked under the hood, I do not know. I did build a web frontend, and that web frontend worked efficiently, fetching only the folders that were being displayed to the user, and their immediate children. A user clicked a folder to expand it, and they would immediately see the pre-fetched child folders, and a new request to fetch those folders children was then triggered.
Firefox has VimFX, and it's awesome.
MIND-BLOWING VIDEO OF UFO OVER MEXICAN HIGHWAY GOES VIRAL
Elites have enough power to evade equalisation. They can:

1. Lobby and influence policy.
2. Shop for a tax effective jurisdiction.
3. Get the best tax and legal advice money can buy.
Does any of this matter when, people just don't care? In 2016 VW sold more cars than any of the years before, and surpassed Toyota as the world's largest automaker [1]. I understand that regulators could issue sale bans or fines or what not -- but these will be set in a small subset of countries only, and even there: "(VW) ...had continued to sell cars with illegal software, including 2015 models."

[1] https://www.usatoday.com/story/money/cars/2017/01/30/volkswa...
Cowboy pie sounds too ​much like cow pie for my liking. That probably has something to do with it never becoming a term.
ME is a separate processor, not a "ring" on the x86.

All this talk about "privilege level above normal software" and "ring -7" just muddies the water. It simply is a physically separate core running its own software which has access to all RAM and all PCIe devices and can program the Intel NIC to silently redirect selected packets away from the x86 cores to itself.
The 2nd amendment existed in 1942, but that didn't prevent the Japanese from being rounded up. We didn't decide to murder them, but we could have.
Except the problem doesn't seem to be the technology, just the way you were using it. You engaged in behavior there you don't engage in in real life (for pretty much the same reasons we don't do it in real life).

The problem with the internet and social media is a lot of people not realizing they aren't that different to real life, and have been getting less and less different.
> Not saying that is necessarily bad but you are stupid if you think the answer to everything is "well did you write a patch?".

I'm not sure why this tone is necessary. If someone just rants about a problem without even _trying_ to submit a bug report with a proposed patch that strikes me as laziness not foresight.

As a maintainer myself, I am well aware that maintainers will reject code if it disagrees with our view of a project. But how on earth do you expect us to know there is a problem without reporting a bug (the only reason I asked whether the author wrote a patch is because they went through the trouble of debugging the problem so probably are in a good place to write a patch anyway)? And if you decide to write an angry and ranting blog post rather than interact with us, we aren't going to be very nice to you either.
The hardest bit when building a client is that keywords are per-folder, so unless you store all the email in a single folder server-side, you have to run the keyword search in every folder, every time, and you can't get updates to multiple folders at once, so you have to re-run that search frequently, which hammers servers pretty hard.
Is there an open bug report? I have read the docs which specifically say "we don't care about leaked memory", but the brokenness being documented is different from it being a "known issue".

And, to be blunt, "it's never been fixed" should be written as "it's not been fixed yet" -- because you have an opportunity to fix it. That's how free software works after all.
> deep learning-based solutions lack mathematical elegance and offer very little interpretability of the found solution or understanding of the underlying phenomena

I disagree. Elegance and interpretability comes with one big flaw: assumption, lots of them. While deep learning based methods assume few or not. If they are so elegant why would them underperform? Probably it is because the problem we are trying to solve doesn't follow the assumptions, like convexity, etc.

In that sense, one can say deep learning methods are even more elegant, because they can work end-2-end. In that sense, NN can be a blessing, because now we got the answer, we don't need to assume anything, but just to DECODE it.
I'm starting to think that human resistance to change is a form of regularization.
Why is Google peeping over my fence?
Ok so Im a little creeped out right now, just saw google has added my back lane to their street view database, the problem is they are looking over my fence into my back yard. I am worried because what I thought was private has now been shared with the world! https://pbs.twimg.com/media/C_Nfay2U0AAX7Sx.jpg
This website is written in Arc (Lisp), I guess it's not "developer centric" as well
Yeah, I got tagged in to talk about Cyrus, as one of the Cyrus IMAP Board. But of course I'll talk about FastMail too, since we do most of the work on Cyrus these days.
Comprehensive is not the same as user friendly, or well paced, or organized in a way that will assist new people learning.

I've seen plenty of projects that were exceptionally well documented. Every method and class had inline docstring documentation, every module has a separate module docstring block. 100% PEP 257 compliance was enforced as part of the CI tool chain... helpful but only after I was sufficiently knowledgeable about the way the project was being used to get any benefit from it. The the sheer volume of documentation meant that many people had written extremely terse explanations, often devoid of any of the contextual information that would significantly improve someone's understanding of how the code in question was be used.

Point is... The volume of documentation or the percentage of documented features, has no direct bearing on its usefulness to any particular user.
> because they can work end-2-end

Agree. Not just end-2-end, but the same model can be applied to many different tasks. DeepMind's recent papers make progress in image generation, audio generation, language modeling & machine translation using the same basic construct of a masked dilated shifted convolutions.
Thanks, they're one of our top two contenders for a new home :) I was going to contact them last week, but the week became a bit busy because we had overseas staff in the office and wanted to use the time with them for face-to-face tasks.
In other words, it modifies global state.
Any of those services for shipping you binary blobs with no open source code. None of them were trustworthy.
Show HN: Ivia.js – A MVVM Framework for JQuery with Vue-Like Interface
I sure hope you're not similarly disgusted by "consider a computer with a billion transistors".

Computer Science is full of abstraction and complexity. Denying it to machine learning seems conservative and naive at best.
We patched Cyrus extensively to provide the cross-folder searching stuff and other non-standard stuff we needed to make our interface fast. It's all in the upstream project now (and in the 3.0 release), so anyone can use it. No standard IMAP client will speak it of course, and we strongly discourage it. We'd prefer people use JMAP, which is documented and working towards becoming a standard. It's also in 3.0 :)
The transformative power of doing absolutely nothing
Elad's pretty clear in laying out how pre-deep learning denoising research is differently elegant compared to CNN, etc. You should also consider the context, SIAM- the applied math community, which has seen a lot of work in deep mathematical connections between PDEs, denoising, etc. The math is certainly more advanced than required for understanding deep learning and applying it to achieve better results.
elegant, adjective: (of a scientific theory or solution to a problem) pleasingly ingenious and simple.

One easily-described approach that is state-of-the-art in a massive number of domains? That's pretty f'ing elegant.
Hey excellent, maybe you can explain why <...> :p
requires all algorithms to "explain" their reasoning

It's about the application. If you are detecting cat images on a social network, then a few false positives or negatives are totally no big deal. If your algo is making investment decisions or is being used as evidence in court then it is entirely reasonable to expect it to have a rock solid causal chain easily comprehensible by a layperson. The example in the article is noise reduction and the method was "we tweaked it until we got the results we wanted". In many fields that's called "overfitting" (or "fitting up") and is a big red flag.
See also cplint and the included example programs, using both regular Prolog and probabilistic extensions:

http://cplint.lamping.unife.it/example/examples.swinb
http://cplint.lamping.unife.it/example/inference/inference_e...

The github repository of cplint is:

https://github.com/friguzzi/cplint
Exactly why are you suggesting that US senators are a credible source of information in this matter?

US senators have also said that there are weapons of mass destruction in Iraq, and that Assad used chemical weapons against the Syrian population. In both cases, credible information has never been put forward to the public.
VHDL – hardware description lang and  general purpose parallel programming lang
I work for Owlstone Medical as a software engineer, so ask me any questions and I'll try to answer as best I can.

Also, we're hiring! https://www.owlstonemedical.com/about/careers/
Huh, I've been extensively using custom IMAP flags/labels with Opera M2. It worked great.
>It's transparently obvious that Apple's subsidiaries in Ireland and the Netherlands exist purely to evade taxes.

To avoid taxes? Sure. Tax evasion is a crime, though, and they haven't even been accused, let alone convicted.

>However their lobbying and economic power have protected them for years, which may have broken recently when the EU determined that they owe $14 billion for illegal benefits...

The issue for the EU revolved around whether Ireland must tax Apple under EU law, not whether the profits Apple is recognizing in Ireland can legitimately be recognized in Ireland.

>So to answer your question, New Zealand has an agreement with all of the companies that they recognize their revenue and expenses and pay tax on the difference. When Apple New Zealand says that they owe their Irish counterpart hundreds of dollars per phone for licensing, and the New Zeaand authorities see that it's an obvious tax dodge shell company, they can and should question whether those hundreds of dollars fall into form vs substance. There is no actual business purpose to pay licensing fees to an Irish subsidiary that was gifted huge amounts of Apple IP.

You're still sidestepping the question. I didn't ask whether tax authorities in New Zealand have an interest in making sure Apple pays what it owes in New Zealand. The question was why would New Zealand care whether or not Apple pays Irish taxes in Ireland.
West Virginia University has the Center for Alternative Fuels Engines and Emissions as part of the engineering school, and they test lots of different vehicles and engine technologies. http://www.cafee.wvu.edu
You can do regression

Exam score= cat_a + cont_b + err

but how do you say something like cf male female has 10 score advantage and family income impact is ...

Can Galileo invent physics by doing nn
Yes competition and alternatives are critical
Well here's an argument for interpretability: how do you know when your model will fail?

One tradeoff might be that with deep learning, it's unlikely to fail, but you won't know when it will. With conventional methods, you may not get as good of a performance in comparison, but have a better sense of the domain of applicability because you have a better understanding of the feature space (for instance, you can determine similarity of new data in this feature space when it arrives to determine whether it is similar to past data your model has been trained on).
What would be wrong with cow pie? I would have thought beef pie would be very popular in the US?
Zomato and Inuit are very famous also in Europe, plus satisfied client always give a professional look and social proof
Personally I run Arch on my desktops but NixOS on my servers. I mostly use Arch because of all the relatively uncommon stuff I occasionally use from the AUR (somehow I doubt STM32CubeMX or ESPtool will enter Nixpkgs any time soon), but I've occasionally ended up cursing that I couldn't do a Nix-style rollback when an update broke something important.
a "cow pie" is cow droppings - manure.
Sadly protocols are made by those who show up and put the effort in.

I'll pass a link to this comment on to the list and see if others chime in. The downside of allowing filtered getMailboxes is more protocol complexity, but maybe it's worth it.

On to the next topic:

Cyrus creates the entire blob. Even when it's streaming a LIST reply it still batches a lot in memory. You'll discover pretty fast if you don't do that, you might wind up holding a lock for a LONG time if you're trying to build consistent replies and the remote end is on a slow network link or just consuming slowly. So we batch all replies right now.

If I was building a brand new product I might use an engine which supported MVCC (like Postgres database for example) and hence have flexibility. Having said that - even then you might find that a server talking to slow clients would want to buffer to temp file and free up memory and locks while it streamed the data.

With HTTP we get around this by having nginx handle all the mess, so I guess that's what will happen with JMAP too, nginx buffering large bodies to disk.
The leakyness here was the Dev, would likely be the Dev again, just pre-github
HTTP/2 with Server Push Proof of Concept for ASP.NET Core HttpSysServer
"then several things happened in a very short time: about two months ago HN user greenpizza13 pointed me at Keras, rather than going the long way around and using TensorFlow directly (and Anaconda actually does save you from having to build TensorFlow). And this in turn led me to Jeremy Howard and Rachel Thomas’ excellent starter course on machine learning."

This is why you read HN. Interesting though had Jacques not made the original attempts I don't think the payoff above would have been as useful.
It may be worth mentioning, if you want to avoid systemd, that Guix has a Scheme-based init system called Shepherd:

https://www.gnu.org/software/shepherd/
I was sure I had used browsers which did that, if I didn't then sorry, I must be hallucinating.

I wouldn't call it FUD, I'm not suggesting don't use JavaScript, and we are already talking in this article about one crazy workaround because of the weirdness of modern jazz development!

The "this is JavaScript after all" referred to JavaScript tending to continue after errors (which it does in some cases, like a bad callback, or a whole file which didn't parse).
Don't you find that when you meet people in real life, they then refer to something on their or your Facebook feed?

Sometime ago, I put up a music video and yesterday I was chatting with a friend who had seen it.