skysight-inc/HackerNews huggingface dataset:
Coming from a Ruby background I've always been curious about Python's libraries for scraping. I've tried scrapy and beautiful soup, but somehow kept going back to Nokogiri and mechanize.

I found the CSS selector or xpath based syntax and the DSL to be a lot more convenient and less verbose to deal with.

Is selenium still the best bet for parsing JS powered pages these days? I was under the impression that headless chrome was more memory / performance efficient.

I do a lot of scraping work but my methods have not really evolved in the past 3-4 years, always on the lookout for something more elegant / quicker.
Smarking (YC W15) Is Hiring Back-End Engineers in SF
Residential streets are mostly limited to 30 km/h here and even the largest inner-city streets have a limit of 50 km/h which is rarely reached due to traffic jams, traffic lights etc.
I want both.

I want 2TB of space and the speed of an SSD, and I don't want to pay much.

Hybrid hard drives seemed like the perfect solution (a few GB of flash, combined with a 2TB drive).

Sadly, nobody managed to get decent performance on hybrid drives. As far as I'm aware, none really had a good grasp of the filesystem, so none could make decisions like 'these small dll files will likley need low latency reads, stick them in the flash, while these massive mp4 files will probably be streamed, leave them on the hd'.
Largest brain imaging study identifies drivers of brain aging
A single passenger vehicle could have this.

The (American) market has shown that people overwhelmingly do not like small personal cars when presented with other options, without the distorting effect of subsidies and tax breaks.
Colonialism is a loaded word, but if you look at India trying to force cell phone companies to manufacture in India I think there is a clear desire to drive economic development through policy. I don't really blame them either, China offers a pretty compelling example of what state intervention in the market can do.
https://www.nature.com/articles/s41586-018-0041-2

I'm assuming OP's referring to the bleaching caused by global warming. 2016 event killed off 29% of the coral there.
> I don't think even the biggest Rails zealot would advocate building Google Maps in Rails.

Rails excels at being the web layer in this situation. All the heavy lifting is done by the DB to spit back feature structures or do routing and native libraries to do image composition.
Somewhat related - "Game Engine Black Book: Wolfenstein 3D" [1], by Fabien Sanglard.

Of course this is a very different book: it includes detailed reviews of the engine's source code, and translates complex concepts with ease. Plus the print edition is beautiful and colorful (which is a must for a game book).

[1] https://www.amazon.com/Game-Engine-Black-Book-Wolfenstein/dp...
The first time I tried Lubuntu, was on an old, no-name brand laptop with Windows XP, that a friend gave me. Installed in a few minutes, and was pleasantly surprised how performant and usable it is, considering the limited hardware resources. I mostly just use it as a browser and book reader, but for giving new life to old laptops, I think Lubuntu works great. Not sure how much of a threat to the market it is though.. Hopefully it provides an open-source option for educational purposes and the "next billion" in the developing world.
It's even worse than that. There's 2 types of crap now: vendor crap and Windows crap.

You can avoid vendor crap by reinstalling a fresh version of Windows from Microsoft, but you'll still get Microsoft crap (i.e., various apps from the Microsoft store pre-installed with links prominently displayed on the Start menu).
For political, other major events or sports betting, normal brokers are more efficient. They have spread something like 5% or less. Financial markets can be even more efficient. Existing betting markets typically take something like 10% for the same bet. There is little reason to go to them unless there are some rare arbitration opportunities.

I think these new prediction markets should differentiate from traditional betting markets in some meaningful way.

One possible idea: marketing the skill. Turn prediction market into expert market. People would invest money to experts (individuals, syndicates even algorithmic syndicates).

Rough idea: trading is anonymous until the underlying is settled. Then the market participants get a cumulative score they can use to sell their experience and get investors. The system would show the expected value form investors, quantified risk and uncertainty. Individual investors and investor syndicates can start with very little cash and demonstrate their skill. Complete nobodies could become renowned experts over time and sell their expertise.

This would could be very good way to provide value in emerging markets. Some Kenyan or Vietnamese market or political analyst could emerge from nothing over few years and sell their expertise to bigger players without PowerPoints, marketing skills and connections.
My roommate (about average technical literacy) tried getting a $100 laptop and putting Lubuntu on it, and ended up selling it because he couldn't figure out Linux and couldn't get any good games on it.
You can achieve 20+% biking mode share in wintry places like Finland: https://torontoist.com/2017/02/what-toronto-can-learn-about-...
>A similar story happened with communist cuisine

Let's be clear about this though. The communist government mandated the specific recipes. It wasn't something that developed organically.
Ask HN: How to organize personal knowledge?
In the last few years I have collected a large amount of ebooks, papers, articles, movies, pictures, etc. (all digital).

I am at a point where I would like to organize these items into a cohesive, searchable and maintainable system. I have looked at various methods (e.g. Niklas Luhmanns "Zettelkasten", Zotero, Org-Mode) and I am not satisfied yet. Any tips?
How much of a lifetime could a device with soldered on 2GB of RAM and 32GB of eMMC storage have? How much repurposed could it be? Pricier Chromebooks with HiDPI screens and Core-M or better processors are still castrated in one way or the other comparing to general computing devices, yet approaching their price levels. What's the point for a developer? "It just works"? "It's just safe!" due to mandatory secure boot and BIOS reflashes? "Hey, look ma, a cheap computer, let's buy it as a gift!" for regular Joes?
One thing I got out of this video is the concept of "quantum of utility". It was to answer the question "When to launch?" -- launch when you have something that someone can use that wasn't there before, a new feature.
The problem with starting from scratch for an Excel alternative is the classic quote : "Everyone needs 10% of the features Excel offers, but is a different 10%."
They'll still have the $200 ones... Paying $600 is for people who want to have multiple tabs open at once.
I could! Maybe it was a clicker though, don't remember, just that I could hear it.
it seems the article boils down to the autonomy puzzle in Tesla. Could Tesla make the autonomy a realization with their approach? would waymo approach be better in the future?

One thing I think that is missing, although it mentioned people love their Tesla and so is other thing in life. It is the fact that I felt that this is derived from the way Tesla designed the car, it is intuitive just like when the first Iphone introduced. There is no whistle and bells like the traditional car. Just like iphone compare to Nokia.

My big take away is harder for the car company to become a software company than a software company become a car company. Not to mentioned as a car company, it has lots of 'legacy' or baggage that they have to deal with.

The works is two times harder I think for an incumbent to become a software company as a compare software company to become a hardware company.
First: As an incumbent they have to unlearned the old way of doing or thinking about what a car company is.
Second: If they are successful at the first one, then they have to learn how to do the software.

While for Tesla, is only 1 step which is to learn how to make car (about the hardware). Tesla does not need to unlearn about things because it has no legacy.

In my experience it is harder to unlearn about things rather than learning about things. I might be wrong :)
So for $350 you can buy much better laptop on ebay.

Example: https://www.ebay.com/itm/HP-PROBOOK-650-G2-I7-6600U-8GB-256G...
Or the stock market will adjust to the predictions and any advantage will be lost.
Awesome!
But why rare to see game development in plain C comparison to the other languages like C++?
Well, if you fail at improving Libre Office to a state where you're satisfied with it, you still improved Libre Office. If you fail to write something better than Calc, all effort is lost.
A lot of people discredit Jobs' creative vision due to disliking his personality, and, if they're engineers, like to overemphasize Woz because he's an engineer.
Honest question, what's the appeal of working at a place like Facebook these days? It seems like a pretty well known fact that they're a horrible company in terms of their "product" (advertising and data mining). Is it money and experience? Being in my 40's with 2 young kids I don't think I could ever bring myself to contribute to a company like that.
Do you understand where I'm coming from?

I do. You should try to get to a different place.
In classic tech journalism fashion, no mention or even apparent knowledge of Microsoft's own efforts in this area: Polaris, Core OS, OneCore, and CShell [1] [2]

[1] https://www.windowscentral.com/understanding-windows-core-os...

[2] https://youtu.be/F_bPcctTV_Y
And boom, you are old.
Conversation on LSD - https://youtube.com/watch?v=rjylxvQqm0U

This 62-minute video was recorded at a private party in Los Angeles hosted by Oscar Janiger, where thirty pioneers of psychedelic research gathered for an "LSD Reunion". Folks in attendence included Myron Stolaroff, Sidney Cohen, Al Hubbard, Timothy Leary, Oscar Janiger, Humphry Osmond, John Lilly, Laura Huxley, Willis Harmon, Nick Bercel, and others.﻿
I don't think "2% or 3%" was very realistic, but you have to remember that when the iPhone first came out it wasn't very good. I didn't have 3G, GPS or App Store (nor a couple of other things). Apple was certainly ahead, but the market also wasn't ready nor big at that. When it actually matured there were a couple of solid offerings including from Microsoft, which among other things had arguably better design than Android. But at that point the market was moving on. The non-Apple market was no longer about selling the operating system or phones but apps, ads, components or accessories. If people want to go "Haha Microsoft" I guess that is fine, but they didn't lose to Apple.
The Xiaomi Air 12 is really good quality for ~$550 if you go for the m3 CPU. It's fanless (but only 4 GB of RAM), which is something I love.

It's a different price point than Lenovo. Much cheaper. They are good ultrabooks.

Regardless of the CPU you choose (e.g. i5 has 8 GB, but it's not fanless), all 12 inch models have Intel components only, including the wireless card. It's one of the few laptops that truly runs well on Linux out of the box with zero glitches.

Only a few classic Thinkpads are better, with even good ACPI support for battery discharge events. But that's really rare, and does not make much difference if you run a HAL like UPower to abstract your ACPI-battery.
For what it's worth I find the Nurburgring record lap done last year with an Alfa Giulia even more ridiculous (https://www.youtube.com/watch?v=5gEdJmIVqLY). The 919 is a unique super-car while the Giulia QF is almost a "normal" car, which one can see parked while shopping at Whole Foods.
Apparent Evidence for Hawking Points in the CMB Sky
In theory, once that happens, anyone who does not have insider trading knowledge will leave the market, either because they keep losing and don't like that, or because they run out of money to lose.
If I remember https://sideways-view.com/2017/02/19/the-monkey-and-the-mach... right, it suggests that this sort of problem comes down to a misalignment or mistrust between your conscious agency and the rest of your brain -- that is, the 'deliberator' and the 'monkey'. If whatever you're doing isn't getting the monkey enough bananas over time, it doesn't care how effective you are at getting Zorkmids or whatever such nonsense you consciously value (nonsense from the POV of the monkey), and it will intervene. The most obvious intervention feels like I-don't-wanna -- find something else to do -- anything else.

Tactical interventions ultimately fail because the monkey, not the deliberator, has its hands on the levers. The monkey can learn that letting the deliberator do its thing and earn zorkmids will ultimately also bring in plenty of bananas, but that has to be true for it to work in the long run.

(I may be adding a few of my own thoughts about how this monkey-and-machine business applies to procrastination -- I don't remember if those were on that long page.)
which is really unfortunate, there were some killer flash website with really subtle layout, animation and aesthetics that I haven't seen yet in any HTML5 websites.
The knowledge and insights pg has deserves more conversations like this
Please tell me which of this things you cannot do on Linux right now.

With Gimp you can do a lot of what you can do with Photoshop.

TeX and any math package like R beat Microsoft Office and produce better documents.

WordPerfect was a much better alternative to Microsoft Word, but guess what happened: Microsoft invested on Corel and suddenly they stopped releasing on Linux.

There's a lot of money invested in making Office a monopoly. By supporting Office and spreading its use you are extending that monopoly further into another generation.
There was recently a class action over this practice: https://www.bleepingcomputer.com/news/google/google-agrees-t...

You should act quickly to either submit a claim as part of the settlement, or exclude yourself from the settlement: http://www.adsensepublishersettlement.com/

I would look over the terms of the settlement and see if they work for you ASAP, since the deadline is in 3 days.
Google is human unfriendly. They only care if their bottom line is in danger. Make a lot of noise on social media(involve your user base if possible.)

You probably thought of this already but why can't you sue them? Even if you lose,you might at least get a review of the ban. Do they have a non-arbitration TOS?
It's actually not as hard as you think for experimental design to show strong causitive effects - I think randomized controlled trials (in animal and then human models) and meta-analysis are much more effective than epidemiological studies (which don't have effective controls, often don't appropriately correct for other factors, or are specific enough to target specific lines of inquiry and allow spurious conclusions to be drawn).

I've just started doing my own research digging through the literature in PubMed and there's a huge amount of research over the past decade especially that's really advanced our understanding of nutrition and metabolism (that sadly, has yet to get full traction in conventional wisdom/popular science).

Just a few examples from my collection on fasting (at this point I'm tracking hundreds of publications covering a whole range of different aspects of nutritional science, and this is only over the course of a couple weeks of research):

Nørrelund, Helene, K. Sreekumaran Nair, Jens Otto Lunde Jørgensen, Jens Sandahl Christiansen, and Niels Møller. “The Protein-Retaining Effects of Growth Hormone During Fasting Involve Inhibition of Muscle-Protein Breakdown.” Diabetes 50, no. 1 (January 1, 2001): 96–104. https://doi.org/10.2337/diabetes.50.1.96.

Bhutani, Surabhi, Monica C. Klempel, Reed A. Berger, and Krista A. Varady. “Improvements in Coronary Heart Disease Risk Indicators by Alternate-Day Fasting Involve Adipose Tissue Modulations.” Obesity (Silver Spring, Md.) 18, no. 11 (November 2010): 2152–59. https://doi.org/10.1038/oby.2010.54.

Harvie, Michelle N., Mary Pegington, Mark P. Mattson, Jan Frystyk, Bernice Dillon, Gareth Evans, Jack Cuzick, et al. “The Effects of Intermittent or Continuous Energy Restriction on Weight Loss and Metabolic Disease Risk Markers: A Randomised Trial in Young Overweight Women.” International Journal of Obesity (2005) 35, no. 5 (May 2011): 714–27. https://doi.org/10.1038/ijo.2010.171.

Chaix, Amandine, Amir Zarrinpar, Phuong Miu, and Satchidananda Panda. “Time-Restricted Feeding Is a Preventative and Therapeutic Intervention against Diverse Nutritional Challenges.” Cell Metabolism 20, no. 6 (December 2, 2014): 991–1005. https://doi.org/10.1016/j.cmet.2014.11.001.

Rothschild, Jeff, Kristin K. Hoddy, Pera Jambazian, and Krista A. Varady. “Time-Restricted Feeding and Risk of Metabolic Disease: A Review of Human and Animal Studies.” Nutrition Reviews 72, no. 5 (May 1, 2014): 308–18. https://doi.org/10.1111/nure.12104.

Fontana, Luigi, and Linda Partridge. “Promoting Health and Longevity through Diet: From Model Organisms to Humans.” Cell 161, no. 1 (March 26, 2015): 106–18. https://doi.org/10.1016/j.cell.2015.02.020.

I should add that the evidence was so strong for certain behaviors that I have changed my diet (VLCHF + 16+:8IF) and n=1 shows immediate improvements in weight, energy, mental clarity, and even skin health. Somewhat unexpected because I wasn't eating that badly according to common wisdom (and have maintained a moderate overweight, but stable weight for the past 3+yrs).
"Most" people definitely do not use photoshop, the most popular photo editing tool is probably the one that comes with your phone's photos application.
all things so small no one has ever heard of them though
Why tourism is killing Barcelona – a photo essay
As well as the bloatware added deliberately by Microsoft that's already mentioned, this method can't touch spyware and bloatware that's automatically reinstalled by the BIOS after reinstalling Windows.

Unsurprisingly, the only company I could find evidence of actually having done this is Lenovo:

https://betanews.com/2015/08/13/lenovo-bios-tool-prevents-cl...
> "As India sets the new rules of the game, it is seeking inspiration from China. Although India does not want to go as far as China, which has cut off its internet from the global one, officials admire Beijing’s tight control over citizens’ data and how it has nurtured homegrown internet giants like Alibaba and Baidu by limiting foreign competition. At the same time, regulators do not want to push out the American internet services that hundreds of millions of Indians depend on."

This is the main point. The main reason the government wants data to be stored locally and is also looking at controlling companies is for surveillance. But unlike China, not all platforms have Indian created equivalents. Fortunately for the citizens of India, regardless of the state of surveillance in the U.S., the U.S. companies do fight a lot more against these controlling measures than any Indian born company ever would. Indian companies like Reliance Jio, which considers "data as the new oil" (the parent company, Reliance, was built on crude oil), and many others have had a thirst for more data for sometime now. [Incidentally, the logo of "Jio" is a mirror image of "Oil" in a certain font]

> “There is a strong feeling in many quarters that the reason that India has not been able to develop a Tencent or Baidu or Alibaba is because we have not been nuanced in our policies.”

This sounds kind of naïve. It's not because of data related policies that these haven't happened.

> "Officials were furious after the Cambridge Analytica scandal this year revealed that Facebook had shared private information on 87 million users, including 560,000 Indians, with a political consulting firm that had sought to influence Indian elections."

This is ironical, because the governments (both central and state governments) didn't even acknowledge issues or took responsibility or made a statement that data leaks from their own sites would be dealt with seriously. Their game is like this — "if we leak data, then it's not an issue, but if someone else is, then we will be outraged". It's just pseudo-nationalistic sentiment that the current central government has been fostering. A search for "Aadhaar data leaks" will show many such instances and the lack of a decent response from the governments.

> "They also warned that India has fewer legal protections than the United States against government searches and data requests, so private data stored in the country could more easily end up in the hands of the police."

This is very true. The central government has shown that it has very little interest in getting a good privacy law in place. The one recently released publicly has so many issues that concerned citizens have started https://saveourprivacy.in/ . Please share this site with every Indian citizen you know.

As an Indian citizen, my only hope is that foreign tech companies resist the crippling moves by the executive. The courts move very slowly, but they're the (mostly) dependable arm here.
This will display the video as ASCII art:

vlc -V aa <youtube link>

For color ASCII he suggests

vlc -v caca <youtube link>
Atomization and social alienation has long been a charge against capitalism as a system. It's interesting that this trend is similar in both the US and Japan, so can't really be explained by something like American car-centric infrastructure.

A tangentially related article that this brings to mind: http://julesboykoff.org/wp-content/uploads/2013/06/Boykoff_L...
He provided an argument. It's the 4th paragraph of the blog post, ending with "and I end up with bloated higher level data classes rather than easy to understand tuples or dicts that contain the data in a dumb simple format that is trivial to introspect."
Personally not so much in model code, but in typescript interfaces/DTO which are used by both routing-controllers on the server side (additionally generating swagger api docs along the way) and by mobx on the frontend.
If they can be developers, they can learn SQL. Apart from DDL statements, it's literally 3 DML statements, of which most of the clauses operate exactly the same way across all 3 statements.
Great idea but your website seems to be using very old style. Its not working properly on mobile.
Air 12 inch, Intel HD Graphics:

https://arstechnica.com/gadgets/2017/05/xiaomi-air-12-review...
They exported their best talent to innovate for other countries. The only way they can capture some of the wealth these innovations create is to force manufacturers to do it in country.

Strange that they see no value in creating and more in manufacturing.
> just add a Promises polyfill and it's compatible with IE9.

I don’t disagree. It just wasn’t clear if the parent was looking for “native only” support or support with polyfills. Though given that this library itself is basically a polyfill I don’t see that really being an issue.
> Will these more upmarket Chromebooks (which have x86 CPUs and acceptable RAM & storage) be OK to run any regular Linux distro?

Yes, with the caveat that full BIOS/UEFI support sometimes lags hardware releases by 6-12 months - out of the box most Chromebooks can only boot ChromeOS. Pretty much all the Chromebook firmware work to support 3rd-party OS' is done by one guy, see his page here: https://mrchromebox.tech

I run Arch on a cheap Chromebook for some tasks at work, I've generally been satisfied, and will probably buy another one eventually. I think if I was spending $500+, I'd just buy a Windows laptop and reformat it though - way more choices, and they tend to be upgradable.

It's also worth keeping in mind most Chromebooks must be disassembled to remove a firmware write-protect screw in order to flash new firmware. The one I have requires removing the battery/keyboard/etc - more than just popping off a small panel on the bottom.