skysight-inc/HackerNews huggingface dataset:
Hello everyone!

Its been 2 and a half months since I posted https://news.ycombinator.com/item?id=21263839

I've made a lot of progress. The most significant thing is certainly the demo! (https://www.ditabase.io/demo.html) I only knew vaguely how the actual product would look, and the demo forced me to put it to code.

This resulted in two important changes:
1. No more schemas, only objects
2. Dit is the real product

Objects take the place of schemas in every way. I can no longer picture what exactly you would want out of a schema that you can't get with an object. They cover schema relationships, and because of the way scripts work, every object can use a different language and it doesn't matter. Schemas seemed like a headache, but object orientation is very simple.

Then, the only logical delivery mechanism is a single file type like dit. Whatever you want that's related to DitaBase can be neatly packaged in a dit. That includes all the things I know about now and all the features I might want to add in the future.

The very next thing is certainly the MVP. This will consist of a CLI Linux app that validates dit files in much the same way the demo does. I am optimistic that I can release that by February 1st.

I am looking for feedback almost exclusively on the demo, and whether it makes sense to you as a first product. What projects can you picture using it for? What features seem make or break to you? Do you still think it's a terrible idea? I want to hear it all.

And to be clear, I realize that many of you are probably not my first users, but you are developers. In the future, I hope all of you will be users, so your feedback is still important.

Please let me know what you think!
Why some rope knots hold better than others
You don't become a $1.2T company by surfing a wave. Its stock price has more than quintupled. IBM's stock price is almost flat over 10 years. GE is down over the decade. Changing direction for a ship that large is very, very hard--a seemingly intractable problem but not for the model Microsoft has provided.
Africa... starvation and primitivity

There are some African countries richer than Eastern European countries.

This sucks...
Does anyone know why exactly they would do something like this? Is it because it forces users to scroll more and thus take longer for people to consume content (so more opportunity to show ads)? It looks like a disaster.
Re: PyTorch TPU support, has anyone checked it out beyond "it works"?

There are many aspects of TPUs that I'm not convinced are easy to port: Colocating gradient ops, scoping operation to specific TPU cores, choosing to run operations in a mode that can use all available TPU memory (which is up to 300GB in some cases), and so on.

These aren't small features. If you don't have them, you don't get TPU speed. The reason TPUs are fast are because of those features.

I only glanced at PyTorch TPU support, but it seemed like there wasn't a straightforward way to do most of these. If you happen to know how, it would be immensely helpful!

As far as predictions go, AI will probably take the form of "infinite remixing." AI voice will become very important, and will begin proliferating through several facets of daily life. One obvious application is to apply the "abridged" formula to old sitcoms. (An "abridged" show is when you rewrite it using editing and new dialog, e.g. https://www.youtube.com/watch?v=2nYozPLpJRE. Someone should do Abridged Seinfeld.) AI audio as already made inroads on Twitch, where streamers like Forsen allow donation messages to be read off in the voice of various political figures (and even his own voice). The Pony Preservation Project was recently solved with AI voice (https://twitter.com/gwern/status/1203876674531667969) meaning it's possible to do realistic voice simulations of all the MLP characters with precise control over intonation and aesthetics.

Natural language AI will continue to ramp up, and people will learn how to apply it to increasingly complex situations. For example, AI dungeon is probably just the beginning. I recently tried to do GPT-2 chess (https://twitter.com/theshawwn/status/1212272510470959105) and found that it can in fact play a decent game up to move 12 or so. AI dungeon multiplayer is coming soon, and it seems like applying natural language AI to videogames in general is going to be rather big.

Customer support will also take the form of AI, moreso than it is already. It turns out that GPT-2 1.5B was pretty knowledgable about NordVPN. (Warning: NSFW ending, illustrating some of the problems we still need to iron out before we can deploy this at scale.) https://gist.github.com/shawwn/8a3a088c7546c7a2948e369aee876...

AI will infiltrate the gamedev industry slowly but surely. Facial animation will become increasingly GAN-based, because the results are so clearly superior that there's almost no way traditional toolsets will be able to compete. You'll probably be able to create your own persona in videogames sooner than later. With a snippet of your voice and a few selfies, you'll be able to create a fairly realistic representation of yourself as the main hero of e.g. a Final Fantasy 7 type game.
Missing the third - access.
I predict the internet becomes addictive to a point where we will start seeing regulations and advisory for kids to stay offline. I'm already seeing parents my age being concerned about their kids.

Also, there will be a niche demand for people who go online and manage online life / identity for these people.
On iOS, you can use AdGuard or other blocker and create custom blockers to block all those popups.
Preventative care might not save money, but in a nationalized system which is funded by tax collection, having participants healthy so that they can live longer and pay more taxes sounds like a good idea.

I feel like it's not only a moral argument, instead it's a better alignment of those who pay and are served by the system. At present, the goals of insurers and providers are very different from patients, partly due to profit-seeking, partly due to the disconnect in who pays for it (49% of US population receives employer-covered healthcare).
Sales Impact from Using Klarna's Pay Later
IANAL You find yourself in BFOQ (bona fide occupational qualification) territory here — sometimes stated as "blind people can't be bus drivers".

For an NFL player, running speed is clearly a BFOQ. For Hooters the case is more complicated (IIRC there is case law)
Reminds me of "Artist Asks People to Draw a Bicycle from Memory and Renders the Results" https://twistedsifter.com/2016/04/artist-asks-people-to-draw...
Thanks for the feedback. I don't consider myself a world-leading expert on neural networks by any means.

I do want to point out that I'm thinking of doing this on a very limited website, not a general purpose thing that replicates any possible website. When I imagine the complexity of a modest CMS or an online mortgage calculator I think that it is much less complex than translating human languages. The fact that web code has to be so much more precise than human language actually makes the task easier. But to be fair, I'm all talk at this point with no code to show for it. So I will keep these comments in mind, this thread has been helpful for helping me think through some of this stuff.
Tesla patents new battery cell chemistry
Plausible scenario, with VW, Toyota and Honda taking their head out of ass and go full hog on Electric.
Some bold predictions. Many may not come true:

1. Intel loses its lead in the data center and in laptops/desktops. This will be lead by Apple replace Intel with their own CPUs later this decade, AWS continuing to build out their ARM offerings, and AMD biting at Intel’s heals on the low end. A competitor from China may emerge, but won’t penetrate the US market due to national security concerns.

2. Boeing will require a government bailout. The Boeing brand never recovers from the Max incident. China starts to compete with Boeing and captures some of the Asian market. The allegations published this year of poor manufacturing practices start to materialize in the late 2020s with Dreamliners falling out of the sky.

3. Social program reform. Medicare goes insolvent causing either (1) an increase in taxes, (2) a cut in benefits, or both. Ditto on many pension funds

4. Climate change starts to cause major displacement and famine.

5. Rudimentary knowledge of a programming language will start to become table stakes for getting a job in developed economies. This won’t fully occur for several more decades though. However, companies will start to realize that the optimizations that can be rendered through “low code” methods has already been rendered.

6. I say this as someone pursing an MBA — MBAs will become less valuable as a degree.

7. Bitcoin bubble bursts for mainstream users. It’s niche will be a payment method for “hostage” software and sanctioned nations to launder money.

8. Brexit leaves the UK economy looking a lot like Japan.

9. A millennial will become president of the US.

10. Some kind of “offline” movement that’s on par with Yoga — people brag about it being good for health.

11. Still no fully autonomous self driving cars.

12. Google and Amazon lose their luster as employers. Microsoft gains more clout as an employer.

13. Ethics becomes a central part of corporate decision making. This isn’t driven by wanting to be good but rather what I’ll call the Susan Fowler effect where a single contributor can bring down a CEO with a blog post.

14. Company valuation currently tends to track revenue growth. I think it’ll move closer to something like EBITDA growth or operating cash flows growth over the next decade.
i personally love keeping pets and eating bbq, but agree that both will be considered completely barbaric in the future
Your argument is not supported by data. The NHS and Canada's universal healthcare systems have been around for decades.

Yet there is no evidence to suggest the factors you describe have ever been part of the public discussion in those countries. And the US is the country with the most draconian drug laws in the Anglosphere.
Do they release this data?

Also how's the user acquisition and retention rate as compared to traffic?
I don’t get it. The iPad Pro is a touch device. I use an old Magic Keyboard with an iPad Pro 10.5 (2017) because the “smart” cover keyboard I got from Logitech with that “magic” connector is flimsy and doesn’t always work right (fails to power-on frequently). For touch interaction, the iPad screen is close enough that a touchpad seems both redundant and only marginally faster than just touching the screen. I use the protection case and stand from the Logitech keyboard case, but it’s much nicer to have the keyboard and display separate so that they can be adjusted and setup individually depending on position: sitting, lying, standing, etc.
1. I'll go against the herd and say China won't collapse but continue to grow and in 2030 China will be the largest economy in nominal GDP terms by a significant margin. Also, Sino-American trade will be at its highest ever in 2030.

2. India will grow and easily overtake Japan to be the 3rd largest economy (nominal GDP) in the world.

3. Vietnam and ASEAN will be the fastest growing economies ( country and region ).

3. VR will become mainstream.

4. Man will set foot on Mars.

5. No general AI.

6. No fusion.

7. Magnus Carlsen will be the first human player to achieve a 3000 rating.

8. Greater accumulation and conconcentration of wealth, growing income inequality, further decline in poverty, further drop in fertility rates and more mass surveillance around the world.
So this project is already dead.
Slack isn’t a “large player” they are nowhere near being profitable and are nowhere in the same league as Facebook, Amazon, Apple, Google or Microsoft.

The app ecosystem was growing like crazy in 2010. It was a year and a half into “there is an app for that”. Facebook had already pivoted to being big in mobile.

The same can be said about Uber. Once the companies have a profitable and sustainable business model that doesn’t involve burning cash then they can be considered a major player.
Indeed. Fishing knot strength is always a hot topic of debate, particularly during the slower, off-season winter months when everyone's hunkering down and doing tackle maintenance. Here's a pretty good breakdown of the line breaking strength of various fishing knots across monofilament, fluorocarbon, and braided line: https://www.knotsforfishing.com/knot-strength-chart/

I personally prefer the Palomar Knot as it is probably the strongest knot that is also easy to tie. The Improved Clinch Knot and its brethren are also handy to know since there are so many variants that have high breaking strength; I typically teach the Improved Clinch Knot to folks new to fishing.
Location: Philadelphia, PA

Remote: Yes

Willing to relocate: Yes (Including International Locations)

Technologies: TypeScript, Python, React, Ruby on Rails, C#, AWS, Docker

Résumé/CV: https://shashwatsingh.me/data/shashwat-resume.pdf

Email: shashanoid@gmail.com

Github: https://github.com/shashanoid
Can you give more example like this when you get time? Can we such things in Google Cloud as well?
If I ever get any actual code running I'll try and post it here.
I saw the link here on HN first. Seek out the Gervais Principle. It is a more interesting view of a person’s place in a company. I have seen the Peter principle in action and have myself benefited/detrimented from it. But the Gervais principle is a whole ‘nother level.

Edit to add:

https://www.ribbonfarm.com/2010/10/14/the-gervais-principle-...
My flying ebbs and flows with life, seasons, weather, etc...since I'll often go a few months without flying, I found OA checkouts were a great way of knocking the rust off. I would study up on the knowledge, and then the ~1 hour of flight time with an instructor for the annual OA checkout was enough for me to get comfortable again. (I never felt like I needed to spend flight time preparing for the OA checkouts.) And the OA checkout could also count as a flight review. So I guess the bottom line is that for me, I could always roll an OA checkout into time when I'd want to be flying with an instructor anyway.

I never got charged more for OA than the published rental rates...but all the places where I did my checkouts had me fill out one extra sheet of paper so that an OA checkout also counted as a checkout for their own insurance rules. So if I was flying with a place a lot, I'd just do the checkout there and buy block time from them and rent under their non-OA policy. Basically, OA was great for everywhere other than one's local FBO, for which it was still typically a better deal to just rent under the terms of their standard non-OA policy.

Renter's insurance would be a tough sell for a lot of people; my local FBO already required it so I was good to go. (My local FBO is great, but they're also the only place I know that does dry rentals where you're not insured by their policy...weird, I know)
Thats quite the prediction. Heres hoping it's wrong.
The Politico piece shows the significance of this:

A former U.S. official who dealt with the Middle East said the strike was especially notable because it targeted the leader of a state apparatus, as opposed to a non-state actor.

“We need to be prepared that we’re now at war,” he said.[1]

This isn't like your typical drone strike on a militant terrorist. It's roughly the equivalent of Iran killing the head of the CIA or of a branch of the US Military or someone else with the full backing of a major state behind him.

Traditionally countries have not engaged in assassination of leadership (with the notable exception of North Korea). It's a dramatic escalation and hard to see how it doesn't lead to another ground war in the Middle East.

The Saudis will be happy though..

[1] https://www.politico.com/news/2020/01/02/soleimani-trump-ira...
I have 2fa on my Android and this feature works fine on Google home.
Model S got unveiled on 2009, the Gov invested/lent in them in 2009 and I remember the whole buzz of having a Tesla. Seems like a lot of people betted on them (pre-orders, government, investors, etc).

Quick search result in that time frame https://www.google.com/search?q=tesla&source=lnt&tbs=cdr%3A1...
Even if you credit all of their software to NeXT, Jony Ive was at Apple pre-NeXT-acquisition and it’s hard to imagine their turnaround going as well as it did without his work on the iMac.
Even after buying Nokia's phone business.
Well, Google legally can’t do a lot of things it does to workers in other countries that it does in the US...so yes? Labor protections in the US are absolutely atrocious compared to most of the European countries where they operate.
Chesterton’s Shell Script
"C'est la vie", say the old folks

It goes to show you never can tell
Lots of great predictions here. I'll just offer a couple about Tesla:

* Tesla's supercharger standard is discontinued in favor of CCS1 for EV rapid charging in the United States.

* Large battery packs providing lots of range in Tesla EVs stops being a competitive differentiator as large battery packs undergo commoditization.
We'll finally understand the messages what the Book of Revelations hold in the Bible as they become present days
Anyone remember the date when subreddits were added?
IsaacL is still around it seems:https://news.ycombinator.com/threads?id=IsaacL
I'm sorry, what's wrong with the notion that 'Humans are resources"?
Such boards can be used for emulation retro games?
Yes.

There is also a related technique used for RAID rebuilding - SCT Error Recovery Control [0] (Western Digital's name is Time-Limited Error Recovery). The main idea is to limit the maximum time allowed during a hard drive's attempt to recover from a read/write error. Without such a limitation, when the hard drive encounters a failure, it may try rereading and remapping a bad sector and becomes temporarily unresponsive, making the RAID controller to believe that the entire hard drive has failed, and potentially put more strain on the existing disk in an unnecessary full rebuild.

[0] https://en.wikipedia.org/wiki/Error_recovery_control
Keyboard with Trackpad for iPad Pro
Best Android VPNs Application to Browse Anonymously 2020
>9. Commonplace purchases will increasingly be made with point-of-sale loans and/or monthly leases. This will increase economic disparity (rich people will buy stuff / get better rates, poor people will rent things / can never get ahead)

Oh man. I didn't even think about it, but I think you hit the nail on the head with this one. Between more and more online retailers offering "Affirm" monthly payments for everyday items and true ownership of goods being less common with subscription services, your rediction is a natural and scary evolution for everyday purchases.
The new decade actually starts Jan 1st 2021... The same way this is the 21st century.
>Also, Sino-American trade will be at its highest ever in 2030.

By percentage of gdp or just total volume?
One could say the same about FB too though but I think FB is dying/dead. Only reason they are relevant is because of their acquisitions - IG, Whatsapp and messenger and people using FB login for sites. As a content platform, I don't think that many people use FB anymore.
I didn’t engage his point because I’ve taken it as a given that we’ll have to agree to disagree. There’s too much conviction on both sides to take that one in any meaningful direction. To some, to you and to the one I replied to, it is a moral issue. I’m not going to convince anyone that it isn’t a moral issue anymore than they will convince me that it is.

There isn’t a lot that is objective, even scientific and historical truths are often less scientific, less historic and less truthful than we think they are. I take a live and let live approach to the voluntary choices of others precisely because I’m not morally superior, nor do I endeavor to be. In return, I don’t accept that the choices they have made are morally superior to my own. They’re just living their lives according to their beliefs and I don’t want to take that away from them, nor do I want them to take away my choices nor to be punished for them. Life is too short, fleeting and full of suffering and choices to start making choices for other people. I do not, and I would wager you do not, have the status, position or occupational license to cast judgements upon others that aren’t our children, charges, employees or elected representatives. Even these limited forms of subordination have their limits.
Same as I did for the past 9 years. A diversified mix of Vanguard index funds (with VTI, VXUS and BND being the largest, roughly 70/30 split these days). It might go down like in 2018, it might go up like in 2019, but statistically it will go up. My IRR is ~8%, which is wonderful.
Throwing a few more!

- Most crypto currencies will die or come close to it including bitcoin. Centralized currency owned by private companies will take over.

- Nuclear tragedy will happen

- Boom of new wearables and micro tech as we finally make a breakthrough in battery/energy tech.

- Major advancement in sex reassignment surgery.

- Virtual characters running for some sort of election somewhere.

- I have a hunch that thousands if not millions of people will die in an unexpected calamity (earthquakes, tsunamis, volcanos, epidemic etc)

- Either Mind controlled or controlling tech. One will surely hit the plate.

- Movements similar to genocide and eugenics will increasingly get popular.

- Hollywood butchers anime by pushing more live action crap. We see huge decline in the creativity and diversity as a whole despite broader audience and more funding than before.

- Ask HN: is IRC still alive?

- Most movies will become interactive in some form.

- Major advancement in architecture. 3D printed houses become viable for rich and techies. Focus will be on making them transportable.

- 3D printing gives rise to a new chain of clothing, accessories, devices, games, drugs, organ transplants and food. People will sell the design instead of the physical product. Online retail that depends on physical shipping will see slow down in growth.

- Lot of minor and some major surgeries will have automation taking over, although it will be in the testing phase for another decade or more.

- Even more accessible and stronger forms of synthetic drugs. Hallucinogen will be legalized in most developed countries and used for treatment.
Drug development will be driven by simulations and machine learning.

- Some kind of regulation that will force tech companies to add mandatory form of parental control and have to go through certification.

- Schools will have AI driven monitoring system which will help them straighten out kids who won't pay attention in classes. They may have to wear school provided wearable which will track their heart rates along with other stuff such as sleep and diet. Workplaces might have something like this too especially low to mid skilled labor intensive tasks that won't be automated yet.

- China will become major exporter of surveillance tech along with India and Singapore.

- Self defense AI drone with taser/gas or soft gun for police. Someone will use drones and remote controlled equipment for terrorist attacks. Operating drones will require license and training.

- Legal euthanasia will become more acceptable. Suicide rate denial with eventual acceptance of problem from the government and people.

- More cyborgs. Advancement in devices operated using nervous system.

- Amazon becomes big provider for retail businesses. It will provide infrastructure and hardware for friction free experience (cashierless checkouts, better discoverability)

- Smart clothes? Maybe not quite but I think gesture control or assistant attached to it might become popular.