skysight-inc/HackerNews huggingface dataset:
As someone who once oversaw the operation of a web crawler I can tell you its pretty simple, if it is "Okay" then the robots.txt file will tell you its allowed. If you look at the LinkedIn robots.txt (https://linkedin.com/robots.txt) you will see it is carefully groomed to allow various search engines look through specific sections of their web site, the rest are disallowed.

Pretty much all of the case law comes down as there is a perfectly valid copyright on the 'collection' of a web site regardless of ownership of particular pieces, and the robots.txt is a well known and well understood mechanism for informing 'authorization'

There is a "value" to LinkedIn to letting Google and other search engines crawl them, you get to see pages in your search results pointed at LinkedIn, so LinkedIn lets them crawl their pages.

At the end of the day this is exactly a question of value. Microsoft knows that the collection of information in LinkedIn is valuable for a number of uses, if you want to pay them some of that value to get access to it, fine, if not then don't use it.

Here is one possible outcome; Microsoft will tell them what it will cost to use their info, HiQ will probably not be able to meet it because they've built their existing pricing structure around "free" access, and then as they are going down the drain Microsoft will buy their assets and technology and LinkedIn will get this new service you can buy from them to help you find and retain people.
YouTube SEO Tips – How to Do SEO for YouTube Video to Rank in Google and YouTube
The bigger problem isn't ignorance here. Lack of emphathy is the main problem. Parent comment, which people are down-voting, is basically suggesting that those African children which were saved are better off dead.
I'm a foster parent, and this is definitely a real thing.

My state recently went into crisis mode for foster care, where they struggled placing kids and filled up the group facility they normal use for short term overflow. They're starting a program specializing in short-term placements.

Opioids have been blamed for the recent increases.

http://fox13now.com/2017/05/12/resources-stretched-thin-as-m...

And this is in a state (Utah) with an already relatively low rate of children in state custody. Surely if we are struggling, other states must be as well.

I don't know what politics to sorry or what macro policy changes will "fix" this, but I know how I can help. Circumstances vary, but if yours permit you to do foster care, I recommend looking seriously at it.
The spec is still available freely: http://www.adobe.com/devnet/pdf/pdf_reference.html

For historical interest, older versions (going back to 1.3) are here: http://www.adobe.com/devnet/pdf/pdf_reference_archive.html

1.2, 1.1, and 1.0 can be found elsewhere on the Internet.
That case created a misconception that refuses to die... There's nothing inherently illegal about having a default app or product. There's also nothing inherently illegal about having a popular app or product.

The reason Microsoft got in trouble is because it was not only found that they had a monopoly in a particular market, but that they obtained some of that market share illegally through shady contracts effectively forbidding OEMs from offering alternative OSes, etc... They were then found to have used that illegally obtained monopoly to take over a completely different market in part by bundling IE with Windows and punishing OEMs who sought to including alternate browsers and completely disallowing the removal of IE.
Because in hope people will eventually understand that they really have the power. Ok, a bit of an utopia I guess...
Show HN: Usability Testing Exchange
You get free usability testing of, and feedback about, your website/web-app, here:

https://usability.testing.exchange

This is a side project where you'll learn about problems people encounter with your website/app, and what makes them confused. Then you can improve your website/app.

Normally, you get back as much testing & feedback as you give to others. However, I and some freelancers want to promote UTX. Therefore, you do not need to do any testing yourself in exchange, right now. (But you can if you want and it's fun :-)). So you can submit your website & get UX testing and feedback for free & no work.

How is it different from other free feedback exchange websites? — It's focus is usability testing, rather than giving advice & suggestions. And you can choose how much UX testing & feedback you want, about your own project: Do more UX testing yourself + write more detailed feedback to others —> you'll get more UX testing & feedback back, yourself — about as much as you gave (counted in the total sum of Math.log(the-length-of-each-feedback)).

All thoughts and feedback is welcome
مشاهدة مباراة الزمالك واهلي طرابلس بث مباشر يوتيوب اون اليوم 9 يوليو 2017
If you'd cared to talk to people outside your bubble, then you might've had a different opinion. And besides, the fact that there are people exploiting a crisis doesn't mean that the crisis was manufactured.
The important distinction between clustering and topological data analysis
Videos like these are a nice introduction to the power of cryptography. Nevertheless, I feel like the wow factor not only gets prioritized, but it completely takes over the conversation.

There should be more emphasis in how hash functions have been weakened in the past, how that can still happen today, and what it would mean to the world if this happened over night (this last point is unlikely, but still not impossible).

When I first studied cryptography, and Bitcoin, I remember seeing an article that talked about the lifecycles of hash functions http://valerieaurora.org/hash.html ... In my arrogance, I dismissed it. Today I can see how spot on it is.
Ha, I personally would not think that but fair enough.

I was simply pointing out that if it's soo hard and expensive to insure a festival because people do drugs, what has Fyre festival got to do with that? It was a disaster because the organizers didn't do their jobs.
I saw one drive by Grace Cathedral in SF just a few weeks ago.

It looked really nice, but I could tell it was a lower model than the S almost immediately. I mistook it for a prius for a few moments.
What about dogs? Dogs can certainly detect weed in an edible, as well as very small quantities of cocaine and mdma.
Business dashboards for social impact
Ask HN: What would you like visualized from databases you interact with?
It seems problematic that when working with databases the primary interface is terminal text output. I'm aware there are many options for getting nicely formatted displays of your tables etc. (e.g. with html and css), but it seems to me like it might be useful to visualize more than this. For instance, wouldn't it be useful if I could just grab my User with ID 23456, and see a tree display of all the data referenced by it, rather than trying to piece this together by looking at various tables? What about its evolution in time? Wouldn't it be useful to just have a slider so that I could watch the data in this tree at previous points in time, or to be able to step through changes that were applied to it?

I've done a bunch of work on a general data visualization system that I'm considering specializing for this—but I wonder if there are enough interesting useful things to visualize, and whether it's something other developers would easily recognize as valuable or if it would seem too foreign.

Any general thoughts on the subject? or particular things you run into regularly that would be useful to have a better visual representation of? Maybe it would be possible to specialize even further around particular (widely used) database-centric software?

Thanks!
I suggest the book Debt: The First 5,000 Years. Graber shows that markets cannot exists without a state. (Even when anarchists argue about state-less markets, it's usually after a state has fallen and there are still state-like actors around).
couldn't figure out how to run https://github.com/ongardie/raft.tla
jwt-go says right in the readme that it is not encrypted:

>> It's important to know that JWT does not provide encryption, which means anyone who has access to the token can read its contents. <<
1. Festivals are hard to insure because the attendees get wasted, then they hurt themselves and do dumb stuff. (OK)

2. Fyre festival was a huge disaster because the people who put it together did a bad job, and not really for any reasons regarding attendees at all. (Also OK)

3. Therefore, Fyre festival has "ruined it" for other festivals -- i.e., made it harder for them to get insurance. (???? This doesn't follow from 1 & 2)
An engineering marvel, but most likely an economic white elephant. The New York Times recently had a more critical report on China's bridges [0]

China is addicted to infrastructure projects to boost its GDP. The problem is that these projects in aggregate produce a poor economic return, so China's debt as a percentage of GDP is growing unsustainably. At some point it will be forced to have a painful adjustment to lower growth, especially for investment spending.

Personally I find Larry Summers analysis pursuasive when he argues that China will most likely achieve 4% growth over next two decades [1]

[0] https://www.nytimes.com/2017/06/10/world/asia/china-bridges-...

[1] http://www.nber.org/digest/mar15/w20573.html
FOLLOWUP: Thanks to all who replied. Disclosure is far more complex than the article hinted at, and the discussion here provides the context around 'Should I disclose?' that was absent from the original article.
That's unfortunate. I guess the same thing that happened to HTML pages (turning into less accessible JS-based SPAs) is now happening to PDFs.
If you set your expectations low enough any experience can be great. Which coincidentally is United's new slogan.
It does. I'm glad someone was able to present a viewpoint agreeing with OP. Thanks!
It really, honestly, is not manufactured outrage.

https://www.vox.com/policy-and-politics/2017/6/28/15881246/d...

> America has about 4 percent of the world’s population — but about 27 percent of the world’s drug overdose deaths

The US uses far more opioids than any other country. Does the US have far more pain than any other country?

> and more suffering for patients.

No.

You seem to think that opioids are an effective treatment for long term pain. They usually are not. The patient either stops taking them because of side effects, and is still in pain. Or the patient develops a tolerance, and needs to take more and more, and is now addicted to opioids and taking dangerously large amounts of opioids and, importantly, is still in pain.

People with long term pain need rapid access to a specialist pain management clinic. Opioids might be a choice of treatment, but they will be carefully prescribed, not dished out.
Truth is subjective, culture, etc...

Eventually the science fanatics (empiricists) will realize this or get defunded of their jobs.
This Wikipedia article suggests about $800B. But the Reuters article you cite says $2T to $6T is the eventual cost.

https://en.wikipedia.org/wiki/Financial_cost_of_the_Iraq_War

Accounting is a creative endeavor.
Could this enable a light-field camera? [1]

[1] https://en.wikipedia.org/wiki/Light-field_camera
I had -Wall set but I forgot that its misleading. -Wextra is needed for -Wtype-limits and -Wsign-compare.
Testing in sqlite is great! That still isn't a reason to write unreadable code though. It may just be a "Linux Torvald" kind of approach: if you can't read the code as is we don't want you in the community.
> but instead we standardize on oxyconton and opiates

That's because oxycontin and opiates work for relieving pain.

> But in states that have embraced cannabis we don't see this level of crisis .

That's a baseless claim that couldn't be further from the truth. Take a walk around SF, LA, Seattle, Portland, etc, there are tons of strung out junkies laying around on the streets surrounded by needles.

The existence of painkillers are not the reason we have drug addicts.
Why do we let that difference exist? You're trying to lead the debate about changing laws by quoting laws.
> it is the first example (in microprocessors) of slowing the clock rate and performing more computation per clock cycle

I'm sure designers were trying to get more out of each cycle, even while they were pumping up the clock frequency.

With the AthlonXP/MP, AMD was the first company to really market outsize the Ghz speed; pushing model numbers they believed rivaled their Intel equivalents that were lower than the actual clock speed. Today both manufactures market using model numbers.
What bothers me about this epidemic is how easy it could be for authorities to stop. Fentanyl isn't created in the back of a motor home. It is a manufactured and controlled narcotic. How controlled - just see the link below. All that needs to happen is for the DEA (et al) to stop raiding homes and torturing people and to pay a visit to these out of control doctors. Why a "Nurse Practitioner" is allowed to prescribe opioids 21937 times - wtf? Opioid prescribing is totally open and public - they aren't hiding it.

Here I have a list of the highest prescribing opioid doctors (sunday with beer project):
https://www.opendoctor.io/opioid/highest

(let me know if you want the sql or whatever).
"Until they became conscious they will never rebel, and until after they have rebelled they cannot become conscious."
But "details such as the background" will probably consist of a whole lot of raster images.
My XPS 15 just had an Intel logo and I pulled it off after I got it. I kinda want to block out the Dell logo now on the bezel. I hate advertising.
> human rights violations and atrocities

Are they really though? Indeed they abuse political dissidents and disallow free speech, but are there really that many people that violate these rules any more?

It's a valid worldview to say "that doesn't matter", but not everyone agrees with that stance. A (mostly) benevolent dictatorship is a perfectly valid form of rule if you ask me.
Stop using JWT for sessions
https://m.youtube.com/playlist?list=PL2_aWCzGMAwI3W_JlcBbtYT...

Some more decent data structure vids.
Interesting. All I knew of previously was Solidity, and it seemed... practical but limited. That said, I haven't done a deep dive yet.

Thanks
LA, and most US cities, need to be more like Tokyo -- which has much better zoning/building regulations (as in, less onerous).

> Here is a startling fact: in 2014 there were 142,417 housing starts in the city of Tokyo (population 13.3m, no empty land), more than the 83,657 housing permits issued in the state of California (population 38.7m), or the 137,010 houses started in the entire country of England (population 54.3m).

http://marginalrevolution.com/marginalrevolution/2016/08/lai...

http://marginalrevolution.com/marginalrevolution/2016/08/the...
I love how you cherry-picked South America and ignore recent examples where US is directly involved in impoverishing people by destroying their country in the name of democracy. Democracy meaning installing their own puppets who will allow them to loot. Countries like Libya, Egypt, Syria, Iraq, Kuwait etc. All South American countries have been at war. All of them. Google them one by one. Leave China out of this equation because they have never started or sponsored war outside Asia. When a country isn't at war, know that it is ruled by puppets of the West.
This is interesting. Always interesting to read about people's development setups.

Especially was intrigued by your idea of not having backups by avoiding having files and instead storing everything on GitHub. (the downside being little things like API keys being exposed... YzUwYzQ3MzAzODdlZDJl...).

How many years have you been doing it this way? Do you envision it working long term? What if GitHub loses your data at some point?

These questions aside, there is some really good info here and I will be studying your tips on using VirtualBox. Would love it if you provided more detail about your use of Docker (something that could get a newbie started with it).

Having a single disk image for each client is cool. I would think you would want to back these up? But you say nope. That's a bit confusing. Maybe you store a huge binary on GitHub? Yes GitHub supports large binaries but ouch? Would be nice to know the story there.
I've been playing around a bit with JPEG2000 (slowly learning about the format, trying to write a decoder for it) --- whereas JPEG normally uses Huffman compression for the bitstream, which although not really parallelisable is relatively fast (essentially 1 table lookup per output value), AFAIK the bottleneck in JPEG2000 decoding is the arithmetic compression, which can't be parallelised either, and involves quite a few more operations than Huffman's inner loop.
Note the title refers to "Expat, a C library for parsing XML", not an obscure novel title for ex-patriots living abroad. Given what shows up on hackernews these days, I had assumed the later on first reading.
In my case, freelance always was through a friend-of-a-friend. And those freelance jobs were nothing major.

For example, looking at your example project, thing that I did as a work for hire seemed to have been simpler.

There was an existing android app showing on 3 screens weather in Dubai or Abudabi (I don't really remember anymore) and I were to write the IOS port.

The reason why the guy chose me, even though I neither had an actual job, nor delivered a project was that he knew me personally for a really long time :-)

So, if I were in your shoes, I would literally be emailing classmates I liked working on projects during school and asking them for work, because that is what I did and it worked out well for me :-)
It seemed like the project was started with unclear/unvetted requirements, led by bureaucracy and image instead of engineering. China tends to do things the other way around.

That smoke exhaust system seems absurd - I don't know how the architectural plans even left the design phase. It should have been isolated and designed such that it could be replaced with a conventional approach cheaply.

The rest of the project sounds like a deadline-driven fixed-resource software project with incompetent management - hacks and cut corners everywhere.
> Can you also detect whether a program will loop forever?

Assumed the current state of knowledge about our universe no program will loop forever.

But maybe our universe is a kind of infinite loop by itself. Who knows.
That's what someone gets for reading just a little.

It is clearly indicated that Bombadil is friends with farmer Maggot (Tolkien states that Bombadil is a Hobbit name). Merry says that Maggot used to go into the Old Forest. If he did so, then meeting Bombadil would be very likely.

Gildor's friends apparently sensed the great urgency, so they would have taken a very direct path which would have led them straight through the Old Forest (after all, Elves have little fear of such things).

The statement that Elrond "has never heard of Tom Bombadil" is clearly wrong given Elrond's comments about Bombadil at the council.

> In those lands I journeyed once, and many things wild and strange I knew. But I had forgotten Bombadil, if indeed this is still the same that walked the woods and hills long ago, and even then was older than the old. That was not then his name. Iarwain Ben-adar we called him, oldest and fatherless. But many another name he has since been given by other folk: Forn by the Dwarves, Orald by Northern Men, and other names beside. He is a strange creature, but maybe I should have summoned him to our Council.’ -- Elrond

Likewise they are wrong about the danger. The Old Forest is not particularly dangerous (as the Hobbits showed by burning part of it down) and while the Barrow Wights (sent by the Nazgul witch king) are dangerous, they seem to hardly compare in danger to caves of dead spirits, haunted pools, orcs, trolls, etc. A war of Gondor against all the evils of Bombadil's domain would be over almost as soon as it started.

I know of no statements that the Withywindle is cursed. Goldberry met Tom there though, so it is likely he sticks around because she cannot leave her river. There is even less evidence that willow trees can appear human (plus the truly bad tree is an "Old Man").

If (like many conjecture) Tom (and perhaps Goldberry) is the physical manifestation of the spirit of Middle Earth itself, then it makes sense for him to withdraw to that area. Arthedain remains relatively undisturbed throughout the third age. The Old Forest and Barrow downs are unoccupied (save for a few Wights) and the Hobbits are a people who prefer the Earth. In fact, almost the entire area of Eriador is unaffected by the War of the Ring save for the Scourging of the Shire (though a big event for Hobbits, it hardly compares to everything else that happened).
People are addicted to pain killers usually because they are dealing with pain, and they are either medicating or self-medicating to manage it.

If mere availability of something addictive was the problem, then we'd have a nation of nothing but alcoholics and cigarette smokers considering you can buy either in an unlimited quantity at any corner store.
The loggers here might disagree with you.
Since there are drugs in US prisons, probably nothing stops people from getting them into a remote island.
I think the article indicates insurers need to do some due diligence on these festivals. Its unclear if Fyre even had insurance for a festival on a remote (basically unpopulated) island in the Bahamas. Most festivals aren't that ambitious in location.

The Fyre organizer basically didn't have it together: "Farland, 25, is alleged to have cheated at least two investors out of about $1.2 million by lying about the revenue and income of Fyre Media Inc., which he founded in 2016. He gave them phony documents claiming the company generated millions of dollars in revenue from thousands of artist bookings in a single year, when it really earned just $60,000 from about 60 performances, they said."[1]

https://www.bloomberg.com/news/articles/2017-07-01/u-s-charg...
Yea I was disappointed in this reveal as well. I mean the title isn't "Why Apple's don't have an Intel Inside Sticker" so I guess it's not a click-bait-n-switch.

The author seems knowledgeable, having worked in marketing for both companies, and it was an interesting read. But we still don't have any details of what kind of deal was made? Did Apple chose to pay a higher price or did they get a similar discount with only have Intel on the box?
Even more so:

-- the fact that the code didn't use the int16_t from stddef.h but rather defined their own, could hint in the sense that a signed-int-over-exactly-16-bits might be unavailable in the ABI. People defining their own exact-width integral types (instead of pulling in stddef.h), rarely think about how that makes the code harder to interpret for a reader.

Now, if the type i16 might indeed be wider than 16 bits, sizeof becomes perfectly justified but '16' is not.
> No it isn't. The goal is to enable financial freedom, so that the people who want that level of control over their money can have it, but those who see benefits from having their money cared for, can do that too.

Sorry, bad phrasing on my part. Perhaps it's better said as "Enabling people to be their own bank is one of the goals of Bitcoin."

Of course, financial freedom is the umbrella goal of Bitcoin, you're right. Part of that is making it possible to be your own bank. Importantly, that means making it _easy_ to be your own bank. We want it to be as easy for the average person to manage their coins themselves, as it is to manage USD at a bank. That way, even though users are free to use centralized services, there should be no reason to.
If something bad happens to you at a festival, why would you sue the festival? In the words of Willie Sutton (who was talking about robbing banks) "That's where the money is."
Most popular GitHub projects by application domain