skysight-inc/HackerNews huggingface dataset:
There are countries named Guinea, Guinea-Bissau, Equatorial Guinea, Papua New Guinea, Guyana and French Guiana.

I think I'm pretty well traveled but even I have difficulty sorting these all out. So even though "Guinean" would be accurate, it would still cause some confusion.
NEW FREE TOOL:  Find your most shared content on Twitter, LinkedIn and Facebook
> Again, PRISM isn't mass surveillance (as it needs specific selectors)

I don't agree with this assertion.

If recording as much as possible that everyone does via a computer is not mass surveillance, then what would be? That is what is happening, and it is mass surveillance.

Why is mass surveillance bad? Because of the chilling effect it has on freedom of speech and freedom of association. These things still apply even when the government promises not to read the data until you come to their attention. So even if you deny the term "mass surveillance", then this conditional surveillance is bad for all the same reasons.
agreed; simply reminding that apple's metal is very likely also a factor.
Conflict Israel vs. Gaza target rockets into israel gaza city August 2014
Node.js port to Google Native Client
How do they ask for that permission? With a popup like the one asking for sending you notices? I thought apps are allowed to do anything on ios. Can't remember skype asking me for recording permissions.
Wow, are we the same person? Or is this the new state of a generation?
Çalışma Kitabı Cevapları
There is no minimum output size. Outputs can be zero-valued.
How do you use a probabilistic approach to scraping data? Were you able to get a low number of false positives?
YQL is surprisingly quite brilliant:

https://developer.yahoo.com/yql/
I imagine you would have to use saline rather than plain water to avoid the lung cells bursting due to osmosis.
Rent control is a political tool that allows at least some poorer people to keep living in the city. The underlying problem is severe and chronic lack of supply in absolute terms.

Rent control is a way to mitigate social tension enough so the people on Google buses don't end up with their heads on a pike.
Do you discuss pricing anywhere? I'm very hesitant to commit to a free trial when I don't know how much the product will cost afterwards.
I scrape Gumtree and eBay hourly using a python script for certain things I want under a certain price. The script sends me an email with the link in it and I get on top of it sharpish.

Managed to bag a lot of stuff over the last couple of years for not much money.

If someone bags this up as a service I'd pay for it.
It could be you're outside the US - Telenav have only recently moved over to OpenStreetMap, from proprietary sources, and they seem to be concentrating on getting the US version working, before rolling it out elsewhere as and when. At the same time as moving to OSM, they also bought another well-thought-of app, Skobbler, and for the moment that seems to be their international version. All rather confusing, but if that applies to you, Skobbler might be worth a go.
Next Generation OpenGL: Key Advances That Will Bring OpenGL to Where Direct3D Was Two Years Ago.
To me it seems like they are just taking frames subject to three constraints: average must be one every 10 frames, maximum gap must be say 80 frames, and finally the aggregate distance is minimized. In other words minimizing that metric subject to those two constraints. That's all. It's a nonlinear minimization problem.

EDIT: After reading their description, I agree they are going the photosynth route. Why not, they have the technology that you worked on. And they say that the naive subsampling I described above doesn't work...
I seem to remember hearing that sofas release cyanide when burned.
It's official: Drummers are smarter than you (and everybody else)
Ui Components/utilities based on AngularJs 1.2+ and Bootstrap 3
How to Be Your Own Project Manager
I redid my Lenovo T520 into a Ubuntu 14.04 machine. A few observations:

The pros:
1. Super fast boot
2. Super fast just about everything
3. Awesome command line
4. great for development

Cons:
1. Battery life sucks on Linux. No optimizations of any kind. In windows, I was able to work for 3+ hours on my battery, now I am happy if I get 1 hour on Linux.

2. Nvidia drivers are still a pain. I tried the built in Ubuntu driver and got super slow refresh rates on a dual 24" setup. On the other hand, the native Nvidia drivers freeze the machine every now and then. Guess I'll just have to live with it

3. Docking the machine sometimes screws up the resolution. Boot the machine undocked, and then dock it seems to be the trick. Not sure if other systems have this issue.
OBAMA AND BATBOY IN CAHOOTS TO SELL KIM KARDASHIAN TO ILLEGAL IMMIGRANTS!
FWIW, the maker of this (Martijn Exel) gave a talk on where to improve OSM last saturday in Seattle at the OSM 10th anniversary event. Slides from his talk are here: https://docs.google.com/presentation/d/1ey85IHqupj7aWxq92Rzq...

Personally like his other tool, the OSM vs. US Census Tiger 'battlegrid' : http://184.73.220.107/battlegrid/#10/41.8941/-87.7753
Sorry for the confusion. They are used for "merging" scraped data from various sources, not in the scraping process itself. For example, they help in figuring out if similar-sounding listings on related websites refer to the same "thing".

If interested, take a look at this (and related) papers: http://www.cs.ubc.ca/~murphyk/Papers/kv-kdd14.pdf
When I worked at MyEdu, I didn't actually sign on with the dev team originally — I worked on "the scraper team". We scraped college and university websites to get class schedule information: which classes were being taught, broken down by department and course number; by which professors; at which times on which days. If you're ever looking for an interesting challenge, I would encourage you to try getting this data.

Well-formed HTML is the exception rather than the rule and page navigation is often "interesting". Sometimes the school's system will use software from companies like Sungard or PeopleSoft, but there's customization within that... and of course, there's no incentive for the schools to aggregate this information in a common format (hence MyEdu's initiative), so there are plenty of homegrown systems. In short, there's no one-size-fits-all solution.

* NOTE: If you do attempt this, I insist that you teach throttling techniques from the very start. Some schools will IP block you if you hit them too hard; other schools have crummy infrastructure and will be crushed by your traffic. Scrape responsibly!
Ricky,

Thanks for this service.

Sometimes, all it takes is to remind someone that people are there for them, and care about them. I don't terribly like Twitter, but I try to read it once a day or so just to keep a view on how people are doing; this service would be incredibly useful to me to make sure that I don't have things that I'd like to pay attention to falling through the cracks.

I know a bunch of people here seem to wish that the service were less aggressive (or that it didn't exist at all): for my application, I'd almost prefer it be more aggressive! Three negative sentiments is a high bar to meet, and I fear the false negative rate could be quite high.

Anyway, thanks very much for writing this. As a whole, classes of applications that help me mediate my interaction with social networks are things that I support, and in specific, this application is incredibly valuable to me.
The story of pro wrestling is the story of American capitalism
As someone who lives in a city (cambridge MA) that got rid of rent control, its done little to limit rents going higher and higher. It did spur a lot of renovations though.

I think zoning has a lot to do with it. If there is anything that will limit housing supplies its land and zoning.

You need to get the zoning right and developers will show up to build more housing if the rents make it worth it.
Base82? You mean base62 - 26(letters) x 2 (other case) +10 (digits)? Or am I missing something?
A lot of services with online billing refuse to send bills by e-mail, instead requiring users to log into their websites.

No doubt the companies would justify this by saying e-mail isn't secure enough. The side-effect that it'll stop many users bothering to look at their bill isn't why they do it at all, no sir.

I've been considering making a web scraper that goes to the phone company, electricity company, gas company, broadband company, electronic payslips, bank, stockbroker, AWS and so on; logs in with my credentials; downloads the PDF (or html) statements; and sends them by e-mail.

Of course, such a web scraper would need my online banking credentials, so I'm not in the market for a software-as-a-service offering.
If you look at the admin themes on wrapbootstrap.com and themeforest.net, they're all extremely similar. Same menu items, same chart plugins, same elements on dashboard, often times even using the same clip art and sample photos. They usually just tweak one another, just manipulating the CSS a bit. I think that's the downside to basing a commercial product off of common design elements, Bootstrap, and open source JavaScript plugins.
I mocked up something similar [1] a while ago, although operating on fixed-length integers instead of db keys and not designed with any regard for the "decryption" process. I'm curious if it's flawed in any significant way for the purpose of converting sequential ids into apparently-random distinct ids.

1. http://ideone.com/qLQHI5
I just created a GoLearn Terminal.com snapshot. You can play with it without having to install or compile anything. https://terminal.com/tiny/QLlicfE27O
I once wrote a scraper for a Yellow Pages site in Python. It pulled down the business category, name, telephone and email for every entry, and returned a nicely formatted spreadsheet. The hours I spent learning the ElementTree API and XPath expressions have paid for themselves several times over, now that I have a nicely segmented spreadsheet of business categories and email addresses, which I target via email marketing.
Visualize your Kimono API results
The project listed in the article, http://algorithmia.com/ looks like it's a web service.

Anyone that's used/written algorithms knows they need to be run natively on your machine/server to run the fastest. Calling a web service will slow this down greatly.

If this site was turned into a marketplace of code listed for each algorithm that can automatically translate between languages, I could see it going somewhere.
The Burger-Flipping Robot That Could Put Fast-Food Workers Out Of A Job
In understand the key is not transfered to the server, but I would still love to see SSL. I also wouldn't want any external resources on the page. No Statcounters or Analytics. Good direction though, appreciate the effort!
The problem is that this tool to satiate the plebs actually makes the problem worse, because it introduces more plebs. Rent control reduces the quantity and quality of housing. This raises prices, making non-poor people poor.
Reddit and twitter account for tendancy.

but twitter is so vast you may want to categorize account.

But reddit is a good source for a lot of info.
You're not a thinker--you're a procrastinator.

There a deep emotional issues causing your anxiety, probably from your childhood. You need to get out of your head. You're stuck in an endless loop.
If I were to hazard a guess: the fact that air is directed over and around the driver's compartment would mean that at racing speeds, someone around or in front of your car releasing an aerosol would mean you're unlikely to be exposed to it
Yeah it is. First, the bride paying for the wedding may be tradition, but it isn't absolute. In other words, in the United States, you won't see two people NOT get married because the wife's family can't afford a wedding. If your culture expects a dowry, what you can afford may influence who you are allowed to marry or whether a marriage can happen or not.

Second, the tradition of the bride's family paying in the U.S. has significantly lessened over the years. More young people pay for their own weddings or share the cost with their parents.

My parents's paid for the bulk of my small wedding (which despite being deliberately small and my hack of avoiding having to pay for the location, was still probably $20k once my dress, the reception, airfare/hotel for my parents and sister, flowers, photos and other assorted pre-wedding meals were dealt with -- weddings are just fucking expensive), and were happy to do it (and were happy they were able to do it), but if they would have been unable to cover the bill, my husband and I -- or his family -- would have stepped in, no questions asked. Like, it wasn't even a concern.
warning: short video (no sound)
A while ago, I had the idea of creating a travel site that catered to the group of people that enjoy traveling but aren't bound by time (i.e. I want to go to X, but I don't care when -- just show me the cheapest weekend for the next 3 months).

Anyway... it turns out that flight APIs are ridiculously non-existent. I ended up scraping two different airline sites, but since it was against their terms, I never took the site any further.
There's really not much to it. Scrape each site/feed every X minutes, find all the hyperlinked URLs on the page, add them to a database table ... and if they're already in the table, send out an email with links to the "buzzed about" URL, as well as all of the sites/feeds that mention it. I keep the links in the table for about a month.
Golang? Not Yet
I have been unsuccessful in finding a demo of the new default theme. Is that available anywhere?
Given that the author is also offering a premium (paid) version of this theme, I doubt a GitHub repository exists as this would make it harder to keep the paid version alive.
This technique actually works great for normal speed and can mimic the smoothness of a cinematographer's expensive dolly: https://www.youtube.com/watch?v=3TlCGh5Pc90
I blame the fact that BART was never extended down the Peninsula.
You are correct. I have been saying this for a while. Facebook has fundamentally replaced the key ingredient of email, that is: the ability of people to reach out to each other easily.

If one builds it properly, Facebook is a good replacement for email's Address Book. Beyond that, it is not much more.

I am not removing myself, nor even going to delete from Facebook, because ultimately, it all boils down to how we can manage ourselves with discipline.
Yes, you're right that activities are broken up like that.
Permissions are defined in the application manifest, and apply to all activities within the application.

Facebook would have to break their application into a calling app and newsfeed app to split the permissions apart. It would still request permission to record and take videos for both, though, if they implemented video recording on the newsfeed app.
Nope, you're exactly right. Need more coffee.
Why not use PRAW? It's very mature, useful library using the Reddit API.
The former.

I thought about something like the latter, but I had my ArduCopter setup working really well before I started the project.
Isn't it trivial to block a user's stuff from your feed, though?
San Francisco is has extremely low population density across vast swaths of its territory for a city with such a high demand for housing. And, unlike other world cities, most of the buildings are not architectural masterpieces with historic value. They're cheaply built, ugly little boxes. The only things that will reduce this tension would be limiting the number of people allowed to move into the city (obviously not legal) or increasing the supply of housing. There isn't a lot of new land, but it would be easy to increase the density by a factor of 2-3x by giving developers incentive to raze lower density housing and replace it with larger buildings. The could be compelled to pay impact fees and fund neighborhood improvements to ensure that transit capacity, parking, public amenities, and street life are actually improved rather than degraded.

Unfortunately, the current regulatory climate in SF is 180 degrees opposed to this solution, with NIMBYism run rampant and any improvement or expansion of existing housing stock subject to a thicket of roadblocks and regulations.
The article is about a macro system that gives you hygiene by default but allows you to capture when you want it.

I'm not using a mature blogging platform.
this could be some kind of metaphor? =D it starts with a simple but very humanist text, about everybody should like everybody, but this all ends with the statement that after he had liked everything, he got with nothing that he really likes. This could be the same with our relationship with people, where if you dont stand for your principles you could get around with people you don't appreciate.
That's a good point. I only knew of the driver we had, who was local, and had to go to do the opposite thing the other 9 months of the year (the occasional rich client airport run aside), but you're right, I totally expect that many of the drivers aren't local. I guess I was more thinking the cab companies themselves rather than the drivers.
http://www.nytimes.com/2000/06/07/opinion/reckonings-a-rent-...

This is an old Krugman Op-Ed from 2000 that says exactly that.
I shopped around for a service like this a week ago.

We went with Setmore: http://www.setmore.com. Clean design, their branding is subtle on the free tier, multiple staff/services, ical, and most of all it's extremely easy for customers to create/re-schedule/cancel appointments.

Over Square Appointments I'd say their pricing is much more keen (substantial free tier, $25/month premium).
What about legal implications? Do you get permission from the sites you crawl?
Programming, Math, and Hot Dogs
Stop saying “Scientists discover” instead, “Prof. Doe's team discovers”
I'm an MD-PhD student with the type of background you are interested in developing. Radiation oncology is going to be a dying field in the future, but that is the subject of a different conversation.

I think you want to go into MD-PhD, but I would suggest against it if you are more interested in the technology than what is best for patients. A lot of technologists are having problems conceptualizing this because they don't understand the limitations of current technology and what dealing with patients entails. Instead of trying to be a leader in this type of field you should focus more on potential problems technology can solve much better for patients by improving outcomes and decreasing costs. The biggest problem in medicine right now are the insurance companies and healthcare administration practices which are quite costly and provide little patient benefit.

1.) Technology is only going to have as big of a impact on medicine as doctors and patients allow. If you want to make an impact on healthcare focus on developing technology where you can convince doctors that outcomes and costs are better. If you look at past clinical research done, a lot of technology did not produce the beneficial outcomes perceived by the inventors. Clinicians are skeptical of technology without proper evidence suggesting its usefulness. Your technology will have to navigate this system.

2) MD-PhD gives you a lot of flexibility with doing this type of thing, but I would suggest that you focus more on helping patients than building a business. Likewise, I would suggest trying to become more involved at an academic hospital that could support your intellectual property pursuits, give you access to the patients your technology can help, and help find the resources you need for new developments. Neurosurgeons with engineering backgrounds are probably the most successful in this respect.

You have a long ways to go and the journey is not easy by any means. Good luck. Questions are welcomed.
Square Appointments does those things as well according to the link. In any case, I don't understand how doing MORE would cause Appointment Reminder to cease being competition for Square.
Whale Flippers Make Better Swim Fins
So, Skyscanner? (Pick'Whole month' / 'Whole year' for the date).
There's going to be a lot of Facebook bashing in this thread, but I'm going to posit that this response from the Facebook software is not unexpected or even wrong, because the author is purposefully playing against the assumptions built into Facebook algorithms.

Most people rarely "like" branded or advertising content on Facebook. So Facebook has tuned their algorithms to be very sensitive to the few data inputs it receives per person.

Now, here is a person flooding it with input. I am not surprised that the result is crazy deluge of branded content. It's like taking a carefully balanced lever and pushing real hard on one end. The other end is going to move a lot.

> I kept thinking Facebook would rate-limit me, but instead it grew increasingly ravenous.

Why would they build in a rate limit? The vast, vast majority of the time, the level of input is very low. To build in a rate-limiting system would be pointless gold-plating.

The rarity of this sort of flood is obvious from the fact that a human being at Facebook noticed the level of activity and contacted the author. That is an incredibly high bar at Facebook, which prides itself on automating everything.
Putting a rocket up Brisbane (2009)
Show HN: Clutter Free – Chrome extension to prevent duplicate tabs
I think you're right; I've heard a couple times that "This call may be recorded " generally applies to both parties in the US.
A simple chrome extension I made after not finding anything that suited the need.
Key issue addressed, that wasn't working with other similar extensions, was that they didn't address duplicate tabs across multiple windows.
Intend to leave it simple, still craving for feedback on must-have features and bugs.
Another thing to do with store loyalty cards is to always look up by phone number - many people in my extended family live nearby and use the same phone number, so the card has so many purchases on it it becomes useless to target.
Is there any estimate of how much income this particular mine can produce, compared the the capital outlay and the ongoing costs?
If you need a short code the user will have to type the legibility is more important than the length, you can optimize for human input like this:

https://gist.github.com/hcarvalhoalves/5330d8af36e7163d58c4
Why one of cybersecurity’s thought leaders uses a pager instead of a smart phone
The bizarre world of philately and space exploration (2011)
I really like these kind of task driven dashboards. But I would never ever use an external service to host it. What happens in my team stays in my team.

I've tried to find software like this that can be self hosted, but it is either not available or extremely expensive as the self hosted version is targeted at big companies with lots of users.

Is it just me being old fashioned, or are there more potential buyers of self hosted software being ignored as a potential customer?
Why would I pay $90/mo [1] with Square when I can pay for the same services and features directly from BookFresh for just $20/mo [2]?

In case you are not aware, Square purchased BookFresh back in February [3].

I think it's a safe assumption that Square Appointments is just rebranded BookFresh

[1] https://squareup.com/appointments#pricing

[2] https://www.bookfresh.com/pricing

[3] http://techcrunch.com/2014/02/26/square-acquires-bookfresh-t...

EDIT: links
Very, very informative and interesting piece of work. It's worth the read.
Is there any automation of the common yet difficult problem of "your dentist / hair stylist / doctor has called in sick today and we're trying to reschedule all of todays appointments". This is not all that unusual. My wife's hair stylist was sick two appointments ago and my kids pediatrician office (windowless) had a summer time air conditioning failure.

Its not in the PR page so I assume its not handled although this would be a very handy feature. "One click reschedule everyone for today"
PlainSite (http://www.plainsite.org) uses about 20 different scrapers/parsers to download and standardize legal materials.