Groups Similar Search Look up By Text Browse About

Google Street View rival Mapillary collaborates with Amazon to read text in its 350M image database


Mapillary , the Swedish startup that wants to take on Google and others in mapping the world by way of a crowdsourced database of street-level imagery, is taking an interesting step in the development of its platform. The company is now working with Amazon, and specifically its Rekognition API, to detect and read text in Mapillarys database of 350 million images. The first application resulting from the new feature will come from a large US city (that Mapillary will not name right now), which plans to use the information that will now be readable from parking signs to build a parking app. Parking is a super hot space and [parking information] is one of the most asked-for pieces of data that people want to use Mapillary for, said Jan Erik Solem, CEO and co-founder of the Malmo, Sweden-based startup. He said that while parking will be the first application and one that he expects other cities to use as well, there will be other applications coming out from matching up text in Mapillarys images, and subsequently being able to pinpoint exact latitude and longitude for specific locations. Were starting with parking signs in the US because parking is one of the biggest issues in towns today, but text recognition will apply to many different types of objects and images, such as building facades. While it might sound odd that a city might not have a grip on the state of its on-street parking, this is apparently the case: cities, Solem said, have general analogue maps indicating parking regulations, but many of them lack digitised versions, which means that when they want to build new services (and in particular services that help them raise revenues either from parking fees, or parking fines), or consider whether they need to build more parking, they lack the datasets to do either. Mapillary cites research that says that parking problems collectively cost $73 billion in the US — presumably that includes not just the fines that people pay for overstaying, the gas they gobble looking for a spot, and so on; but perhaps even the lost revenues in areas where they overstay and no one knows. Notably, Mapillary is referring to its use of the Rekognition API as a collaboration with Amazon, although when I asked about the wording, he was a little less willing to collaborate with me. I cant comment on what Amazon is doing or why, he said. It would be nice to have that part of the announcement, but it ended up not working out this time.  It seems that the two have been working together for a while now, although that is all under NDA. Amazon has been doing a lot in the world of mapping, however, both as a provider of data to third parties, and for its own services. For starters, the company is a logistics powerhouse, and part of the reason for that is because of its intelligent routing around areas to figure out how best to collect and deliver and distribute goods bought and sold on its marketplace. But that is just one part of how mapping and location are used at Amazon. The company uses maps from Here, and had at one point been rumored to be one of the parties interested in buying the mapping firm. Meanwhile, it also has built (and acquired other mapping IP and talent in the process) a mapping API, similar to Googles, for developers that want to build apps that use location services in any way for any Amazon device. For now, that has mainly meant building apps for its Fire tablet and Amazons burgeoning range of Echo devices, but Amazon is also very focused on also having a role to play in other kinds of hardware, such as connected vehicles. In January, Toyota announced that it would be working with Amazon to integrate Alexa into its cars, and separately, Amazon has also been racking up patents in the area of autonomous vehicles. In other words, there is a clear opportunity for a company like Mapillary, providing a viable alternative to Google Maps in terms of street-level imagery, to work as a strong partner to Amazon in these services, specifically in indexing and providing information about what is around you, and how to route you most efficiently from A to B. And as a side note, as with other artificial intelligence platforms, Rekognition is also learning from each time that its used in an application, so through its collaboration with Mapillary, it too is picking up more detailed data about street signs and what they say, and where they are used. Mapillary itself is an interesting startup that Ive long thought is one to watch. Solem is a computer vision specialist who sold his previous company, the facial recognition startup Polar Rose, to Apple; and his latest venture has raised $24.5 million so far from the likes of Sequoia, Atomico, Navinfo, BMW and Samsung — leading the way to building some interesting inroads with potential customers. One of these happens to include Here, Amazons mapping provider. Others are under NDA. Together, they are now also feeding Mapillary images to contribute to its wider database, although Solem said about 80 percent of its content of 350 million images still comes from individuals, much like Waze. Everyone either seems to have a need to solve some kind of problem, or a desire to fix maps around the world, he said. While text recognition and reading is one problem Mapillary is tackling today, the next will be helping people capture more images, more automatically. The next iteration of our product will help people fill out coverage, Solem said without elaborating more on the details. We are building out tools to deploy capture tasking.

Mapillary will use Amazon Rekognition in effort to ease urban parking crunch


Many large U.S. cities seem to have adopted the motto: Man, parking here sucks. But a Swedish startup believes it can apply a little technology to solve a problem that is costing billions of dollars each year. Today, Mapillary, based in Malmo, Sweden, announced it will collaborate with Amazon Rekognition, a visual data analysis platform, to create a system that makes it easier to find parking in congested areas. Mapillary is developing a street level-imagery platform that uses computer vision technology to enhance digital maps. The company will now use Rekognitions text-in-image feature to scan parking sign data on a large scale. City authorities are struggling to keep track of their parking signs and data, said Mapillary CEO and cofounder Jan Erik Solem, in a statement. For cities to manually track this themselves would cost millions of taxpayers dollars, not to mention the enormous time investment. The collaboration between Mapillary and Amazon Rekognition means that several cities in the U.S. are now in a position to get complete updates on their parking signs through an automated and computer vision-driven process, saving both time and money. Mapillary says it currently has 350 million images on its platform. These images are collected via contributions from various people and organizations. While Mapillary can detect whether an image is a parking sign, it cant actually read the text. Amazons Text-in-Image Rekognition will make that possible. Mapillary says tests of the system using 40,000 parking signs resulted in the text being read correctly 95 percent of the time. The company first uses its own technology to identify parking signs in its system, and then it runs Rekognition to decode them. Mapillary cited a 2017 study that found the growing parking crunch costs U.S. residents $73 billion each year, including lost time and parking tickets. As frustration grows, cities are often spending big money to overbuild parking structures rather than finding better ways to use existing parking spaces. With improved tracking of existing parking, Mapillary hopes to save cities and consumers precious time and money.