Tag: #AI

Sony to Release World’s First Intelligent Vision Sensors with AI Processing Functionality

Sony Corporation today announced the upcoming release of two models of intelligent vision sensors, the first image sensors in the world to be equipped with AI processing functionality. Including AI processing functionality on the image sensor itself enables high-speed edge AI processing and extraction of only the necessary data, which, when using cloud services, reduces data transmission latency, addresses privacy concerns, and reduces power consumption and communication costs.

These products expand the opportunities to develop AI-equipped cameras, enabling a diverse range of applications in the retail and industrial equipment industries and contributing to building optimal systems that link with the cloud.

Model name Sample shipment date Sample price (excluding tax)
IMX500 1/2.3-type (7.857 mm diagonal) approx. 12.3 effective megapixel intelligent vision sensor (bare chip product) April 2020 10,000 JPY
IMX501 1/2.3-type (7.857 mm diagonal) approx. 12.3 effective megapixel intelligent vision sensor (package product) June 2020 (planned) 20,000 JPY

The spread of IoT has resulted in all types of devices being connected to the cloud, making commonplace the use of information processing systems where information obtained from such devices is processed via AI on the cloud. On the other hand, the increasing volume of information handled in the cloud poses various problems: increased data transmission latency hindering real-time information processing; security concerns from users associated with storing personally identifiable data in the cloud; and other issues such as the increased power consumption and communication costs cloud services entail.

The new sensor products feature a stacked configuration consisting of a pixel chip and logic chip. They are the world’s first image sensor to be equipped with AI image analysis and processing functionality on the logic chip. The signal acquired by the pixel chip is processed via AI on the sensor, eliminating the need for high-performance processors or external memory, enabling the development of edge AI systems. The sensor outputs metadata (semantic information belonging to image data) instead of image information, making for reduced data volume and addressing privacy concerns. Moreover, the AI capability makes it possible to deliver diverse functionality for versatile applications, such as real-time object tracking with high-speed AI processing. Different AI models can also be chosen by rewriting internal memory in accordance with user requirements or the conditions of the location where the system is being used.

Main Features

 

■ World’s first image sensor equipped with AI processing functionality

The pixel chip is back-illuminated and has approximately 12.3 effective megapixels for capturing information across a wide angle of view. In addition to the conventional image sensor operation circuit, the logic chip is equipped with Sony’s original DSP (Digital Signal Processor) dedicated to AI signal processing, and memory for the AI model. This configuration eliminates the need for high-performance processors or external memory, making it ideal for edge AI systems.

■ Metadata output

Signals acquired by the pixel chip are run through an ISP (Image Signal Processor) and AI processing is done in the process stage on the logic chip, and the extracted information is output as metadata, reducing the amount of data handled. Ensuring that image information is not output helps to reduce security risks and address privacy concerns. In addition to the image recorded by the conventional image sensor, users can select the data output format according to their needs and uses, including ISP format output images (YUV/RGB) and ROI (Region of Interest) specific area extract images.

■ High-speed AI processing

When a video is recorded using a conventional image sensor, it is necessary to send data for each individual output image frame for AI processing, resulting in increased data transmission and making it difficult to deliver real-time performance. The new sensor products from Sony perform ISP processing and high-speed AI processing (3.1 milliseconds processing for MobileNet V1*2) on the logic chip, completing the entire process in a single video frame. This design makes it possible to deliver high-precision, real-time tracking of objects while recording video.

MobileNet V1: An image analysis AI model for object recognition on mobile devices.

■ Selectable AI model

Users can write the AI models of their choice to the embedded memory and can rewrite and update it according to its requirements or the conditions of the location where the system is being used. For example, when multiple cameras employing this product are installed in a retail location, a single type of camera can be used with versatility across different locations, circumstances, times, or purposes. When installed at the entrance to the facility it can be used to count the number of visitors entering the facility; when installed on the shelf of a store it can be used to detect stock shortages; when on the ceiling it can be used for heat mapping store visitors (detecting locations where many people gather), and the like. Furthermore, the AI model in a given camera can be rewritten from one used to detect heat maps to one for identifying consumer behavior, and so on.

Key Specifications

 

Model name IMX500 (bare chip product) IMX501 (package product)
Number of effective pixels 4056 (H) × 3040 (V), approx. 12.3 megapixels
Image size Diagonal 7.857 mm (1/2.3 type)
Unit cell size 1.55 μm (H) × 1.55 μm (V)
Frame rate Full pixel 60 fps
Video 4K (4056 × 2288) 60 fps
1080p 240 fps
Full/video+AI processing 30fps
Metadata output 30fps
Sensitivity (F5.6 standard value) Approx. 250LSB
Sensor saturation signal level (minimum value) Approx. 9610e-
Power supply Analog 2.7V
Digital 0.84V
Interface 1.8V
Main functions AI processing function, ISP, HDR shooting
Output MIPI D-PHY 1.2 (4 lane) / SPI
Color filter array Bayer array
Output format Image (Bayer RAW), ISP output (YUV/RGB), ROI, metadata
Package – Ceramic LGA

12.5 mm (H) × 15.0 mm (V)

Microsoft joins forces with Enable Ireland to embed AI into Assistive Technology Passport.

Microsoft and Enable Ireland have joined forces today to announce a new commitment to embed AI into the Assistive Technology Passport which is being developed to empower people with disabilities to have an independent life. The announcement marks the 20th anniversary of Microsoft’s partnership with Enable Ireland.

Microsoft and Enable Ireland have been collaborating on the role of Assistive Technology for twenty years. The partnership has been built on a shared vision of enabling technology to transform the lives of people with disabilities and to empower them to achieve more. The idea for the AT Passport came from a discussion paper published by Enable Ireland in 2016 with the support of Microsoft and Disability Federation of Ireland. The focus of this paper was about bringing the idea of the AT Passport to life in Ireland and today’s announcement marks the next phase in this process and will see Microsoft and Enable Ireland work with Maynooth University to make this idea a reality.


Picture shows from left John O’Sullivan, CEO, Enable Ireland; Imelda Delemere, Enable Ireland Adult Services in Sandyford  and Cathriona Hallahan, Managing Director, Microsoft Ireland

 

Research has shown that the provision of AT services is often fragmented, difficult to navigate and not user centric. The AT Passport is a personal record of all of the relevant information about an individual’s requirement for AT including the necessary referrals, eligibility and training requirements and can support users to access the training and supports they need. Once developed it will be a tool that will help to streamline the way in which people gain access to Assistive Technology – equipment, training and funding and has the potential to ensure that those who need Assistive Technology can get it and, as a result, experience greater autonomy in their own lives.

Speaking today Cathriona Hallahan, Managing Director, Microsoft Ireland said: “At Microsoft we believe that technology can play a key role in driving positive and progressive change across every aspect of our lives, unlocking new and exciting opportunities for everyone in society. Assistive technology can transform the lives of people with disabilities ensuring they have the tools, skills and support to be independent and live a life with no limits. That is why we have been supporting Enable Ireland’s life-changing work for over 20 years and why today we are announcing a collaboration with them to develop the Assistive Technology Passport.”

“Technology empowers us all to achieve more everyday but for a person living with a disability it can be the difference of being able to engage with the world and not. The idea of an AT passport was something we really wanted to help bring to life with Enable Ireland and the funding we’re providing will do this while also ensuring that we embed AI into the functionality of the passport. We’re really excited to see this project brought to life.”

Today just 1 in 10 people with a disability who require AT have access to it. In order to ensure that technology can deliver real progress and change for everyone in society we must equip those with disabilities with the technology they need and ensure that their families, carers, employers and educators have the necessary training. Scaling the AT Passport internationally has the potential to achieve a truly global impact.

John O’Sullivan, CEO of Enable Ireland said: “I am thrilled to be part of the announcement today of a deepening of our collaboration with Microsoft Ireland. We have enjoyed a great relationship with Microsoft over the last 20 years, which has allowed us to provide Ireland’s only accredited course in AT and for their continued commitment which will help us to develop an AT passport. I believe that an AT passport will help to ensures that those who need AT have access to it. Technology is able to provide truly life changing assistance to people with disabilities by enabling them to live and achieve independence. Research has shown that the provision of AT services is sometimes disjointed, unclear and not designed around the end user. By developing an AT passport, we believe it will be less ambiguous for users to access the support and training they require.”

For further details on this initiative follow Enable Ireland on www.enableireland.ie/at.

The Perfect MWC: Less Focus on the Latest Devices and More on the Future of the Mobile Industry. #MWC #5G #AI #MachineLearning

The perfect Mobile World Congress would focus less on the latest devices and more on the future of the mobile industry; it would be more of a collaborative forum where the entire mobile ecosystem comes together to define the state of the industry and identify what really needs to be done in order to move markets, solutions, and outcomes forward, states the MWC veteran analysts from global tech market advisory firm, ABI Research.

In its new whitepaper, The Perfect Mobile World Congress: 13 Visions for the Ideal Mobile Trade Show, ABI Research highlights that while MWC 2020 was a missed show, it’s not a missed opportunity. The cancellation was unavoidable, but “this pause may prove to be just what the mobile community needs: a chance to reflect, reengage, and, ultimately, reorient to most effectively chart the future of the industry,”  explains Stuart Carlaw, Chief Research Officer at ABI Research.

The Perfect Mobile World Congress visions from ABI Research’s analysts:

“Traditionally, most MWC events are inundated by noise-generating, but not revolutionary, announcements. This annual game of one-upmanship largely detracts from the meaningful discussions, dialogs, and negotiations that should be happening at the perfect MWC to build consensus around how to shape the future of the industry,” Carlaw propounds.

AI & Machine Learning: “The perfect MWC would have all telcos presenting at the event fully realize and embrace the importance of 5G and Artificial Intelligence (AI). The deployment of 5G already brings AI to radio access networks and backhaul optimization. Telcos will need to speed up their adoption curve by integrating AI into service-based architecture and utilize AI in various domains, such as customer service, inventory management, and network service orchestration,” offers Lian Jye Su, AI Principal Analyst at ABI Research.

5G and Mobile Network Infrastructure: “The perfect MWC would put the challenges facing the mobile telco domain in a market that is currently experiencing 5G deployments and mass market adoption of this new generation, including geopolitics, a declining economic environment, increased pressure on infrastructure vendors, and a transition to more open networks. An ideal MWC would have a forum to discuss all these aspects and become the central arena to move the industry forward,” advises Dimitris Mavrakis, 5G Research Director at ABI Research.

5G Markets: “The perfect MWC would have the telco market come together to identify and pursue SME requirements and create the platforms, services, and applications to cater to them. This may not mean doing everything alone, but to collaborate with the web domain to address this challenging market segment,” proposes Leo Gergs, 5G Analyst at ABI Research.

5G Devices, Smartphones & Wearables: “The perfect MWC would offer real insight into more collaboration in 5G. Indeed, a welcome prospect, with major vendors (yes, including perennial shunner Apple!) and component suppliers working closely with global carrier partners to create differentiated offerings taking 5G far away from the concept of being just another ‘G’,” advocates David McQueen, 5G Devices Research Director at ABI Research.

Digital Security: “The perfect MWC would have significantly more coverage of more cybersecurity-related issues. This is especially critical for any IoT-adjacent services, and with each IoT vertical holding its own unique security requirements (e.g., industrial, critical infrastructure, smart cities, etc.),” envisions  Michela Menting, Cybersecurity Research Director at ABI Research.

“One thing is for certain; the mobile industry is not learning lessons fast enough and is not answering the right questions at the right time.  The cancellation of MWC 2020 might seem a disaster, but the future is bleaker if the industry doesn’t pause, take some time to reflect, and radically retool its approach to be a fit-for-purpose entity, Carlaw sums up.

For even more visons of The Perfect MWC, download the whitepaper: https://abi.link/2VIMFRa.