Looking for datasets for your next project? You are in luck because Google just launched Dataset Search. The name is self-explanatory. Go try it out.
Here are the latest articles from Microsoft regarding cloud data science products and updates. Find the latest on AI, Azure Functions, IoT and more.
- Azure IoT Toolkit supports C#, Go, Java, Node.js, PHP, Python and Ruby to develop Azure IoT application in VS Code – With the latest release of Azure IoT Toolkit, lots of popular languages are supported to quickly create an Azure IoT application in VS Code: C#, Go, Java, Node.js, PHP, Python and Ruby! (Note: For C#, Java, Node.js and Python, it is based on Azure IoT Hub …[Read More]
- Two seconds to take a bite out of mobile bank fraud with Artificial Intelligence – Artificial Intelligence (AI) models have the potential to dramatically … Feature engineering to create customer and account profiles. Azure Machine Learning to create a fraud classification model. Azure PaaS services for real-time event processing …[Read More]
- Turn Whiteboard UX Sketches into Working HTML in Seconds – Introducing Sketch2Code – Introducing Sketch2Code – a web based solution that uses AI to transform a picture of a hand-drawn user … that coordinates the generation process by interacting with all the services. Azure Website: The user interface front-end that enables uploading …[Read More]
- Monitoring environmental conditions near underwater datacenters using Deep Learning – Because Project Natick operates like a standard land datacenter, the computers inside can be used for machine learning … use AI to accelerate digital transformation. An AOA enables organizations to map a business solution to the set of AI tools, services …[Read More]
- Bot Framework v4 with Luis – The Cognitive Services Language Understanding Intelligence Services (Luis … Luis uses a thing called a ‘Resolution’ to provide additional data with these kinds of complex entities so that you can resolve the actual values from the words the user said.[Read More]
- Peninsula Grammar amplifies learning impact by applying technology to evidence-backed pedagogy – Good practice trumps everything else – the science … in their learning from the way I was teaching them not the way I was using technology. But mix evidence-based pedagogy with technology then, wow – then it’s amplified. I collect data about …[Read More]
- Accelerating Artificial Intelligence (AI) in healthcare using Microsoft Azure blueprints – To be successful in using AI, healthcare needs solutions … Blueprints include resources such as example code, test data, security, and compliance support. These are packages that include reference architectures, guidance, how-to guides and other …[Read More]
- Extracting actionable insights from IoT data to drive more efficient manufacturing – What are the things we typically want to do with IoT data (once we collect it and store it)? In order of sophistication: With end actions ranging from sending a simple command to a machine, to tweaking operational parameters, to performing an action on …[Read More]
- Smart Solutions 7: Predictive analysis with Time Series, and intro to R for C/AL developers – Time Series is a topic on its own in machine learning, as it is one of the cleanest … Hopefully this post shows a simple way to get your Dynamics NAV data into another world: The world of Data Science. By bringing it over here you open up for an enormous …[Read More]
Azure Data Week is a virtual conference for all things Microsoft Azure and data science. It takes place October 8-12, 2018. It is not free, but the cost is low and you do not have to travel.
The latest articles from Microsoft regarding cloud data science products and updates.
- Build Intelligent Web App with Machine Learning Service – In an earlier article: How to operationalize TensorFlow models in Microsoft Machine Learning Server, we showed how you can deploy a TensorFlow image classification model pre-trained using ImageNet as service in Machine Learning Server, and download a …[Read More]
- Measuring Model Goodness – Part 1 – Data and AI are transforming businesses worldwide from finance … actionable insights. This is where data science and machine learning come in. This entire process has been documented as the Team Data Science Process (TDSP) at Microsoft, captured in …[Read More]
- Driving industry transformation with Azure – Getting started – Edition 1 – Banking customers want more from their services … using AI and machine learning to detect patient risk and identify disease faster while maintaining privacy and protecting against fraud. IoT in manufacturing isn’t just about collecting data.[Read More]
- Speech Services August 2018 update – We are pleased to announce the release of another update to the Cognitive Services Speech SDK (version 0.6.0 … dev kits to significantly improve the audio quality of the audio data collected via the dev kits’ microphones, for high speech recognition …[Read More]
- Introducing yet another approach for iot compiler toolchains – iotz – iotz is an extension based containerized wrapper for other IoT compiler toolchains. There are many toolchains with specific needs and way of using. We developed this experimental tool to make compiling things easier. – cross compiling tools are mostly …[Read More]
- Design against crime & Microsoft Azure with Shiny – It is this app we will later learn how to deploy a shiny app onto Microsoft Azure services … including a review of data available via police.uk. We engaged with UCL to find a student from the Security and Crime Science course who could help us to …[Read More]
- Simplifying big data analytics architecture – manufacturing, retail education, nonprofit, government, healthcare, media, banking, telecommunication, insurance, and many more industries ranging in use cases from ETL to Data Warehousing, from Machine Learning to IoT, and more.[Read More]
Here are the latest articles from Microsoft regarding cloud data science products and updates.
- Advanced Analytics is coming into Azure Portal – We see Azure Monitor users are using both the Log Search page and the Analytics portal to accomplish their tasks. The Analytics portal offers advanced features, and we’re happy to announce it’s coming into Azure! …[Read More]
- Azure Custom Vision in action – Azure platform offers many ready-to-use cognitive services, allows you easily enrich your applications with innovative features. In this article we will see how to use the Custom Vision service. We will train a model to learn how to recognize some types of …[Read More]
- IoT in Action: Building secure, sophisticated solutions – Customers across industries are implementing increasingly sophisticated IoT solutions in countless scenarios to achieve their own unique objectives. From launching new products to creating new services to streamlining operations, our customers continue to …[Read More]
- Azure #HDInsight Interactive Query: simplifying big data analytics architecture – manufacturing, retail education, nonprofit, government, healthcare, media, banking, telecommunication, insurance, and many more industries ranging in use cases from ETL to Data Warehousing, from Machine Learning to IoT, and more.[Read More]
- Azure IoT Edge support for Raspbian 8.0/Debian 8.0 – In theory, Azure IoT Edge is working only for the version 9 of Debian. If you’re using a Raspberry Pi, you’ll most likely use a Raspbian version which is based on Debian. So same, you’ll have to be on the version 9 to be able to deploy Azure IoT Edge …[Read More]
- Service Fabric and Kubernetes comparison, part 1 – Distributed Systems Architecture – During the last decade, distributed services platforms are drawing more and more attention. These platforms are revolutionizing the way we think about systems architecture, bringing multiple theoretical computer science … Azure IoT Hub, Dynamics 365 …[Read More]
- The ‘What’ is known ? But ‘How’ is the gap ? – I must admit that, no conversation is complete these days without speaking about AI. While I reflect on many meetings I have had in the last 6-8 months, it is imperative that the next frontier of innovation revolves around ‘Data’, and ‘Independent Software …[Read More]
- The Microsoft AI Idea Challenge – Breakthrough Ideas Wanted! – data scientists, professionals and students, and preferably developed on the Microsoft AI platform and services. The challenge gives you a platform to freely share AI models and applications, so they are reusable and easily accessible. The ideas you submit …[Read More]
- Installing certificates into IoT devices – Lots of folks are moving to X.509 certificate-based authentication as they start to use the Azure IoT Hub Device Provisioning Service, which is great! But I’ve gotten lots of questions about what the best practices are, and how to go about doing it at scale.[Read More]
- Azure #HDInsight Apache Phoenix now supports Zeppelin – manufacturing, retail education, nonprofit, government, healthcare, media, banking, telecommunication, insurance, and many more industries ranging in use cases from ETL to Data Warehousing, from Machine Learning to IoT, and more.[Read More]
- Azure IoT Edge for VS Code 1.2.0 has been released – Now run IoT Edge modules with simulator – Now Azure IoT Edge for VS Code 1.2.0 has been released with a bunch of new features. What’s new in IoT Edge for VS Code 1.2.0 1.Now you and run IoT Edge solution with the built-in IoT Edge simulator without deploying to IoT Edge device. 2.You can watch …[Read More]
- Azure IoT Workbench now supports ESP32 devices – To learn more, visit tutorial for enabling OTA firmware with IoT DevKit. IoT devices generate continuous streams of data so the need for processing those data is now widely realized and reflected in IoT solutions. Azure Stream Analytics is Microsoft’s …[Read More]
- Data Platform & Analytics technical webinars & consultations – August, September & October – focused on Data and AI scenarios. You’ll learn how to sell and deploy solutions faster with technical guidance from a Microsoft expert. Participate in instructor-led webcasts that include interactive training and real-time Q&A capabilities. Register …[Read More]
- Building an Azure Event Grid app. Part 1: Event Grid Topic and a .NET Core custom app event publisher. – In order to have a sample “data feed” for an application I wanted to use Azure … The generic scenario is that of alarms (of whatever sort you’d imagine; car, house, IoT device) for which the events represent status updates. This is the first …[Read More]
Data Scientists do more than build fancy AI and machine learning models. They often times need to get involved with the data acquisition process. It is common for data to be pulled from other databases or even an API. Plus, the models need to be deployed. These tasks fall to the data scientist to solve (unless there is a data engineer willing to help). Recently, I have discovered Azure Functions to be an extremely useful tool for solving these types of tasks.
What are Azure Functions?
Simply stated, Azure Functions are pieces of code that run. More formally stated,
Azure Functions are serverless computing which allows code to run on-demand without the need to manage servers or hardware infrastructure.
This is exactly what a data scientist needs to solve the tasks mentioned above. I, for one, do not enjoy managing servers (hardware or virtual). I have done it before, but I find it time-consuming and tedious. It is just not my thing. Thus, I happily welcome the serverless capabilities of Azure Functions. I just focus on the code and get the task completed.
Because the code does not always need to be running, Azure Functions invoke the code based upon specified triggers. Once the trigger is activated, the code will begin to run. The following list provides some examples of the triggers available.
Triggers for Azure Functions:
- Timer – Set a timer to run the Azure Function as often as you like. Timing is specified with a cron expression.
- HTTP Rest call – Have some other code fire off an HTTP request to start the Azure Function.
- Blob storage – Run the Azure Function whenever a new file is added to a Blob storage account.
- Event Hubs – Event Hubs are often used for collecting real-time data, and this integration offers Azure Functions the ability to run when a real-time event occurs.
- Others – Cosmos DB, Service Bus, IoT Hub, GitHub are other events which can trigger an Azure Function.
What can Azure Functions Do?
Once you begin to understand the concept, you can quickly see some of the possibilities. Without having to configure servers or virtual machines, the following tasks become much simpler:
- Reading and writing data from a database
- Processing images
- Interacting with an HTTP endpoint
- Automating decisions in real-time
- Computing descriptive statistics
- Creating your own endpoint for other data scientists to call
- Automatically analyzing code after commits
Programming Languages for Azure Functions
Simplify Tasks for Data Science
Next time you have a data science task which requires a little coding, consider using an Azure Function to run the code. It will most likely save you some deployment and configuration time. Then you can quickly get back to optimizing those fancy AI models.
See the video below for a quick demonstration of how to create an Azure function via a web browser (no IDE needed).