Deep Learning Jump-Start Workshop | SGInnovate
April 14-24
2018

Location

BASH, Level 3, 79 Ayer Rajah Crescent
Singapore 139955

Deep Learning Jump-Start Workshop

Presented by SGInnovate

SGInnovate partners with Red Dragon AI to offer hands-on, cutting-edge training to developers and data scientists who are looking to build AI Applications for real world use.

This workshop gives participants a grounded understanding of how Deep Learning works and how to start applying it straight away for their own unique projects.

 

The workshop consists of a full day session on 14th Apr (Sat), with 2 follow-up sessions on the evenings of 17th Apr (Tue) and 24th Apr (Tue) and is eligible for funding support.

 

Attendees MUST bring their own laptops

 

Workshop Overview:
In the course participants will learn:

  • The basic concepts of Neural Networks and an introduction to the mathematics of Deep Learning
  • Introduction to the Keras API and how it works as a higher level of abstraction for TensorFlow
  • Building and using TensorFlow native Estimators
  • Building various types of Deep Learning models
  • Building models for Computer Vision challenges
  • Building models for Natural language challenges

The course will consist of a full day on 14th Apr (Sat) from 8:45am to 5:30pm with lunch and 2 tea breaks provided.

At the end of the day, once participants have an understanding of the basics, they will go home to work on their own models and projects.

There will then be 2 follow up evenings on 17th Apr (Tue) and 24th Apr (Tue) that will look at more advanced uses of Deep Learning for Computer Vision and for Natural Language Processing and allow for students to ask questions about their own projects.

 

Recommended Prerequisites:

  • An interest in Deep Learning
  • Ability to be able to read and follow code
  • We will send out some videos to help people with Python syntax specifically before the course begins.

 

Agenda:

Day 1, 14th Apr (Saturday)

08:45 Registration

09:15 The Key Concepts behind Deep Learning and Introduction to the basic math

10:45 Tea Break

11:00 Building your first Neural Network

12:30 Lunch

13:30 Building a Convolutional Neural Network

15:00 Tea Break

15:15 Using Transfer Learning for new problems

16:15 Doing a Project

17:15 Closing Comments and Questions

 

Evening Follow up Session 1, 17th Apr (Tue)

18:45 Registration

19:00 Deep Learning for Natural Language Processing Evening Session

21:00 Project Clinic 1

21:30 Closing Comments and Questions

 

Evening Follow up Session 2, 24th Apr (Tue) 

18:45 Registration

19:00 Deep Learning for Computer Vision Evening Session

20:00 Building a Model for Structured Data with TensorFlow Estimators

21:00 Project Clinic 2

21:30 Closing Comments and Questions


 

Day 1, Section 1: The Key Concepts behind Deep Learning and Introduction to the basic math

A simple introduction to how the math behind networks works

  • Math of Neural Networks and Back Propagation
  • Activation functions
  • Loss functions
  • Optimization functions

 

Day 1, Section 2: Building your first Neural Network

Frameworks: TensorFlow, Keras

A look into the Keras API

  • Parts of a Model
  • Hidden Layers in action
  • Keras Layers API
  • Multi-Layer Perceptrons
  • Setting Hyperparamaters

 

Day 1, Section 3: Building a Convolutional Neural Network

Frameworks: TensorFlow, Keras

Convolutional Model Architectures

  • Convolution layers
  • Pooling layers
  • Dropout and how it affects networks
  • Combining Convolution layers

 

Day 1, Section 4: Using Transfer Learning for new problems

Frameworks: TensorFlow, Keras

Understanding the Estimator framework and its advantages

  • Inception Network
  • Building a classifier with a pre-trained network
  • Reusing and retraining weights for a specific task

 

Day 1, Section 5: Doing a Project

Frameworks: TensorFlow, Keras

Actually *doing something* is very important

  • Ideas for projects to do
  • Q&A on ‘doable projects’
  • Homework: What to bring to the next session

 

Evening Follow up Session 1, Section 6: Deep Learning for Natural Language Processing Evening Session

Frameworks: TensorFlow, Keras, Estimators

Using Deep Learning for problems related to language

  • Ways to represent words and language
  • Intro to RNNs
  • Classifying Text
  • Project questions and general follow up

 

Evening Follow up Session 1, Project Clinic 1

 

Evening Follow up Session 2, Section 7: Deep Learning for Computer Vision Evening Session

Frameworks: TensorFlow, Keras, Estimators

Various types of Computer vision tasks

  • Understanding more advance image networks
  • Generative modeling for images
  • Examples of Style Transfer and Deep Dream

 

Evening Follow up Session 2, Section 8: Building a Model for Structured Data with TensorFlow Estimators

Frameworks: TensorFlow, Estimators, Datasets API

Understanding the Estimator framework and its advantages

  • What makes up an Estimator
  • Canned Estimator
  • Building a network for Structured Data
  • Estimator Input function
  • Intro to the TensorFlow Datasets API

 

Evening Follow up Session 2, Project Clinic 2


 

Instructors’ Biodata:

Dr Martin Andrews

Martin has over 20 years of experience in Machine Learning and using it to solve problems in financial modeling and creating AI automation for companies. His current area of focus and specialty is in Natural Language Processing and understanding. In 2017 Google appointed Martin one of the first 12 Google Developer Experts for Machine Learning.

 

Sam Witteveen

Sam has used Machine Learning and Deep Learning in building multiple tech startups, including a children’s educational app provider which has over 4 million users worldwide. His current focus is AI for conversational agents to allow humans to interact easier and faster with computers. In 2017 Google appointed Sam one of the first 12 Google Developer Experts for Machine Learning in the world.

 

IMPORTANT PLEASE TAKE NOTE:

 

Attendees Pre-Workshop Instructions

1) You MUST bring your own laptop to this workshop.

2) Please watch the introductory videos we will send out separately.

3) Please experiment with the pre-exercises given as well.


 

Funding Support

This workshop is eligible for e2i and UTAP Funding Support schemes.

 

e2i

An initiative of the National Trades Union Congress (NTUC), e2i (Employment and Employability Institute) supports nation-wide manpower and skills upgrading programmes.

 

Criteria for e2i Funding Support eligibility:

  • Participant must be a Singaporean or a Singapore Permanent Resident
  • Company-sponsored participant must not be from a Public Agency (includes but not limited to Ministries, Statutory Boards, Organisation of State, etc)
  • Achieves 100% workshop attendance
  • Must complete & submit a survey form after the online registration to fulfill funding requirements

* Note: e2i Funding is on a reimbursement basis and processing of the refund may take up to 2 months after course completion. Participants who do not fulfill ANY of the above criteria will NOT be eligible for e2i funding.


 

UTAP

Union Training Assistance Programme (UTAP) is an individual skill upgrading account for NTUC members. As a member, you will enjoy UTAP funding up to 50% of the unfunded^ course fee, capped at $250 every year.

(^Unfunded course fee refers to the balance course fee payable after applicable government subsidy. This excludes GST, registration fees, misc. fees etc.)

 

Criteria for UTAP Funding Support eligibility:

  • Participant must have paid-up union membership before course commencement, throughout whole course duration and at the point of claim
  • The course must not be funded through company sponsorship or other types of funding
  • Achieves 100% workshop attendance
  • UTAP self-application must be submitted within 6 months after course completion

* Note: UTAP Funding is on a reimbursement basis and processing of the refund may take up to 2 months upon your successful self-application after the workshop ends. Participants who do not fulfill ANY of the above criteria will NOT be eligible for UTAP funding.


 

To apply for UTAP Funding,

Please submit an online application within 6 months after the workshop ends:
https://www.ntuc.org.sg/wps/portal/up2/home/eserviceslanding?id=6bc1ca2c-ce81-4acb-a28f-c0be586e185f

 

UTAP Step-by-Step Application Guide:

http://demo.e2i.com.sg/wp-content/uploads/2017/05/UTAP-Step-by-Step-Application-Guide_Apr2017.pdf

 

For more information on UTAP, please visit http://skillsupgrade.ntuc.org.sg / email UTAP@e2i.com.sg / call the NTUC Membership hotline at 6213 8008.

 

 

 

 

Supported by
 

 

For enquiries, please send an email to training@sginnovate.com

Upcoming Events

  • Technology That Matters: A Cyberpunk Approach To Healthcare

    Join us for a talk by Dr. Steven Tucker, Chief Medical Officer at CXA Group and Founder of Tucker Medical, on healthcare innovation.

  • SGInnovate Presents: AI Evening – Applied Deep Learning for Image and Video Analytics in Enterprises

    Join SGInnovate and IBM on 19 April as we delve deep into image and video analytics and applied deep learning in enterprises, with practical use cases in healthcare, agriculture, civil defense.

  • AWS AI Services Workshop for Beginners

    SGInnovate partners with Amazon Web Services (AWS) to offer hands-on training and share learnings of AWS AI capabilities as fully managed services and put them into the hands of every developer and data scientist across diverse industries.

  • Blockchain Evening: Creating Sharing Economy Marketplaces

    Origin Protocol is building the infrastructure for a new, decentralized, sharing economy. The San Francisco based company is creating a set of protocols that allow developers and businesses to build decentralized marketplaces on the blockchain, with a focus on the sharing economy. The company has just released their live decentralized application and numerous projects have committed to developing applications on the platform.

  • Singapore Elm Meetup

    Elm Singapore is a group for people interested in web development using the programming language Elm. We plan regular meet-ups, with a strong focus on hands-on learning, knowledge sharing, and having fun while writing code! 

  • Government Care and the AI Revolution on Human Capital

    As AI becomes the new general purpose tool like electricity and internet, governments and nations are investing billions of dollars into the technology. Some countries are regulating it while others adopt a wait-and-see approach. How would AI affect society, and what should government bodies do and take into consideration in order to maximise the benefits while minimising the risks and societal costs of a global adoption of AI?

  • AI in Focus: Uncovering the Hype and Hubris

    Join IAG Firemark, SGInnovate and our expert panellists as we explore the key trends and counter trends in the history of AI hype-cycles; delve into the limitations of Machine Learning; and examine what breakthroughs and enablers are needed to surpass these limitations. Finally, we share our views on the future of AI and what this means for investors, corporates and start-ups alike.

  • Python For Beginners

    Explore the intersection of coding and data with General Assembly. During our Python-focused introductory workshop, you’ll learn to harness the power of an essential programming language for data scientists.

  • Blockchain Programming for Programmers – Session 3

    This is a hands-on event - please come with fully charged laptops. We will be coding and at the end of the session, we should have fully working, deployed code. In the third session, we will:

  • Ethereum Meetup: Vuulr

    Vuulr is a digital supply chain and marketplace for the 240 billion film & TV content industry built on the Ethereum Blockchain. It is an end-to-end solution that removes many of the existing frictions in the industry that slows the content acquisition process in today's quick-paced demands. We aim to shorten that process from the current 3 to 6 months to a mere 24 hours.

  • Dear Future Founders

    The world has difficult challenges that can be tackled with deep tech – Artificial Intelligence, Blockchain, Medtech, Space Tech, etc. In recent years, Singapore’s deep tech ecosystem has been fast growing, with venture-catalysts, talent, corporate and government partners working with scientists and researchers to build companies. 

  • Change the World: Building A Sustainable Future by Bricks and Blocks

    SGInnovate’s Change The World series returns on 7 May, with a focus on sustainable development and a special spotlight on Denmark’s story. Join us for an insightful morning as our speakers from The LEGO Group, Positive Energy Community and H.E. Ambassador Dorte Bech Vizard, on how technology could help build a sustainable future, by bricks and blocks.

  • Talk Data To Me: Healthcare Innovation

    At this event, we host thought-leaders from the healthcare community to discuss the possibilities that data brings to life. They’ll cover how today’s wealth of data drives business and product decisions across industries ranging from journalism to programming, and share their visions for the future. Why It Matters: According to a Forbes article, “2017 will be the year big data goes mainstream … whether gathering data on the front end or making big decisions in the C-Suite, every single person in your organization must buy into the value [data] analytics brings”. Data is everywhere, and it affects not only how we run our businesses, but how we live as individuals. Understanding the ways you can leverage data in your personal and professional life can help you find key insights, make smarter decisions, and elevate your career.

  • Artificial Intelligence: Research Strength and Ecosystem in Alberta, Canada

    Canada has emerged as a leader in global artificial intelligence (AI development, and the Alberta Machine Intelligence Institute (AMII) at University of Alberta (UAlberta) is one of the three AI superclusters in Canada. UAlberta's game and AI development are world-renown. AlphaGo, developed by the team at Google DeepMind, was led by AMII Ph.D. David Silver and AMII Postdoctoral Fellow Aja Huang. And "game research" has always been a driver of innovation, and provides a technical base for other major applications in more generalized problems. AMII has application impact in the areas of Precision Health and Legal Informatics as well.

  • NVIDIA Deep Learning Institute Fundamentals Workshop for Computer Vision

    SGInnovate partners with NVIDIA Deep Learning Institute (DLI) to offer hands-on training to developers, data scientists, and researchers looking to solve real world problems with deep learning across diverse industries such as self-driving cars, healthcare, online services and robotics.

  • Google Next Billion Users (NBU): Product Design Lessons from UX

    User Experience Design is often thought about as the last mile in the product development process. In the past few years, Google has launched several products that are relevant to users who are coming online for the very first time. While building these products, Google learnt that User Experience (UX) is not just a designer's job. With successful collaboration with business development, marketing, engineering and product management teams we have integrated designing thing deep into our product development cycle. This session will focus on what it means for products team to be design-driven with some examples and success stories. 

  • Singapore Session: Collaboration for Innovation

    In celebration of the France-Singapore Year of Innovation, a signature Singapore Session conference will be held in conjunction with VivaTech in Paris, to position Singapore as an AI and deep tech innovation hub and gateway in Asia, and to deepen collaboration and foster partnerships with entrepreneurs, researchers and academics, investors, corporates and governments between French and Singapore innovation ecosystems. 

  • ScaleUp with SGInnovate-Microsoft Startup Pitching

    Singapore startups are invited to register for a chance to participate in an exclusive invite-only startup pitching event in Singapore, jointly organised by SGInnovate and Microsoft. The application period is from 20 April to 21 May 2018.