Open Source Flipper Zero, Thread, Matter, and Zigbee on ESP32, Arduino go Zephyr, and more!

0:00:00 / -

Watch now on YouTube Watch now

Ai Powered Bull**** Detector

Made by 8BitsAndAByte / 3D Printing / Artificial intelligence / Communication / Voice / IoT

About the project

The one device we all need, an AI Powered Bull**** Detector!

Project info

Difficulty: Difficult

Platforms: Adafruit, Google, Raspberry Pi

Estimated time: 3 days

License: Creative Commons Attribution-NonCommercial-ShareAlike CC BY-NC-SA version 4.0 or later (CC BY-NC-SA 4+)

Items used in this project

Hardware components

	Google AIY Voice Kit for Raspberry Pi	x 1
	NeoPixel Ring RGB LED 24 x WS2812	x 1
	Raspberry Pi Camera Module	x 1
	Raspberry Pi 3 Model B	x 1

Software apps and online services

	Remo.tv
	Google Dialogflow
	Raspberry Pi Raspbian

Hand tools and fabrication machines

	3D Printer (generic)	x 1
	TinkerCad	x 1

Story

Overview

Below an overview of the content:

Project video
3D Printing
Electronics
Training the AI - Dialogflow
Remo.tv
Result!

Project Video

The one device we all need, an AI Powered Bull**** Detector!

3D Printing

First things first, we need a container. In this case we chose to 3D print a nice colorful one. You can also use something else, as long as all the electronics fit.

Happy with our box, we can 3D print a poop emoji made by 3DCreatorPurzi. All we have to do is add a hollow space in the bottom to hold our NeoPixel ring.

All the model files are attached.

Electronics

It all starts with a Raspberry Pi 3B+.

Because we want to use Speech-To-Text we also have to add an AIY VoiceHat and the corresponding microphone. It's all documented right here.

Last but not least, we wire up the NeoPixel ring, here's a great tutorial for just that.

With everything set up we can test out the Speech-To-Text and NeoPixel ring, the test code is attached.

Training the AI - Dialogflow

For our AI we are going to use Dialogflow. Originally, it's meant to be used as chatbot software, we can slightly misuse it to train our bull**** detector.

We create two intents, one is our fallback, and the other bull****. Next we add all the content in the training phrases of our bull**** intent. You can really go nuts here.

After saving, our bot will be training to detect bull**** based on the given training phrases. Once done, we can use a bit of python code to connect to our freshly trained AI.

The data flow is as followed:

The microphone picks up someone speaking and records it.
This file is sent to the Google Cloud and transformed into text.
The generated text is sent back to the Raspberry Pi.
This text is then sent to Dialogflow.
Dialogflow tries to match the text with the content from our bull**** intent, and depending on the result it will either send back the bull**** intent or the default fallback one.
On our Pi we check the name of the intent, and if it's 'Default Fallback Intent' we tell the lights to flash green, meaning no bull***. Otherwise we flash red, indicating bull****.

The full code is attached.

Remo.tv

We can't keep something so powerful all to ourselves! So, we are going to make our detector available for everybody. To make this happen we are going to use Remo.tv, a robot streaming platform.

All we need to do is attach a Pi Camera and follow their setup instructions.

Once Remo.tv is set up, we will write our own chat handler. Instead of using Speech-To-Text we directly send the chat messages we receive on Remo.tv to Dialogflow. The rest of the logic remains the same. Just add a note in the background to tell visitors what they are looking at, and we're all done.

Result!

We successfully built a AI powered bull**** detector, which can learn from new input!

You can try it out yourself right here.

Now, where can we collect our nobel peace prize?

Schematics, diagrams and documents

Dataflow

CAD, enclosures and custom parts

Code

TestCodeNeoVoice.py

from aiy.cloudspeech import CloudSpeechClient
import neopixel
import time
import board

pixels = neopixel.NeoPixel(board.D12,30)

print('setup...')
client = CloudSpeechClient('/home/pi/cloud_speech.json')

while True:

    print('Listening...')
    spokenText = client.recognize() 

    if spokenText is None:
        print('You said nothing.')
    else:
        if spokenText == 'green':s
            pixels.fill((0, 255, 0))
            time.sleep(0.5)
            pixels.fill((0, 0, 0))
        elif spokenText == 'red':
            pixels.fill((255, 0, 0))
            time.sleep(0.5)
            pixels.fill((0, 0, 0))

chat_custom.py

import re
import os

from aiy.cloudspeech import CloudSpeechClient
import dialogflow_v2 as dialogflow
import neopixel
import time
import board
import robot_util

pixels = neopixel.NeoPixel(board.D12,30)

print('setup...')
client = CloudSpeechClient('/home/pi/cloud_speech.json')

session_client = dialogflow.SessionsClient()
session = session_client.session_path('XXXX', 12345)

def getDialogResponse(text):

    text_input = dialogflow.types.TextInput(text=text, language_code='EN')

    query_input = dialogflow.types.QueryInput(text=text_input)

    response = session_client.detect_intent(session=session, query_input=query_input)

    text = response.query_result.fulfillment_text

    return response

# example for adding a custom chat handler
main_chat_handler = None


# Reboot function, to be added to the extended chat commands.
def reboot(*args):
    os.system('sudo shutdown -r now')
    exit()  

def setup(robot_config, chat_handler):
    global main_chat_handler
    
    # Any chat related setup code goes here


    
    # Add a reboot command to the extended chat commands
    if robot_config.getboolean('tts', 'ext_chat'):
        import extended_command
        extended_command.add_command('.reboot', reboot)    
    
    main_chat_handler = chat_handler
    
    
def handle_chat(args):
    # Your custom chat handling code goes here
    print(args['message'])
    spokenText = args['message']
    response = getDialogResponse(spokenText)
    responseText = response.query_result.fulfillment_text
    responseIntent = response.query_result.intent.display_name

    if responseIntent == 'Default Fallback Intent':
        robot_util.sendChatMessage("No Bull****!")
        pixels.fill((0, 255, 0))
        time.sleep(1)
        pixels.fill((0, 0, 0))
    else:
        robot_util.sendChatMessage("Bull****!")
        pixels.fill((255, 0, 0))
        time.sleep(1)
        pixels.fill((0, 0, 0))
     
    # Call the main chat handler
    main_chat_handler(args)

TestCodeDialogflow.py

from aiy.cloudspeech import CloudSpeechClient
import dialogflow_v2 as dialogflow
import neopixel
import time
import board

pixels = neopixel.NeoPixel(board.D12,30)

print('setup...')
client = CloudSpeechClient('/home/pi/cloud_speech.json')

session_client = dialogflow.SessionsClient()
session = session_client.session_path('XXXXX', 12345)

def getDialogResponse(text):

    text_input = dialogflow.types.TextInput(text=text, language_code='EN')

    query_input = dialogflow.types.QueryInput(text=text_input)

    response = session_client.detect_intent(session=session, query_input=query_input)

    text = response.query_result.fulfillment_text

    return response

while True:

    print('Listening...')
    spokenText = client.recognize() 

    if spokenText is None:
        print('You said nothing.')
    else:

        print(spokenText)
        response = getDialogResponse(spokenText)
        responseText = response.query_result.fulfillment_text
        responseIntent = response.query_result.intent.display_name

        if responseIntent == 'Default Fallback Intent':
            pixels.fill((0, 255, 0))
            time.sleep(0.5)
            pixels.fill((0, 0, 0))
        else:
            pixels.fill((255, 0, 0))
            time.sleep(0.5)
            pixels.fill((0, 0, 0))

Credits

8BitsAndAByte

We’re Dane & Nicole, two makers that create tremendously terrible tech, which we happily share with you on our channel! https://www.youtube.com/c/8bitsandabyte

Shop

Project Hub

Video

Blog

Shop home

3D printing

Single Board Computers

Development kits

Sensors

Internet of things

Robotics

Accessories

Product of the Week

Electromaker Educator

The Electromaker Show

The Electromaker Podcast