Version 19 (modified by Ales Horak, 3 years ago) (diff)


PV277 Programming Applications for Social Robots

Pepper API

programming in Choregraphe via Python

  • enter only one box Python Script
  • edit its contents via double click:
    • to __init__ add:
      self.tts = ALProxy('ALTextToSpeech')
    • to onInput_onStart add:
      self.tts.say("Ahoj, jak se máš?")
  • add Czech into Project Properties
  • save the project and run in on a virtual robot

speech input via Python

  • in __init__ add:
            self.speech = ALProxy("ALSpeechRecognition")
  'Running on virtual robot')
            self.speech = None
  • process speech accordingly
    def get_answer(self, reactions):
        if self.speech is None:
            return (random.choice(reactions.keys()))
            self.speech.setVocabulary(reactions.keys(), False)
  'Speech recognition engine started')
    def onInput_onStart(self):
        self.tts.say("Ahoj, jak se máš?")
        reactions = {
            'dobře':  'to je super!',
            'špatně': 'doufám, že to brzo bude lepší',
            'nevím': 'tak to určitě nebude tak zlé',
        answer = self.get_answer(reactions)
        react = reactions.get(answer)'answer={}, react={}'.format(answer, react))
  • see ALSpeechRecognition documentation


  • add boxes Set Language with Czech and add Czech to project properties
  • right click the free area -> Create a new box -> Dialog...
  • in the Dialog -> Add Topic - choose Czech and Add to the package content as collaborative dialog (allows to start the dialog just by talking to the robot)
  • connect onStart -> Set Language -> Dialog
  • in Project files double click on and enter
    topic: ~dialog()
    language: czc
    concept:(ahoj) "ahoj robote"
    concept:(dobrý_den) ["dobrý den" "krásný den" "krásný den přeju"]
    u:(~ahoj) ahoj člověče
      to máme dnes hezký den
    u:(~dobrý_den) ~dobrý_den
  • see QiChat - Introduction and QiChat - Syntax for details
  • beware that the "nice" function of recognizing any text via _* is unfortunately not available in the real robot - free speech recognition works only as a payed service over-the-network. The dialog must use predefined (possibly dynamic) concepts instead via _~conceptName.

adding animations

  • single animation - via Animation box
  • connect to dialog:
    • add rule to topic:
      u:(["můžeš zamávat" zamávej] {prosím}) ahojky $zamavej=1
    • add output to the dialog box (right click -> Edit box) named zamavej (Bang, punctual)
    • add Kisses animation box, connect it to the zamavej output
  • within the dialog:
    u:(~ahoj) ^start(animations/Stand/Gestures/Hey_1) ahoj člověče
      to máme dnes hezký den 

shows only on real robot, see default list of animations

Pepper API II

installing application to the robot

  • make a ssh key (replace <xlogin> with your login):
    ssh-keygen -m PEM -t ecdsa -N '' -f ~/.ssh/pepper_<xlogin>
  • copy your public key to the course directory:
    cp ~/.ssh/pepper_<xlogin>.pub /nlp/projekty/pepper/course/keys/
  • add host karel to your $HOME/.ssh/config:
    Host karel
        User nao
        # IdentityFile is important for
        IdentityFile ~/.ssh/pepper_<xlogin>
        StrictHostKeyChecking no
        PubkeyAuthentication yes
  • build the PKG package in Choregraphe
  • test logview
    ssh aurora
  • after the key is allowed, install it to the robot
    ssh aurora
    /nlp/projekty/pepper/bin/ your_package.pkg

running/launching the application

  • if the application contains a behavior (behavior.xar), it needs to be launched. Behaviors can have two natures: interactive (used as a dialog) or solitary (used without a direct listener). Any behavior can be launched using one of 3 ways:
    1. specify the behavior's trigger conditions (works with both solitary and interactive) and/or its trigger sentences
    2. run it with
      /nlp/projekty/pepper/bin/ your_package[/path_to_behavior]
      call -l to obtain a list of installed behaviors.
    3. call ALAutonomousLife.switchFocus or QiChat ^switchFocus

using tablet

  • from a dialogue (see QiChat - pCall):
    u:(jak se můžu dostat na fakultu bez přijímaček?)
        Způsobů je celá řada. 
        Všechno se dozvíš dnes na přednášce, od paní ze studijního
        nebo na webu vvv fi muni cz v sekci pro uchazeče.
  • Using Pepper’s Tablet

face characteristics

creating application outside Choregraphe

  • prepare your pepper directory unless you already have one
    mkdir $HOME/pepper
  • copy template directory
    cp -r /nlp/projekty/pepper/course/template $HOME/pepper/
  • rename the template to template_<xlogin> (replace <xlogin> with your login) or something else:
    mv $HOME/pepper/template $HOME/pepper/template_<xlogin>
    cd $HOME/pepper/template_<xlogin>
  • go through all files, rename the application where necessary
  • build the PKG package (the version number will be increased):
    cd $HOME/pepper/template_<xlogin>
    make pkg
  • and install it
    cd $HOME/pepper/template_<xlogin>
    make install
    During the development this can be in one command
    make pkg install

creating own service

  • copy and rename template-service directory
    cp -r /nlp/projekty/pepper/course/template-service $HOME/pepper/
    mv $HOME/pepper/template-service $HOME/pepper/template-service_<xlogin>
    cd $HOME/pepper/template-service_<xlogin>
  • go through all files, rename the application where necessary
  • build the PKG and install it

Attachments (1)

Download all attachments as: .zip