general SDK questions
831 3 2020-10-1
Uploading and Loding Picture ...(0/1)
o(^-^)o
omrialo
New

Israel
Offline

Hello, I am a researcher, and i work on gestural communication with drones.
I have already created a software for gestural interaction in PYTHON.

I want to purchase mavick 2 enterprise dual, and import the system to the drone. I want to be able to conduct a gesture that could control the movement of the drone, the lights, the speaker etc.


I am quite new to the field of drones and drones proggraming, and i want to get a better sense of how i can do what i want:
1. is it possible to "load" a software i created + drone control part that i will add, and then control the drone with a programm that is embedded on it ?
2. can i get access to the speaker, lights and other devices on the drone via the SDK ?
3. is it possible to do all of that in python? (otherwise much work will go to waste).

In general, i would appreciate any simple explanation of the scheme or approaches for implementation of such a software in the drone.

2020-10-1
Use props
DJI_Lisa
lvl.4
United States
Offline

Thanks for asking these great questions - I've listed them out below with my replies:

~Lisa, DJI Developer Relations

1. Is it possible to "load" a software i created + drone control part that i will add, and then control the drone with a program that is embedded on it ?


Waypoint Missions can be loaded directly to a drone: https://developer.dji.com/document/aab56894-31c7-4f38-b12d-616d312965a6

2. Can i get access to the speaker, lights and other devices on the drone via the SDK ?

Yes:
Flight Controller: https://developer.dji.com/document/0e5d22b9-efcf-4fe5-8cf4-80d410f2b690
Below this guide you'll see other useful topics, like camera and gimbal.  

You will find specific APIs for the items in the Mobile SDK that you want to control and you can also use the UX SDK for fast access.  For example: https://developer.dji.com/api-reference/ios-uilib-api/Widgets/DUXSpeakerWidget.html

3. Is it possible to do all of that in python? (otherwise much work will go to waste).

No it is not possible to program with our SDK in Python, unless you are working with the Tello drone

The Mobile SDK and UX SDK supports Java+Kotlin and Obj-C+Swift
OSDK supports C++
2020-10-2
Use props
omrialo
New

Israel
Offline

DJI_Lisa Posted at 10-2 14:53
Thanks for asking these great questions - I've listed them out below with my replies:

~Lisa, DJI Developer Relations

thank you for your response.
I have received another message regarding that topic, from one of DJI employees that said:

"We do not have an SDK that supports Python, however if you can send instructions from your python based program to a DJI Mobile SDK app, then this is possible with Virtual Sticks"

can you tell me more about that ? how does it works and how is it going to function?

and in addition, I want to ask if other code can be embed to the drone, such as gesture recognition code, movement control and more.
thanks !
2020-10-4
Use props
DJI_Lisa
lvl.4
United States
Offline

I can not tell you how to send Python instructions to an iOS or Android Mobile App - maybe someone else here on the forum can

But I can point you in the right direction for Virtual Sticks - here is a general overview: https://developer.dji.com/mobile ... tml#virtual-sticks.  Essentially, you can programmatically give the flight controller instructions mimicking your RC stick controls - roll, pitch, yaw, throttle

Virtual Sticks is covered on a Simulator tutorial here: (iOS) https://developer.dji.com/mobile ... /SimulatorDemo.html and (Android) https://developer.dji.com/mobile ... /SimulatorDemo.html

iOS APIs: https://developer.dji.com/api-re ... tcontroldata_inline
Android APIs: https://developer.dji.com/api-re ... ghtControlData.html

You'll also find some developer made tutorials and other virtual sticks resources listed here in the Forum Index: https://forum.dji.com/forum.php? ... &extra=page%3D1

As for your other question "I want to ask if other code can be embed to the drone, such as gesture recognition code, movement control and more" - it's less about code being embedded in the drone and more about the APIs that expose the ability to perform the functions.  For example, gesture recognition is a combination of using vision, virtual sticks or missions.  So each one of your "and more" features, would need to be looked at individually.  
2020-10-5
Use props
Advanced
You need to log in before you can reply Login | Register now

Credit Rules