| Both sides previous revisionPrevious revisionNext revision | Previous revision |
| courses:456:2022:projects:456-2022-01:project-01 [2022/05/02 00:40] – [Technical Approach] mliu59 | courses:456:2022:projects:456-2022-01:project-01 [2022/05/02 00:43] (current) – [Other Resources and Project Files] mliu59 |
|---|
| The robot homing procedure in two cameras | The robot homing procedure in two cameras |
| |
| For the robot toll path calibration component, the goal is to develop a more intuitive, human understandable, and unified data structure for the representation of waypoints used in the robot’s normal operation. In order to achieve this, we developed a custom data structure that does not explicitly define each robot waypoint as its own set of absolute coordinates, but rather as a “directional graph” of positions relative to each other and one single absolute “home position”. This calibration graph is stored in a human readable JSON file for ease of calibration, and is loaded by a ROS node upon robot system startup. | |
| | For the robot tool path calibration component, the goal is to develop a more intuitive, human understandable, and unified data structure for the representation of waypoints used in the robot’s normal operation. In order to achieve this, we developed a custom data structure that does not explicitly define each robot waypoint as its own set of absolute coordinates, but rather as a “directional graph” of positions relative to each other and one single absolute “home position”. This calibration graph is stored in a human readable JSON file for ease of calibration, and is loaded by a ROS node upon robot system startup. |
| | {{ :courses:456:2022:projects:456-2022-01:picture2.png?600 |}} |
| | The graph developed for the current robot's operational trajectory. Each node is a specific waypoint along some trajectory. |
| |
| For the robot's handeye calibration, since there is already a calibration procedure that can handle the bulk of the calibration, our team would package the script such that it can be integrated into the ROS framework for the robot. This existing procedure moves the robot to N points in a rectangular grid near the 2D plane where the mosquito manipulation occurs, detects the robot gripper tooltip position at each of these points, and fits the resulting point correspondences using a Bernstein polynomial fit. Coefficients for this polynomial fit is then saved in a config file. This config file is then opened and read by a dedicated ROS service node that can translate between robot and camera coordinates. | For the robot's handeye calibration, since there is already a calibration procedure that can handle the bulk of the calibration, our team would package the script such that it can be integrated into the ROS framework for the robot. This existing procedure moves the robot to N points in a rectangular grid near the 2D plane where the mosquito manipulation occurs, detects the robot gripper tooltip position at each of these points, and fits the resulting point correspondences using a Bernstein polynomial fit. Coefficients for this polynomial fit is then saved in a config file. This config file is then opened and read by a dedicated ROS service node that can translate between robot and camera coordinates. |
| * {{:courses:456:2022:projects:456-2022-01:final_poster_pdf.pdf|PDF of Poster}} | * {{:courses:456:2022:projects:456-2022-01:final_poster_pdf.pdf|PDF of Poster}} |
| * Project Final Report | * Project Final Report |
| * {{:courses:456:2022:projects:456-2022-01:final_report.pdf|Final Report}} | * {{ :courses:456:2022:projects:456-2022-01:liu_cis_ii_final_report.pdf |}} |
| * links to any appendices or other material | * links to any appendices or other material |
| |
| W. Li et al., "Automated Mosquito Salivary Gland Extractor for PfSPZ-based Malaria Vaccine Production," 2021 IEEE International Conference on Robotics and Automation (ICRA), 2021, pp. 866-872, doi: 10.1109/ICRA48506.2021.9560959. | W. Li et al., "Automated Mosquito Salivary Gland Extractor for PfSPZ-based Malaria Vaccine Production," 2021 IEEE International Conference on Robotics and Automation (ICRA), 2021, pp. 866-872, doi: 10.1109/ICRA48506.2021.9560959. |
| ======Other Resources and Project Files====== | ======Other Resources and Project Files====== |
| Here give list of other project files (e.g., source code) associated with the project. If these are online give a link to an appropriate external repository or to uploaded media files under this name space (2022-01). | Code repositories: |
| | All of the code for the robot, including the code developed as a part of this project, are stored in this repository group on GitLab: |
| | https://git.lcsr.jhu.edu/mosquitoproject |
| | |
| | The code repositories directly containing work covered by this project are: |
| | |
| | https://git.lcsr.jhu.edu/mosquitoproject/rqt_sanaria_robot_controller |
| | https://git.lcsr.jhu.edu/mosquitoproject/sanaria_calibration_tools |
| | https://git.lcsr.jhu.edu/mosquitoproject/sanaria_transformation_graph |
| | https://git.lcsr.jhu.edu/mosquitoproject/sanaria_handeye |
| | |
| | Documentation on system design is in the documentation repository: |
| | https://git.lcsr.jhu.edu/mosquitoproject/sanaria_docs |
