Hello Manos, Konstantinos and Nikolaos, In continuation to the discussion on the github issue for extending deepbots to evolutionary algorithms, I have submitted a draft proposal through the GSoC portal. For now, I have kept the proposal to be relatively empty by adding filler text. I plan to complete these and add all the other sections needed as per the GSoC proposal guidelines. But I think, it's essential to first decide the end goals and details about how to pursue them. So I have mainly focussed on two sections; Goals and Specifications and I would love to get your suggestions on those. We can discuss the ideas in the comments itself and decide on a concrete framework. Once that is done, I'll add all the other details such as week-wise breakdown of the work to be done and other things in the next iteration of the proposal. I thought that it would be pointless to add those things right now since I first need to decide the details of how to pursue the goals. Kindly let me know your thoughts on this. Regards, Vedant On Thu, Mar 11, 2021 at 5:50 PM Vedant Kandarp Shah < f20180566 [ at ] goa [ dot ] bits-pilani [ dot ] ac [ dot ] in> wrote: > Hi Manos, > > Thanks for the reply and thanks a lot for all the useful tips on how to > get started! I’ll start working with Webots and Deepbots straight way and > will definitely get back to you for further discussion regarding this. > Looking forward to working on this with you. > > > > Regards, > > Vedant > > > > Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for > Windows 10 > > > > *From: *Manos Kirtas <manolis [ dot ] kirt [ at ] gmail [ dot ] com> > *Sent: *11 March 2021 04:57 PM > *To: *Vedant Shah <f20180566 [ at ] goa [ dot ] bits-pilani [ dot ] ac [ dot ] in>; > gsoc-developers [ at ] ellak [ dot ] gr > *Subject: *Re: [gsoc-developers] GSoC Projects : Deepbots > > > > Hello Vedant, > > I am glad to hear that you are interested in contributing to deepbots > project! Indeed, your plan seems that is the best way to be prepared for > the GSoC proposal phase. First of all, feel free to contact us via email > for any help or open a discussion at project's github page. In order to be > familiar with webots and deepbots you can try to run and reproduce the > examples included at deepworlds repository. There are extensive tutorials > in deepbots-tutorials repository. If you find a bug or develop a fix you > are welcome to open an issue or PR respectively. After all you can checkout > the deepbots' issues which are tagged with 'ideal first issue' in order to > be familiar with the codebase. > > Feel free to contact us for help. You can join GFOSS > <https://matrix.to/#/%23gsoc2021:chat.ellak.gr?via=chat.ellak.gr&via=matrix.org> > matrix channel as well. > > Best regards, > > Manos. > > > > On 11/3/21 5:22 π.μ., Vedant Shah wrote: > > Hello everyone, > > I am Vedant Shah, a pre-final year undergraduate student at BITS Pilani, > India. I am primarily interested in two projects hosted by GFOSS for GSoC > 2021: “Extend Deepbots to support stable-baseline and implement gym style > default Reinforcement Learning Experiments” and “Extend Deepbots to support > evolutionary algorithms”. > > > > A little bit on my background: I have been working in the fields of deep > learning and (especially) reinforcement learning for quite some time now > and have worked on / am working on several related projects and research. > As a part of these, I have significant experience with working with deep > learning frameworks like PyTorch, tensorflow, etc. and also with tools > specific to reinforcement learning such as OpenAI gym, stable-baselines, > rllib, etc. I am also a core-contributors to a pytorch first reinforcement > learning library. A part from reinforcement learning, I have also worked in > robotics on tasks such as navigation, motion planning and control. > > > > I have always been interested in real-world reinforcement learning and > specially it’s applications in robotics. IMy avid interests in real-world > RL is the main driving factor behind be choosing these projects (I’ll be > happy to work on any of these). Although I am not familiar with Webots * > *yet** it seems like a really actionable platform for testing out > algorithms in context of robotics. I have grown familiar to deepbots over > the past couple of days and am pretty confident I can pull (any of) these > two projects off. > > > > Currently I have a very rough plan of action in mind which includes > > > > 1. Getting comfortable with Webots (can be done before the actual work > period begins) > 2. Researching upon some relevant evolutionary algorithms (for eg. > which have been proved to be robust to noisy data) which can be used in > context of robotics > 3. Start implementing those > > > > For the stable-baselines project, I am already familiar and have used > stable-baselines before and directly jump to integrating it once I am > familiar Webots (again, this can be done before the actual work period > begins). I am aware that these plan of action is not very detailed and is > very unrefined. So I’d like to get in touch with the mentors Manos > Kirtas, Konstantinos Tsampazis, Nikolaos Passalis to discuss the project > further. Looking forward to hearing from you soon! > > > > Regards, > > Vedant > > > > Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for > Windows 10 > > > > > > > > ---- > > Λαμβάνετε αυτό το μήνυμα απο την λίστα: Λίστα αλληλογραφίας και συζητήσεων που απευθύνεται σε φοιτητές developers \& mentors έργων του Google Summer of Code - A discussion list for student developers and mentors of Google Summer of Code projects., > > https://lists.ellak.gr/gsoc-developers/listinfo.html > > Μπορείτε να απεγγραφείτε από τη λίστα στέλνοντας κενό μήνυμα ηλ. ταχυδρομείου στη διεύθυνση <gsoc-developers+unsubscribe [ at ] ellak [ dot ] gr> <gsoc-developers+unsubscribe [ at ] ellak [ dot ] gr>. > > >
---- Λαμβάνετε αυτό το μήνυμα απο την λίστα: Λίστα αλληλογραφίας και συζητήσεων που απευθύνεται σε φοιτητές developers \& mentors έργων του Google Summer of Code - A discussion list for student developers and mentors of Google Summer of Code projects., https://lists.ellak.gr/gsoc-developers/listinfo.html Μπορείτε να απεγγραφείτε από τη λίστα στέλνοντας κενό μήνυμα ηλ. ταχυδρομείου στη διεύθυνση <gsoc-developers+unsubscribe [ at ] ellak [ dot ] gr>.