The OpenAI scholars program requires a final open source project. I've been eagerly working on it and I'm happy to present it now. Along with this blog post, my final presentation, code and an academic paper, I present Semantic Parsing English-to-GraphQL (SPEGQL). I presented this project in my final project…
The scholars program is coming to an end. Since my next post will detail my final project, I thought this would be a good opportunity to reflect on the scholars program as a whole. I'd like to talk about the goals of the scholars program. Goal of the Scholars ProgramThe…
My final project involves taking natural language English prompts and running them through a model to generate corresponding GraphQL queries. This post details the preliminary model experiments and validation strategies I've used the past couple of weeks. Original PlanAs you can see in my project proposal document, I planned to…
My final project for OpenAI is to generate GraphQL queries from natural english prompts. The first project deliverable is to create a GraphQL dataset. This post will detail the process I went through to create that dataset and my reflection of each step. Research & PlanI started doing some preliminary…
The OpenAI scholars program ends with the deliverable of an open source final project. I'll be working on this project from now until the start of July when the program ends. This post will give a brief overview and a link to my proposal for that project. Text-to-GraphQLThe core goal…
These last couple of weeks have involved a lot of code, from my PR to huggingface to my PR to Swift for Tensorflow, to my current work on implementing a text-to-SQL model on the Spider dataset. Since that time was spent mostly coding, I feel like I have picked up…
These past couple of week I've been working on a contribution to the 🤗Huggingface Transformers repo. Transformers is a fast moving library that uses the transformer deep learning architecture to solve problems such as translation, named entity recognition, summarization, and other nlp tasks. I also used the PyTorch Lightning framework.…
While writing this blog post I realized that since the field of deep learning moves so fast, having too many technical details won't be useful as time goes on. So I’ll try to focus more on sharing the details of my learning process and the lessons I've learned. Lessons…