first commit

notebook.ipynb

@@ -318,73 +318,72 @@
   },
   {
    "cell_type": "code",
-   "execution_count": 21,
+   "execution_count": 22,
    "metadata": {},
    "outputs": [
     {
      "name": "stdout",
      "output_type": "stream",
      "text": [
-      "How much money do youtubers make?\n",
-      "\n",
-      "['https://www.youtube.com/watch?v=G4qOiwIE_o0', 'https://www.youtube.com/watch?v=ABG-1iy07NM', 'https://www.youtube.com/watch?v=-cz4in1WY-o', 'https://www.youtube.com/watch?v=KA5FmevAzTc', 'https://www.youtube.com/watch?v=JZ7GHzkBvzs']\n",
+      "What it does after extracting only the code\n",
+      "https://youtu.be/l_r_b38VXmQ\n",
       "Segments generated successfully!\n",
       "Fitting with n=5...\n",
       "Searcher fit successfully!\n",
-      "Segment from 'I Asked YouTube Millionaires How Much They Make' by Jordan Welch\n",
-      "Timestamp: (00:00, 01:04)\n",
+      "Segment from 'GPT-4 Auto Coder 2 reads docs from URL links and Auto Debugs' by echohive\n",
+      "Timestamp: (12:01, 13:12)\n",
       "\n",
-      "what's the most you've generated in a month from your YouTube channel oh man oh the best month uh I'll just say our biggest one in earnings I've always wondered how much the biggest YouTubers make so today I'm here at the most exclusive YouTube conference in the world to ask them myself we're here with my brother phidius how long did it take you to make your first dollar from YouTube Oh two years what is the most amount of money that you spent on a single video oh I spent 50 000 on a video and I made back like 25. I'm very bad in business so how much money I make I make around seventy thousand dollars per month per month around 15K that we get and 15 chaos and sold thirty thousand dollars per month congratulations bro I wish you the best when you say it I have to say that this guy that's the best AdSense in the world so he makes more money than most of the people that he asks us questions let me share how much I make in the video yeah yeah tell us maybe and then dude I love you\n",
+      "exact same thing we tried at first right after this neural network demonstration so look so it's finished it and ran it there we go and test input I have successfully created synthetic data set and it's given its final answer yeah it's pretty crazy so look let's just grab our instructions without any links and give it to gpt4 and see how far it goes so you didn't even know what to do but I have added return of python script for this let's see what it does now as we see here we got some code loading of the text is fine but there's nothing about link chain it just simply doesn't know what Lang chain is it doesn't know what a QA chain is it's just trying to come up with something cool as far as it knows what's best but this is not what we were looking for by the way we're gonna review the code here in a moment but all the necessary code will be available to my patreon supporters the link will be in the description now let's try it with web browsing with gpt4 this is Cape this uses gpt4 and it\n",
       "\n",
       "\n",
       "\n",
-      "Segment from 'HOW MUCH MONEY DO YOUTUBERS MAKE?' by MrBeast\n",
-      "Timestamp: (02:48, 03:22)\n",
+      "Segment from 'GPT-4 Auto Coder 2 reads docs from URL links and Auto Debugs' by echohive\n",
+      "Timestamp: (07:31, 08:38)\n",
       "\n",
-      "if you see a video with 1 million views they probably made around two thousand dollars if it had you know sponsorship or a brand deal or something they probably made a couple hundred to a couple thousand depending on their size and yeah that's the video make sure you like make sure you subscribe this is an iPad I just dropped the iPad why is the outro not playing Oh Oh\n",
+      "was mostly right it's 95 there all you have to do is just add Dot Page content over here and a good user question and you're good to go which would have taken somehow maybe longer uh to try to figure out from the documentation alone so as we see in the first interaction it actually received an error see set the sequence up so it actually did really well this time but it got the expected string because it had a problem with the how the character text splitter creates the document because it's a tuple so it actually decide to print it see as you see it actually prints it and it understands that it has to use page contents here let's say see says I can see that the text variable contains a list of document objects I need to extract the page content and here it's actually using that text first element of the text the page content versus up here when it was receiving the error it was only trying to let's see where is it it was only trying to use the first element which is the Tuple object right here right the list\n",
       "\n",
       "\n",
       "\n",
-      "Segment from 'How Much YouTube Pays You For 1,000 Views In 2023' by Make Money Matt\n",
-      "Timestamp: (00:00, 00:55)\n",
+      "Segment from 'GPT-4 Auto Coder 2 reads docs from URL links and Auto Debugs' by echohive\n",
+      "Timestamp: (08:38, 09:46)\n",
       "\n",
-      "YouTube shows ads on the videos that you upload at the beginning sometimes in the middle and at the end of your videos once you get 4 000 hours of watch time and a thousand subscribers then you can join What's called the YouTube Partner program then YouTube will pay you a cut of the revenue and that's what we're going to be talking about in this video how much you actually make now I personally run a ton of different YouTube channels and I did some research into both my own channels and other people who've uploaded videos talking about how much money they make per thousand views and the answer is that channels make between one dollar and thirty dollars per thousand views so the average Channel based on my research makes 15.50 per thousand views but with that being said most channels from my personal experience only get around five to ten dollars per thousand views that you make now in order to make more money per thousand views you can do a couple things first of all you can create a channel in what's called a high RPM Niche now RPM is how much you actually\n",
+      "the Tuple within a list does because at the end there's some metadata actually on the third try see it was able to create a code that actually worked perfectly it actually was able to get the answer right now it's actually giving us the final answer but we can just copy this for example you do have to run this in an environment which you have all these packages installed we're going to talk about the requirements here in a moment but if you were to bring it into this test and just run this let me see we are loading our QA chain text splitter we are loading Isaac newton.text and getting first chunk is the first element's page content and we are input inputting that is the document and question is what did Isaac Newton discover me right oh I have to stop that and whenever you run this is actually a working code line chain code question over question answering over documents is you have split documents into three but we are only using the first document and Isaac Michigan discovered the laws of motion and universal gravitation so I found that this works really well\n",
       "\n",
       "\n",
       "\n",
-      "Segment from 'HOW MUCH MONEY DO YOUTUBERS MAKE?' by MrBeast\n",
-      "Timestamp: (00:00, 00:57)\n",
+      "Segment from 'GPT-4 Auto Coder 2 reads docs from URL links and Auto Debugs' by echohive\n",
+      "Timestamp: (04:13, 05:20)\n",
       "\n",
-      "what's up guys today we're gonna be talking about what's up guys today we're gonna be talking about how much money youtubers make I see comments about YouTube money all the time and most people have no idea what they're talking about so the question I see asked the most is how much do youtubers make per view well instead of just making up a random number we're actually going to take a look at my analytics I'm going to pick one day we're gonna see how many views I got and how much money I made off those views that way you know the numbers I'm telling you are actually real so I picked the day from last month and on that day I got 240,000 views and made around six hundred and sixty-nine dollars basically if you do the math that means every thousand views I got around two dollars and seventy cents so I want you to remember that number that every thousand views is two dollars and seventy cents because that's not just a number I made up that straight out of my analytics and we're going to use that to see how much these big\n",
+      "lag format and if we take a look at the documentation as we see actually in the question answering stuff not in nowhere in the two pages stuff chain type is mentioned it's only using mapreduce and we're not going to be using summarize we're saying only question answering QA chain we're not even specifying the exact name and also with the characters text splitter we're saying chunk size to 500 and also the overlap of zero and this will of course split it into multiple pieces but we said that we only want to work with the first element of that first chunk or the first element of the list so as we see so we review it we have the summarize elements we have the QA elements and the text splitter once we know we have all our elements all we have to do is just put our instructions in here I have implemented multi-line input so you can actually paste code here as well because it's a multi-line input we do have to say done and click enter and now we're entering agent executor chain so this is the fun part as you see I have heavily\n",
       "\n",
       "\n",
       "\n",
-      "Segment from 'HOW MUCH MONEY DO YOUTUBERS MAKE?' by MrBeast\n",
-      "Timestamp: (00:57, 02:02)\n",
+      "Segment from 'GPT-4 Auto Coder 2 reads docs from URL links and Auto Debugs' by echohive\n",
+      "Timestamp: (00:00, 01:07)\n",
       "\n",
-      "youtubers are making so if every youtuber made what I made per thousand views that means in the last 30 days nine youtubers have made over a million dollars in just the last 30 days PewDiePie has 13 billion billion with the BEA views and if he made two dollars and seventy cents per thousand views that means over the lifespan of his channel he's made 35 million dollars even better a channel called Ryan toy review has over 6 billion views which means he's potentially made over 16 million dollars off of reviewing toys what's up guys beast toy reviews here and today we're reviewing this toy Karambit as you'll see it's uh can I just get the 16 million dollars and guys it keeps getting better most big youtubers make an additional six figures offer brand deals and sponsorships and to prove that that's true here's the deal that I was offered an app which I'm not going to name offered me $400 to do a video on it and then an additional 50 cents for every one of you that downloaded the app basically if I had done a video on that app I would have got\n",
+      "hey everybody today we're gonna look at different implementation of Auto GPT which writes code debugs it automatically all while using documentation as its guidance what we're going to do is we're going to load this page this URL question answering and summarize analyze document URL and character text Splitter from blank chain and then we're going to ask and we will be using a python agent with the python Ripple which is able to execute code and gets feedback from the output and takes in user instructions to write code whatever you like let's just run this the best way to understand it is to see it when we run this code we are first greeted that the script this script will be Auto executing AI generator code this may be dangerous make sure you're observing the process we have to say accept here once we type in accept and click enter we are asked do you want to load any URLs we're going to say yes we don't have to load URLs if you don't want to you can just give it instructions without the urls I've set it up so that you can load up to three\n",
       "\n",
       "\n",
       "\n",
-      "Youtubers can make between one dollar and thirty dollars per thousand views, with the average channel making around 15.50 dollars per thousand views. However, most channels only get around five to ten dollars per thousand views. Some big youtubers make over a million dollars in just 30 days, and PewDiePie has made 35 million dollars over the lifespan of his channel. Additionally, most big youtubers make an additional six figures from brand deals and sponsorships. [Make Money Matt, 00:00-00:55; MrBeast, 00:57-02:02]\n"
+      "I could not find an answer.\n"
      ]
     },
     {
      "data": {
       "text/plain": [
-       "('Youtubers can make between one dollar and thirty dollars per thousand views, with the average channel making around 15.50 dollars per thousand views. However, most channels only get around five to ten dollars per thousand views. Some big youtubers make over a million dollars in just 30 days, and PewDiePie has made 35 million dollars over the lifespan of his channel. Additionally, most big youtubers make an additional six figures from brand deals and sponsorships. [Make Money Matt, 00:00-00:55; MrBeast, 00:57-02:02]',\n",
-       " 'Segments that might have been used to answer your question: (If you specified more segments than shown here, consider increasing your token budget)\\n\\n### Segment 1 (00:00 -  01:04):\\n<iframe\\n    width=\"400\"\\n    height=\"240\"\\n    src=\"https://www.youtube.com/embed/JZ7GHzkBvzs?start=0&end=64&controls=0\"\\n    frameborder=\"0\"\\n    allow=\"accelerometer; autoplay; modestbranding; encrypted-media; gyroscope; picture-in-picture\"\\n    allowfullscreen\\n    >\\n    </iframe>\\n\\n### Segment 2 (02:48 -  03:22):\\n<iframe\\n    width=\"400\"\\n    height=\"240\"\\n    src=\"https://www.youtube.com/embed/G4qOiwIE_o0?start=168&end=202&controls=0\"\\n    frameborder=\"0\"\\n    allow=\"accelerometer; autoplay; modestbranding; encrypted-media; gyroscope; picture-in-picture\"\\n    allowfullscreen\\n    >\\n    </iframe>\\n\\n### Segment 3 (00:00 -  00:55):\\n<iframe\\n    width=\"400\"\\n    height=\"240\"\\n    src=\"https://www.youtube.com/embed/KA5FmevAzTc?start=0&end=55&controls=0\"\\n    frameborder=\"0\"\\n    allow=\"accelerometer; autoplay; modestbranding; encrypted-media; gyroscope; picture-in-picture\"\\n    allowfullscreen\\n    >\\n    </iframe>\\n\\n### Segment 4 (00:00 -  00:57):\\n<iframe\\n    width=\"400\"\\n    height=\"240\"\\n    src=\"https://www.youtube.com/embed/G4qOiwIE_o0?start=0&end=57&controls=0\"\\n    frameborder=\"0\"\\n    allow=\"accelerometer; autoplay; modestbranding; encrypted-media; gyroscope; picture-in-picture\"\\n    allowfullscreen\\n    >\\n    </iframe>\\n\\n### Segment 5 (00:57 -  02:02):\\n<iframe\\n    width=\"400\"\\n    height=\"240\"\\n    src=\"https://www.youtube.com/embed/G4qOiwIE_o0?start=57&end=122&controls=0\"\\n    frameborder=\"0\"\\n    allow=\"accelerometer; autoplay; modestbranding; encrypted-media; gyroscope; picture-in-picture\"\\n    allowfullscreen\\n    >\\n    </iframe>\\n\\n')"
+       "('I could not find an answer.',\n",
+       " 'Segments that might have been used to answer your question: (If you specified more segments than shown here, consider increasing your token budget)\\n\\n### Segment 1 (12:01 -  13:12):\\n<iframe\\n    width=\"400\"\\n    height=\"240\"\\n    src=\"https://youtube.com/embed/l_r_b38VXmQ?start=721&end=792&controls=0\"\\n    frameborder=\"0\"\\n    allow=\"accelerometer; autoplay; modestbranding; encrypted-media; gyroscope; picture-in-picture\"\\n    allowfullscreen\\n    >\\n    </iframe>\\n\\n### Segment 2 (07:31 -  08:38):\\n<iframe\\n    width=\"400\"\\n    height=\"240\"\\n    src=\"https://youtube.com/embed/l_r_b38VXmQ?start=451&end=518&controls=0\"\\n    frameborder=\"0\"\\n    allow=\"accelerometer; autoplay; modestbranding; encrypted-media; gyroscope; picture-in-picture\"\\n    allowfullscreen\\n    >\\n    </iframe>\\n\\n### Segment 3 (08:38 -  09:46):\\n<iframe\\n    width=\"400\"\\n    height=\"240\"\\n    src=\"https://youtube.com/embed/l_r_b38VXmQ?start=518&end=586&controls=0\"\\n    frameborder=\"0\"\\n    allow=\"accelerometer; autoplay; modestbranding; encrypted-media; gyroscope; picture-in-picture\"\\n    allowfullscreen\\n    >\\n    </iframe>\\n\\n### Segment 4 (04:13 -  05:20):\\n<iframe\\n    width=\"400\"\\n    height=\"240\"\\n    src=\"https://youtube.com/embed/l_r_b38VXmQ?start=253&end=320&controls=0\"\\n    frameborder=\"0\"\\n    allow=\"accelerometer; autoplay; modestbranding; encrypted-media; gyroscope; picture-in-picture\"\\n    allowfullscreen\\n    >\\n    </iframe>\\n\\n### Segment 5 (00:00 -  01:07):\\n<iframe\\n    width=\"400\"\\n    height=\"240\"\\n    src=\"https://youtube.com/embed/l_r_b38VXmQ?start=0&end=67&controls=0\"\\n    frameborder=\"0\"\\n    allow=\"accelerometer; autoplay; modestbranding; encrypted-media; gyroscope; picture-in-picture\"\\n    allowfullscreen\\n    >\\n    </iframe>\\n\\n')"
       ]
      },
-     "execution_count": 21,
+     "execution_count": 22,
      "metadata": {},
      "output_type": "execute_result"
     }
    ],
    "source": [
     "main(openAI_key=\"env\", \n",
-    "    question=\"How much money do youtubers make?\", n_videos=5, \n",
-    "    urls_text=\"\", \n",
+    "    question=\"What it does after extracting only the code\", n_videos=5, \n",
+    "    urls_text=\"https://youtu.be/l_r_b38VXmQ\", \n",
     "    split_by_topic=False, \n",
     "    segment_length=200, \n",
     "    n_neighbours=5, \n",