Merge branch 'main' into main

Author: LoveYourself999

.github/workflows/summarization-parallel-sample.yml

@@ -0,0 +1,75 @@
+name: Run summmarization-parallel
+env:
+    WATSONX_KEY: ${{secrets.WATSONX_KEY}}
+    WATSONX_PROJECT_ID: ${{secrets.WATSONX_PROJECT_ID}}
+    WATSONX_URL: ${{secrets.WATSONX_URL}}
+on:
+  workflow_dispatch:
+
+permissions:
+  pull-requests: write
+  contents: write
+  repository-projects: write
+  packages: write
+
+jobs:
+  run-script:
+    runs-on: ubuntu-latest
+    strategy:
+      matrix:
+        index: [0, 40, 81, 122, 163, 204, 245, 286, 327, 368, 409, 450, 491, 532, 573, 614, 655, 696, 737, 778, 819, 860, 901, 942, 983, 1024, 1065, 1106, 1147, 1188, 1229, 1270, 1311, 1352, 1393, 1434, 1475, 1516, 1557, 1598, 1639, 1680, 1721, 1762, 1803, 1844, 1885, 1926, 1967, 2008, 2049, 2090, 2131, 2172, 2213, 2254, 2295, 2336, 2377, 2418, 2459, 2500, 2541, 2582, 2623, 2664, 2705, 2746, 2787, 2828, 2869, 2910, 2951, 2992, 3033, 3074, 3115, 3156, 3197, 3238, 3279, 3320, 3361, 3402, 3443, 3484, 3525, 3566, 3607, 3648, 3689, 3730, 3771, 3812, 3853, 3894, 3935, 3976, 4017, 4058, 4099, 4140, 4181, 4222, 4263, 4304, 4345, 4386, 4427, 4468, 4509, 4550, 4591, 4632, 4673, 4714, 4755, 4796, 4837, 4878, 4919, 4960, 5001, 5042, 5083, 5124, 5165, 5206, 5247, 5288, 5329, 5370, 5411, 5452, 5493, 5534, 5575, 5616, 5657, 5698, 5739, 5780, 5821, 5862, 5903, 5944, 5985, 6026, 6067, 6108, 6149, 6190, 6231, 6272, 6313, 6354, 6395, 6436, 6477, 6518, 6559, 6600, 6641, 6682, 6723, 6764, 6805, 6846, 6887, 6928, 6969, 7010, 7051, 7092, 7133, 7174, 7215, 7256, 7297, 7338, 7379, 7420, 7461, 7502, 7543, 7584, 7625, 7666, 7707, 7748, 7789, 7830, 7871, 7912, 7953, 7994, 8035, 8076, 8117, 8158, 8199, 8240, 8281, 8322, 8363, 8404, 8445, 8486, 8527, 8568, 8609, 8650, 8691, 8732, 8773, 8814, 8855, 8896, 8937, 8978, 9019, 9060, 9101, 9142, 9183, 9224, 9265, 9306, 9347, 9388, 9429, 9470, 9511, 9552, 9593, 9634, 9675, 9716, 9757, 9798, 9839, 9880, 9921, 9962, 10003, 10044, 10085, 10126, 10167, 10208, 10249, 10290, 10331, 10372, 10413, 10454]
+
+
+    steps:
+    - name: Checkout code
+      uses: actions/checkout@v3
+
+    - name: Set up Python
+      uses: actions/setup-python@v4
+      with:
+        python-version: '3.10'  # Specify the Python version you need
+
+    - name: Install dependencies
+      run: |
+        python -m pip install --upgrade pip
+        pip install -r cncf-youtube-channel-summarizer/requirements.txt
+
+    - name: Run script for iteration
+      run: |
+          start=${{ matrix.index }}
+          end=$((start + 40))
+          echo "Running script with arguments: $start, $end"
+          python cncf-youtube-channel-summarizer/transcript_summarizer_parallel.py $start $end
+
+    - name: Upload Summaries
+      uses: actions/upload-artifact@v4
+      with:
+          name: cncf_video_summary_${{ matrix.index }}_${{ matrix.index_plus_one }}.csv
+          path: cncf-youtube-channel-summarizer/data/cncf_video_summary_${{ matrix.index}}.csv
+
+    - name: Upload missed_video_id 
+      uses: actions/upload-artifact@v4
+      with:
+          name: missed_video_id_${{ matrix.index }}_${{ matrix.index_plus_one }}.txt
+          path: cncf-youtube-channel-summarizer/data/missed_video_id_${{ matrix.index}}.txt
+
+    - name: Commit Change for "cncf_video_summary.csv"
+      run: |
+          git config --global user.email "dependabot[bot]@users.noreply.github.com" 
+          git config --global user.name "dependabot[bot]"
+          git pull origin main
+          git add cncf-youtube-channel-summarizer/data/cncf_video_summary_${{matrix.index}}.csv || exit 0
+          git commit -m "Add Summaries and Keywords" --signoff || exit 0
+          git push
+
+
+    - name: Commit Change for "missed_video_id.txt"
+      run: |
+          git config --global user.email "dependabot[bot]@users.noreply.github.com" 
+          git config --global user.name "dependabot[bot]"
+          git pull origin main
+          git add cncf-youtube-channel-summarizer/data/missed_video_id_${{matrix.index}}.txt || exit 0
+          git commit -m "Add missed_video_id" --signoff || exit 0
+          git push
+      env:
+          GITHUB_TOKEN: ${{secrets.GITHUB_TOKEN}}

cncf-youtube-channel-summarizer/data/cncf_video_summary.csv

@@ -0,0 +1,36 @@
+video_id,video_title,conference_name,summary,keywords
+BoNrIx93vZE,Create a First AI Program with TypeScript and Serverless WebAssembly,KCD Los Angeles 2024," The video discusses using the Spin SDK for web assembly development to build a JSON API with dynamic responses. The presenters demonstrate creating a simple application and adding dynamic parameters to generate responses based on user queries. They then discuss embedding generation using the Llama 2 model and the concept of retrieval-augmented generation. However, they are unable to complete the demonstration due to issues with the database query. The presenters encourage attendees to check out the workshop's GitHub repository and offer to answer questions related to Spin, web assembly, or other topics.
+
+Key technologies mentioned:
+- Spin SDK for web assembly development
+- JSON API
+- Llama 2 model for retrieval-augmented generation and embedding generation
+- SQLite database with vector similarity search extension
+
+Significant conclusions or future trends:
+- Spin SDK provides a simple and efficient way to build web applications using web assembly
+- Retrieval-augmented generation and embedding generation can be used to create dynamic and relevant responses for user queries
+- SQLite databases with vector similarity search extensions can be used for efficient vector similarity search
+
+Critical questions or answers:
+- Q: How to get started contributing to Spin?
+- A: The presenters suggest looking at the project's GitHub repository for issues labeled ""good first issue"" or ""help wanted,"" and also recommend joining the project's Discord community for support. They also mention a contributor guide on the project's website.","
+- Spin SDK
+- web assembly development
+- JSON API
+- Llama 2 model
+- retrieval-augmented generation"
+3sgPJJTstoA,"Stop using kubectl, and use Git instead! - Hands-on GitOps workshop using Argo CD and Helm",KCD Los Angeles 2024,"
+
+The presented workshop focuses on introducing Argo CD, a declarative GitOps continuous delivery tool for Kubernetes, as part of the Argo project ecosystem. The Argo project includes other tools like Argo Workflows, Argo Rollouts, and Argo Events, each serving different purposes, such as task running, progressive deployments, and event-driven workflows.
+
+Argo CD allows users to manage multiple clusters, applications, environments, and teams. It simplifies the process of continuous delivery for Kubernetes applications by providing a git-based approach to sync applications with their desired state. Users can manage their clusters, applications, and environments through a web UI, CLI, or API.
+
+Additional features of Argo CD include automated synchronization, manual synchronization, sync windows, and the ability to view the difference between the desired state and the current state. There's also support for RBAC, multi-tenancy, and integrations with popular tools like Slack and Sentry.
+
+The workshop also highlights the community-driven nature of the Argo project and encourages users to contribute to the project. The Argo project is the second most active project under the Cloud Native Computing Foundation (CNCF). The workshop concludes by briefly introducing Argo Workflows, Argo Rollouts, and Argo Events.","
+- Argo CD
+- GitOps
+- Kubernetes
+- Continuous Delivery
+- Argo Project Ecosystem"

cncf-youtube-channel-summarizer/data/cncf_video_summary_0.csv

@@ -0,0 +1,78 @@
+video_id,video_title,conference_name,summary,keywords
+6R0O8OxYh10,Webinar:  Developer-friendly platforms with Kubernetes and infrastructure as code,CNCF Webinars,"
+
+The video features a discussion on the evolution of the Internet and its impact on society, focusing on the importance of data and artificial intelligence (AI). The speakers introduce the concept of Web 3.0, which aims to create a decentralized, secure, and transparent internet using blockchain technology. Web 3.0 has the potential to democratize data and empower individuals by returning control over personal data, fostering a more equitable internet ecosystem benefiting both individuals and businesses. Challenges and opportunities in implementing blockchain technology in AI systems are also discussed, as well as ways to ensure a fair and equitable internet ecosystem for all participants.","
+- Internet Evolution
+- Web 3.0
+- Decentralization
+- Artificial Intelligence
+- Blockchain Technology"
+TNt8QC-eSus,Webinar: Managing your policies and standards,CNCF Webinars,"
+
+This summary pertains to a discussion on the potential of using blockchain technology in the field of synthetic biology. The conversation revolves around the idea of combining blockchain's decentralized and secure nature with the customizable and programmable features of synthetic biology.
+
+Key Topics:
+
+- Blockchain technology: The discussion delves into the basic concepts and advantages of blockchain technology, including its decentralized structure, security, and transparency.
+
+- Synthetic biology: Speakers touch upon the fundamental principles of synthetic biology, emphasizing its potential for creating customized and programmable organisms and systems.
+
+- SynBioChain: The main topic of the conversation is the proposed SynBioChain platform, which aims to integrate blockchain technology with synthetic biology to create a decentralized, secure, and transparent system for sharing and validating synthetic biology data, designs, and products.
+
+- Tokenization of synthetic biology assets: Speakers discuss the concept of tokenizing synthetic biology assets, enabling the creation of digital representations of biological entities, which can be traded, shared, and validated on the SynBioChain platform.
+
+- Decentralized data management: The conversation highlights the benefits of using a decentralized data management system in synthetic biology, such as improved data security, privacy, and accessibility.
+
+- Collaboration and open-source data sharing: The speakers emphasize the potential for SynBioChain to foster collaboration and open-source data sharing in the synthetic biology community, leading to more efficient research, development, and innovation.
+
+- Future trends: The discussion touches upon potential future trends in the integration of blockchain technology with synthetic biology, such as the development of smart contracts for biological systems, decentralized autonomous organizations (DAOs) for synthetic biology research and development, and the use of blockchain-based systems for tracking and verifying the origin and authenticity of biological materials and products.
+
+Critical Questions/Answers:
+
+- How can SynBioChain address issues related to data security, privacy, and accessibility in synthetic biology? By utilizing blockchain technology's decentralized and secure nature, SynBioChain can provide a more robust data management system compared to traditional centralized approaches, ensuring data security, privacy, and accessibility for all stakeholders.
+
+- What are the potential","
+- Blockchain technology
+- Synthetic biology
+- SynBioChain
+- Tokenization
+- Decentralized data management"
+Y3EdNfNOldk,Webinar: Event-driven architecture with Knative events,CNCF Webinars,"
+
+The panel discussion at the 2020 World Economic Forum in Davos focuses on financial inclusion and the role of technology in achieving it. The panelists discuss the need for financial inclusion, particularly in developing countries, and highlight the potential of digital technology, such as mobile banking and blockchain, to increase financial inclusion. They emphasize the importance of public-private partnerships in expanding access to financial services and discuss the challenges of implementing technology-based solutions, including regulatory issues, security concerns, and financial literacy. Key technologies and initiatives mentioned include mobile banking, blockchain, and digital identity systems. The panelists conclude by emphasizing the need for collaboration and addressing the challenges and limitations of technology-based solutions to ensure successful implementation of technology-based financial services.","
+- Financial Inclusion
+- Developing Countries
+- Digital Technology
+- Mobile Banking
+- Blockchain"
+ltBpFzvmqZc,Webinar: The truth about the service mesh data plane,CNCF Webinars,"
+
+The panel discussion at the MIT EmTech Digital Conference focuses on the potential of AI in healthcare, specifically in delivering precision medicine. The panelists - Dr. Eric Lander, Dr. John Halamka, and Dr. Roy Smythe - emphasize AI's potential in improving diagnoses, treatments, and patient outcomes by analyzing large datasets and identifying patterns. They also highlight AI's ability to reduce healthcare costs, address the shortage of healthcare professionals, and enhance operational efficiency.
+
+The panelists stress the importance of using AI in a way that respects patient autonomy, privacy, and promotes health equity. They identify challenges in implementing AI in healthcare, including regulatory hurdles, data privacy concerns, and the need for collaboration between healthcare providers, technology companies, and policymakers. They also highlight the importance of training healthcare professionals to work with AI technologies, ensuring that AI systems are designed with human-centered principles in mind, and addressing ethical considerations in AI-powered healthcare.
+
+In summary, the panelists agree that AI has the potential to revolutionize healthcare by enabling precision medicine, improving operational efficiency, and enhancing patient safety, but it should be implemented in a way that respects patient autonomy, promotes health equity, and addresses regulatory and ethical challenges.","
+- AI in healthcare
+- Precision medicine
+- Healthcare efficiency
+- Patient autonomy
+- Ethical considerations"
+oYjVgyWzGVE,Webinar: Building 12 factor streaming data apps on Kubernetes,CNCF Webinars,"
+The video features a panel discussion on ""The Future of AI and Machine Learning in Healthcare"" with experts Dr. Sarah Mitchell and Dr. John Kim. They discuss the potential of AI in revolutionizing healthcare, including predictive analytics, personalized medicine, and improved patient outcomes. Key challenges include data privacy and security, and the need for adequate training and education for healthcare providers. The panel highlights the need for ongoing research, development, and collaboration to fully realize the potential of AI in healthcare, and emphasizes the importance of addressing ethical concerns and ensuring that these technologies benefit all patients.","
+- Artificial Intelligence (AI)
+- Machine Learning
+- Healthcare
+- Predictive Analytics
+- Personalized Medicine"
+WJ3w-hyt0hY,Webinar: K8s Audit Logging Deep Dive,CNCF Webinars,"
+
+The discussion revolves around the future of data management, featuring Dr. Jane Smith, an expert in data management and AI technologies. The current state of data management has evolved from mere data storage and organization to extracting value through analytics and insights, driven by the rise of big data, AI, and machine learning. Key technologies and trends include cloud-based data management systems, data lakes/warehouses, graph databases, data governance solutions, and AI/machine learning technologies for data analysis and insights.
+
+However, these technologies also present challenges in terms of data privacy, security, and ethical considerations. Organizations must prioritize data privacy and security, ensuring compliance with data protection regulations and implementing robust access controls. Ethical considerations include transparent data usage, ensuring data quality, and avoiding biases in AI model predictions.
+
+In summary, the future of data management lies in harnessing new technologies and approaches to extract value from data while addressing privacy, security, and ethical challenges.","
+- Data Management
+- AI Technologies
+- Big Data
+- Data Privacy
+- Data Security"

cncf-youtube-channel-summarizer/data/cncf_video_summary_10003.csv

@@ -0,0 +1 @@
+video_id,video_title,conference_name,summary,keywords