images
Browse files
README.md
CHANGED
|
@@ -53,6 +53,10 @@ This projects aims to monitor in-demand skills for machine learning roles. Skill
|
|
| 53 |
|
| 54 |
The follow scripts are scheduled to automate the skill monitoring and model tranining processes continually.
|
| 55 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 56 |
### 1. Job-posting scraping
|
| 57 |
Fetching job descriptions for machine learning from LinkedIn via Rapid API.
|
| 58 |
### 2. Skills tagging with LLM
|
|
@@ -63,10 +67,6 @@ The skill extraction model is finetuned with respect to the extracted groundtrut
|
|
| 63 |
Skills are extracted from job-postings with finetuned model
|
| 64 |
### 5. Embedding & visualization
|
| 65 |
Extracted skills are embedded, reduced and clustered with an embedding model, UMAP and K-means respectively.
|
| 66 |
-
### 6. Pipeline Flow
|
| 67 |
-
<div align="center">
|
| 68 |
-
<img src="./images/in-demand-flow.png" alt="Flow Image">
|
| 69 |
-
</div>
|
| 70 |
|
| 71 |
|
| 72 |
<h1>
|
|
|
|
| 53 |
|
| 54 |
The follow scripts are scheduled to automate the skill monitoring and model tranining processes continually.
|
| 55 |
|
| 56 |
+
<div align="center">
|
| 57 |
+
<img src="./images/in-demand-flow.png" alt="Flow Image">
|
| 58 |
+
</div>
|
| 59 |
+
|
| 60 |
### 1. Job-posting scraping
|
| 61 |
Fetching job descriptions for machine learning from LinkedIn via Rapid API.
|
| 62 |
### 2. Skills tagging with LLM
|
|
|
|
| 67 |
Skills are extracted from job-postings with finetuned model
|
| 68 |
### 5. Embedding & visualization
|
| 69 |
Extracted skills are embedded, reduced and clustered with an embedding model, UMAP and K-means respectively.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 70 |
|
| 71 |
|
| 72 |
<h1>
|
app.py
CHANGED
|
@@ -98,15 +98,10 @@ fig.update_layout(
|
|
| 98 |
|
| 99 |
with gr.Blocks() as demo:
|
| 100 |
|
| 101 |
-
|
| 102 |
-
# inputs=gr.Textbox(placeholder="Enter sentence here..."),
|
| 103 |
-
# outputs=["highlight"],
|
| 104 |
-
# examples=examples,
|
| 105 |
-
# title="In-demand skills in machine learning (ML) industry"
|
| 106 |
-
# )
|
| 107 |
-
|
| 108 |
# gr.Markdown("Embedding visualisation of sought skills in ML job posting in Stockholm, Sweden on LinkedIn")
|
| 109 |
gr.Plot(fig)
|
|
|
|
| 110 |
|
| 111 |
|
| 112 |
demo.launch()
|
|
|
|
| 98 |
|
| 99 |
with gr.Blocks() as demo:
|
| 100 |
|
| 101 |
+
gr.Markdown("# 3D Visualization of Skills in ML Job Postings", elem_id="title")
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 102 |
# gr.Markdown("Embedding visualisation of sought skills in ML job posting in Stockholm, Sweden on LinkedIn")
|
| 103 |
gr.Plot(fig)
|
| 104 |
+
|
| 105 |
|
| 106 |
|
| 107 |
demo.launch()
|