-
Notifications
You must be signed in to change notification settings - Fork 5.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Video frame extraction #4085
base: main
Are you sure you want to change the base?
Video frame extraction #4085
Conversation
# Conflicts: # web/i18n/lang/app-overview.zh.ts
…edded-chrome-plugin
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Azure openai add gpt4v&1106
Mermaid front end optimize
Embedded chrome plugin
…ction # Conflicts: # api/models/model.py
…eo-frame-extraction
…eo-frame-extraction # Conflicts: # api/config.py
We are currently reorganizing and designing the file data structure. We will communicate with you about adjustments after we finish the design. 😁 |
Okay, no problem. |
We have aligned on this requirement within our team. Since this feature is beyond the capabilities of the native multimodal model, and the positioning of the basic chatbot is low-threshold, we suggest providing support at the tool level for use by Workflow professionals. |
Description
Using video frame extraction and ASR technology to realize short video content inference
When debugging ChatFlow app、Workflow app in the development environment, change 'api/core/file/file_obj.py' as follows:
’‘’
@Property
def preview_url(self) -> Optional[str]:
"""
Get signed preview url
:return:
"""
return self._get_data(force_url=True)
‘’‘
change to
’‘’
@Property
def preview_url(self) -> Optional[str]:
"""
Get signed preview url
:return:
"""
return self._get_data(force_url=False)
‘’‘
Fixes # (issue)
Type of Change
Please delete options that are not relevant.
How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration
![WechatIMG1352](https://cdn.statically.io/img/private-user-images.githubusercontent.com/24435100/327965247-220a1fb3-8076-42b3-8eae-674c4194bda7.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjI0OTYzNjcsIm5iZiI6MTcyMjQ5NjA2NywicGF0aCI6Ii8yNDQzNTEwMC8zMjc5NjUyNDctMjIwYTFmYjMtODA3Ni00MmIzLThlYWUtNjc0YzQxOTRiZGE3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MDElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODAxVDA3MDc0N1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTU3Y2UxZGFlYjU0MmQwNDBkNDg3MzMyZjUwYTEzNmUxMmJlNTc1NjAwZTFjYmM5OTJkZDNmMTA1Mzc5Mjg4NTMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.Y1X4nWlFMsV0t3hILYmQdy8G35MLa_ajzx3kmUwDLL8)
![WechatIMG1340](https://cdn.statically.io/img/private-user-images.githubusercontent.com/24435100/327965252-99fd41a5-dd7b-464b-be59-40090db2c8af.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjI0OTYzNjcsIm5iZiI6MTcyMjQ5NjA2NywicGF0aCI6Ii8yNDQzNTEwMC8zMjc5NjUyNTItOTlmZDQxYTUtZGQ3Yi00NjRiLWJlNTktNDAwOTBkYjJjOGFmLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MDElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODAxVDA3MDc0N1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTRlMGFjYTFkMzAzZmZmMjRhNWFmMzFlZmExOTY2YTFmNWRlYzkzOGNkNGViZTg1MDcwOTUwMmE2ZmRmZGY1ZWYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.njI63AqZKIAzfYj8jDiz9FWYjug5OAe-sFth9jjSIWE)
![11](https://cdn.statically.io/img/private-user-images.githubusercontent.com/24435100/327965254-b84b613b-58fb-4b6c-9d80-76710964a7b2.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjI0OTYzNjcsIm5iZiI6MTcyMjQ5NjA2NywicGF0aCI6Ii8yNDQzNTEwMC8zMjc5NjUyNTQtYjg0YjYxM2ItNThmYi00YjZjLTlkODAtNzY3MTA5NjRhN2IyLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MDElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODAxVDA3MDc0N1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTU2NzRkOGQ3ODQxNjhhNmIyZTI3NGRlOWQ5MjkyMjUyNjFlZmU0N2Q3ZjNmNjEyYWVmYTY5YjA3YTVkOTA4N2UmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.02oegdcvbsf4_pGYJO2wuFcnwpy28sa9U4gytGWQtEY)
Suggested Checklist:
dev/reformat
(backend) andcd web && npx lint-staged
(frontend) to appease the lint godsoptional
I have made corresponding changes to the documentationoptional
I have added tests that prove my fix is effective or that my feature worksoptional
New and existing unit tests pass locally with my changes