Unclaimed project
Are you a maintainer of piflow? Claim this project to take control of your public changelog and roadmap.
Changelog
πflow is a big data flow engine with spark support
Last updated about 1 month ago
spark.master=yarn
spark.deploy.mode=cluster
#hdfs default file system
fs.defaultFS=hdfs://10.0.85.83:9000
#yarn resourcemanager hostname
yarn.resourcemanager.hostname=10.0.85.83
#if you want to use hive, set hive metastore uris
#hive.metastore.uris=thrift://10.0.85.83:9083
#show data in log, set 0 if you do not show the logs
data.show=10
#monitor the throughput of flow
monitor.throughput=true
#server port
server.port=8001
#h2db port
h2.port=50001
#if you want to mount python component,please set hdfs params
#hdfs.cluster=master:127.0.0.1;slave1:127.0.0.2
#hdfs.web.url=master:50070
./start.sh
./stop.sh
./restart.sh
./status.sh
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
A feature-rich command-line audio/video downloader
Python tool for converting files and office documents to Markdown.
:octocat: 分享 GitHub 上有趣、入门级的开源项目。Share interesting, entry-level open source projects on GitHub.