当前位置：Gxlcms > 数据库问题 > DATAX 从scv到csv 从csv到mysql

DATAX 从scv到csv 从csv到mysql

时间：2021-07-01 10:21:17 帮助过：11人阅读

{ 2 "setting": {}, 3 "job": { 4 "setting": { 5 "speed": { 6 "channel": 2 7 } 8 }, 9 "content": [ 10 { 11 "reader": { 12 "name": "txtfilereader", 13 "parameter": { 14 "path": ["E:/DATAX/Workplace/TEXT/csv/catalogue.csv"], 15 "encoding": "UTF-8", 16 "column": [ 17 { 18 "index": 0, 19 "type": "string" 20 }, 21 { 22 "index": 1, 23 "type": "string" 24 } 25 ], 26 "fieldDelimiter": ",", 27 "skipHeader": "False" 28 } 29 }, 30 "writer": { 31 "name": "txtfilewriter", 32 "parameter": { 33 "path": "E:/DATAX/Workplace/TEXT/csv", 34 "fileName": "in.csv", 35 "writeMode": "truncate", 36 "format": "yyyy-MM-dd", 37 "header":[‘id‘, ‘info‘] 38 } 39 } 40 } 41 ] 42 } 43 }

从csv到mysql

  1. <span style="color: #008080;"> 1</span> <span style="color: #000000;">{
  2. </span><span style="color: #008080;"> 2</span>     <span style="color: #800000;">"</span><span style="color: #800000;">job</span><span style="color: #800000;">"</span><span style="color: #000000;">: {
  3. </span><span style="color: #008080;"> 3</span>         <span style="color: #800000;">"</span><span style="color: #800000;">setting</span><span style="color: #800000;">"</span><span style="color: #000000;">: {
  4. </span><span style="color: #008080;"> 4</span>             <span style="color: #800000;">"</span><span style="color: #800000;">speed</span><span style="color: #800000;">"</span><span style="color: #000000;">: {
  5. </span><span style="color: #008080;"> 5</span>                 <span style="color: #800000;">"</span><span style="color: #800000;">channel</span><span style="color: #800000;">"</span>: <span style="color: #800080;">2</span>
  6. <span style="color: #008080;"> 6</span> <span style="color: #000000;">            }
  7. </span><span style="color: #008080;"> 7</span> <span style="color: #000000;">        },
  8. </span><span style="color: #008080;"> 8</span>         <span style="color: #800000;">"</span><span style="color: #800000;">content</span><span style="color: #800000;">"</span><span style="color: #000000;">: [
  9. </span><span style="color: #008080;"> 9</span> <span style="color: #000000;">            {
  10. </span><span style="color: #008080;">10</span>                <span style="color: #800000;">"</span><span style="color: #800000;">reader</span><span style="color: #800000;">"</span><span style="color: #000000;">: {
  11. </span><span style="color: #008080;">11</span>                     <span style="color: #800000;">"</span><span style="color: #800000;">name</span><span style="color: #800000;">"</span>: <span style="color: #800000;">"</span><span style="color: #800000;">txtfilereader</span><span style="color: #800000;">"</span><span style="color: #000000;">,
  12. </span><span style="color: #008080;">12</span>                     <span style="color: #800000;">"</span><span style="color: #800000;">parameter</span><span style="color: #800000;">"</span><span style="color: #000000;">: {
  13. </span><span style="color: #008080;">13</span>                         <span style="color: #800000;">"</span><span style="color: #800000;">path</span><span style="color: #800000;">"</span>: [<span style="color: #800000;">"</span><span style="color: #800000;">E:/DATAX/Workplace/TEXT/csv/catalogue.csv</span><span style="color: #800000;">"</span><span style="color: #000000;">],
  14. </span><span style="color: #008080;">14</span>                         <span style="color: #800000;">"</span><span style="color: #800000;">encoding</span><span style="color: #800000;">"</span>: <span style="color: #800000;">"</span><span style="color: #800000;">UTF-8</span><span style="color: #800000;">"</span><span style="color: #000000;">,
  15. </span><span style="color: #008080;">15</span>                         <span style="color: #800000;">"</span><span style="color: #800000;">column</span><span style="color: #800000;">"</span><span style="color: #000000;">: [
  16. </span><span style="color: #008080;">16</span> <span style="color: #000000;">                            {
  17. </span><span style="color: #008080;">17</span>                                 <span style="color: #800000;">"</span><span style="color: #800000;">index</span><span style="color: #800000;">"</span>: <span style="color: #800080;">0</span><span style="color: #000000;">,
  18. </span><span style="color: #008080;">18</span>                                 <span style="color: #800000;">"</span><span style="color: #800000;">type</span><span style="color: #800000;">"</span>: <span style="color: #800000;">"</span><span style="color: #800000;">string</span><span style="color: #800000;">"</span>
  19. <span style="color: #008080;">19</span> <span style="color: #000000;">                            },
  20. </span><span style="color: #008080;">20</span> <span style="color: #000000;">                            {
  21. </span><span style="color: #008080;">21</span>                                 <span style="color: #800000;">"</span><span style="color: #800000;">index</span><span style="color: #800000;">"</span>: <span style="color: #800080;">1</span><span style="color: #000000;">,
  22. </span><span style="color: #008080;">22</span>                                 <span style="color: #800000;">"</span><span style="color: #800000;">type</span><span style="color: #800000;">"</span>: <span style="color: #800000;">"</span><span style="color: #800000;">string</span><span style="color: #800000;">"</span>
  23. <span style="color: #008080;">23</span> <span style="color: #000000;">                            }
  24. </span><span style="color: #008080;">24</span> <span style="color: #000000;">                        ],
  25. </span><span style="color: #008080;">25</span>                         <span style="color: #800000;">"</span><span style="color: #800000;">fieldDelimiter</span><span style="color: #800000;">"</span>: <span style="color: #800000;">"</span><span style="color: #800000;">,</span><span style="color: #800000;">"</span><span style="color: #000000;">,
  26. </span><span style="color: #008080;">26</span>                         <span style="color: #800000;">"</span><span style="color: #800000;">skipHeader</span><span style="color: #800000;">"</span>: <span style="color: #800000;">"</span><span style="color: #800000;">False</span><span style="color: #800000;">"</span>
  27. <span style="color: #008080;">27</span> <span style="color: #000000;">                    }
  28. </span><span style="color: #008080;">28</span> <span style="color: #000000;">                },
  29. </span><span style="color: #008080;">29</span>                 
  30. <span style="color: #008080;">30</span>                <span style="color: #800000;">"</span><span style="color: #800000;">writer</span><span style="color: #800000;">"</span><span style="color: #000000;">: {
  31. </span><span style="color: #008080;">31</span> 
  32. <span style="color: #008080;">32</span>                     <span style="color: #800000;">"</span><span style="color: #800000;">name</span><span style="color: #800000;">"</span>: <span style="color: #800000;">"</span><span style="color: #800000;">mysqlwriter</span><span style="color: #800000;">"</span><span style="color: #000000;">,
  33. </span><span style="color: #008080;">33</span> 
  34. <span style="color: #008080;">34</span>                     <span style="color: #800000;">"</span><span style="color: #800000;">parameter</span><span style="color: #800000;">"</span><span style="color: #000000;">: {
  35. </span><span style="color: #008080;">35</span> 
  36. <span style="color: #008080;">36</span>                         <span style="color: #800000;">"</span><span style="color: #800000;">writeMode</span><span style="color: #800000;">"</span>: <span style="color: #800000;">"</span><span style="color: #800000;">insert</span><span style="color: #800000;">"</span><span style="color: #000000;">,
  37. </span><span style="color: #008080;">37</span> 
  38. <span style="color: #008080;">38</span>                         <span style="color: #800000;">"</span><span style="color: #800000;">username</span><span style="color: #800000;">"</span>: <span style="color: #800000;">"</span><span style="color: #800000;">root</span><span style="color: #800000;">"</span><span style="color: #000000;">,
  39. </span><span style="color: #008080;">39</span> 
  40. <span style="color: #008080;">40</span>                         <span style="color: #800000;">"</span><span style="color: #800000;">password</span><span style="color: #800000;">"</span>: <span style="color: #800000;">"</span><span style="color: #800000;">zb753951</span><span style="color: #800000;">"</span><span style="color: #000000;">,
  41. </span><span style="color: #008080;">41</span> 
  42. <span style="color: #008080;">42</span>                         <span style="color: #800000;">"</span><span style="color: #800000;">column</span><span style="color: #800000;">"</span><span style="color: #000000;">: [
  43. </span><span style="color: #008080;">43</span> 
  44. <span style="color: #008080;">44</span>                             <span style="color: #800000;">"</span><span style="color: #800000;">name</span><span style="color: #800000;">"</span><span style="color: #000000;">,
  45. </span><span style="color: #008080;">45</span> 
  46. <span style="color: #008080;">46</span>                             <span style="color: #800000;">"</span><span style="color: #800000;">value</span><span style="color: #800000;">"</span>
  47. <span style="color: #008080;">47</span> 
  48. <span style="color: #008080;">48</span> <span style="color: #000000;">                        ],
  49. </span><span style="color: #008080;">49</span> 
  50. <span style="color: #008080;">50</span>                         <span style="color: #800000;">"</span><span style="color: #800000;">session</span><span style="color: #800000;">"</span><span style="color: #000000;">: [],
  51. </span><span style="color: #008080;">51</span> 
  52. <span style="color: #008080;">52</span>                         <span style="color: #800000;">"</span><span style="color: #800000;">connection</span><span style="color: #800000;">"</span><span style="color: #000000;">: [
  53. </span><span style="color: #008080;">53</span> 
  54. <span style="color: #008080;">54</span> <span style="color: #000000;">                            {
  55. </span><span style="color: #008080;">55</span> 
  56. <span style="color: #008080;">56</span>                                 <span style="color: #800000;">"</span><span style="color: #800000;">jdbcUrl</span><span style="color: #800000;">"</span>: <span style="color: #800000;">"</span><span style="color: #800000;">jdbc:mysql://127.0.0.1:3306/datax?useUnicode=true&characterEncoding=utf8&useSSL=false&serverTimezone=GMT%2B8</span><span style="color: #800000;">"</span><span style="color: #000000;">,
  57. </span><span style="color: #008080;">57</span> 
  58. <span style="color: #008080;">58</span>                                 <span style="color: #800000;">"</span><span style="color: #800000;">table</span><span style="color: #800000;">"</span>: [<span style="color: #800000;">"</span><span style="color: #800000;">csv1</span><span style="color: #800000;">"</span><span style="color: #000000;">]
  59. </span><span style="color: #008080;">59</span> 
  60. <span style="color: #008080;">60</span> <span style="color: #000000;">                            }
  61. </span><span style="color: #008080;">61</span> 
  62. <span style="color: #008080;">62</span> <span style="color: #000000;">                        ]
  63. </span><span style="color: #008080;">63</span> 
  64. <span style="color: #008080;">64</span> <span style="color: #000000;">                    }
  65. </span><span style="color: #008080;">65</span> 
  66. <span style="color: #008080;">66</span> <span style="color: #000000;">                }
  67. </span><span style="color: #008080;">67</span>                 
  68. <span style="color: #008080;">68</span>                 
  69. <span style="color: #008080;">69</span> <span style="color: #000000;">            }
  70. </span><span style="color: #008080;">70</span> <span style="color: #000000;">        ]
  71. </span><span style="color: #008080;">71</span> <span style="color: #000000;">    }
  72. </span><span style="color: #008080;">72</span> }

 

DATAX 从scv到csv 从csv到mysql

标签：setting   ace   ldd   insert   UNC   odi   ssi   param   root   

人气教程排行

本站所有资源全部来源于网络，若本站发布的内容侵害到您的隐私或者利益，请联系我们删除！