Is it possible to run Cloud Dataflow with custom packages? -


Is it possible to provision dataflow workers with custom packages? I want to open in a Debian-packed binary from inside computing.

EDIT: To be clear, the package configuration is complicated enough - it is not possible to simply bundle files in files. At some point in the solution, the Debian package should be installed.

This does not clearly support some dataflows. However, some suggestions below are how you can accomplish this. Please keep in mind that things can change in the future, things that can change.

There are two different problems:

  1. Receiving the Debian package on the worker
  2. Installing the Debian package.

For the first issue you can use --filesToStage and specify the path to your Debian package. This will upload the package to GCS and then the work will be downloaded at startup. If you use this option, you should be included in the value of the files for all your JARs, because they will not be included by default if you set it explicitly - FileStorage.

Any file on the Java worker will be available in these files in the following directory (or subdirectory) 

  / var / opt / google / dataflow

or

we

we

Will be required to find the guarantee. Provide no guarantee that these directories will not change in the future; these are the only places used today.

To solve the second problem, you can override yourself from here, you can open it outside the command line and after finding it in the / dataphlau / package, install your Debian package. You can.

Many instances of your DWN running side may be so that you can get conflicts with problems, two processes try to install your package together, I'm not sure that the Debian package system can handle it Or you need explicitly in your code.

This approach is not to use a slight type of - add files to your employees to distribute the package but rather to add it to your starting bundle to bring it to a certain place.


Comments

Post a Comment

Popular posts from this blog

python - Overriding the save method in Django ModelForm -

I'm having trouble overriding a ModelForm save method. I get this error I'm: Exception type: TypeErier Exception Value: Save () found an unexpected keyword argument 'committed' My intentions include a form 3 fields Submit several values ​​for, then create an object for each combination of those areas, and to save each object file models.py class collarsult type (models.Model): id = model. AutoField (db_column = 'icontact_result_code_type_id', primary_key = true) callResult = models.ForeignKey ( 'CallResult', db_column = 'icontact_result_code_id') campaign = models.ForeignKey ( 'campaign', db_column = 'icampaign_id') CALLTYPE = models.ForeignKey ( 'CALLTYPE', db_column = 'icall_type_id') agent = models.BooleanField (db_column = 'bagent', default = true) teamLeader = models.BooleanField (db_column = 'bTeamLeader', default = true) active = models.BooleanField (db_column = Django.form...
Read more

html - CSS autoheight, but fit content to height of div -

I have a div in which there are three children- div in the left and middle div: float: left while true: float: true because it is my layout Actually will spoil, I've used ClearFix Hack: .cf {zoom: 1; }. Cf: First,. Cf: {content: ""; Display: Table; }. Cf: After {clear: both; } It still works, but I want to be the right div an indicator. So it should fill 100% of the parent unit of height. How can I complete this? PS is the full code: & Lt; / Div & gt; & Lt; Div class = "mobile_content" & gt; & Lt; H5 & gt; {{Data.titel}} & lt; / H5> & Lt; Table & gt; & Lt; TR & gt; & Lt; Th & gt; Komponist: & lt; / Th & gt; & Lt; TD & gt; {{Data.komponist}} & lt; / TD & gt; & Lt; / TR & gt; & Lt; TR & gt; & Lt; Th & gt; Instrument: & lt; / Th & gt; & Lt; TD & gt; {{Data.instrumente}} & lt; / TD & gt; & Lt; / TR & gt;...
Read more

qt - How to prevent QAudioInput from automatically boosting the master volume to 100%? -

I have been trying to use Qt5 multimedia to record audio with QAudioInput, however, when I see If QAudioInput is started, it increases the master volume of my sound device to 100%. How can I prevent QAudioInput from changing the master volume? My current development platform is Linux with PalsAdio (with flat audio disabled). How can I use QAudioInput : QAudioDeviceInfo device_info = QAudioDeviceInfo :: defaultInputDevice (); QAudio format format; Format.setSampleRate (44100); Format.setChannelCount (1); Format.setSampleSize (16); Format.setCodec ("Audio / PCM"); Format.setSampleType (QAudioFormat :: SignedInt); Format.setByteOrder (QAudioFormat :: LittleEndian); Std :: cout & lt; & Lt; Device_info.deviceName (). ToUtf8 (). ConstData () & lt; & Lt; Std :: endl; QAudioInput * default_device = new QAudioInput (device_info, format); QIODevice * default_io_device = default_device-> Start (); a QAudioInput.setVolume () method is not you I ...
Read more